KARAOKE SCENE MAGAZINE ONLINE! - Removing Duplicate Songs Public Forums Karaoke Discussions Karaoke Scene's Karaoke Forums Home | Contact Us | Site Map  

Karaoke Forums

Karaoke Scene Karaoke Forums

Karaoke Scene

   
  * Login
  * Register

  * FAQ
  * Search

Custom Search

Social Networks


premium-member

Offsite Links


It is currently Wed Apr 17, 2024 8:12 pm

All times are UTC - 8 hours





Post new topic Reply to topic  [ 57 posts ]  Go to page Previous  1, 2, 3  Next
Author Message
PostPosted: Tue Nov 25, 2014 4:25 pm 
Offline
Extreme Plus Poster
Extreme Plus Poster
User avatar

Joined: Sun Nov 27, 2005 11:31 am
Posts: 5353
Location: Watebrury, CT
Been Liked: 397 times
alexias wrote:
DuplicateFilesDeleter works excellent to find duplicate files and delete them quickly than other software. You may also try it and I m sure you will be happy too. Thank you!


Chris wants to remove the same songs as he has more than one version. I highly doubt duplictefilesdeleter will do what he wants because I assume that with the program all the files need to be named the same right down to the extention.

_________________
The Line Array Experiment is over. Nothing to see here. Move along.


Top
 Profile Singer's Showcase Profile 
 
PostPosted: Tue Nov 25, 2014 6:16 pm 
Offline
Super Extreme Poster
Super Extreme Poster
User avatar

Joined: Mon Dec 10, 2001 3:57 pm
Posts: 22975
Songs: 35
Images: 3
Location: Tacoma, WA
Been Liked: 2126 times
DannyG2006 wrote:
alexias wrote:
DuplicateFilesDeleter works excellent to find duplicate files and delete them quickly than other software. You may also try it and I m sure you will be happy too. Thank you!


Chris wants to remove the same songs as he has more than one version. I highly doubt duplictefilesdeleter will do what he wants because I assume that with the program all the files need to be named the same right down to the extention.

I highly doubt that the poster of that post is really concerned and it's more a spam hit & run. If I'm wrong i'll apologize!

_________________
LIKE Lonman on Facebook - Lonman Productions Karaoke & my main site via my profile!
Image


Top
 Profile Personal album Singer's Showcase Profile 
 
PostPosted: Tue Nov 25, 2014 10:24 pm 
Offline
Super Poster
Super Poster

Joined: Sat Nov 01, 2014 8:41 am
Posts: 682
Been Liked: 259 times
But Chris . . . Why are you changing or moving files? A "Professional" KJ has no need to move or delete files because a "Professional" KJ is organized and knows from the very start where each and every file belongs! 8>))))))))))


Top
 Profile Singer's Showcase Profile 
 
PostPosted: Wed Feb 03, 2016 12:19 am 
Offline
Major Poster
Major Poster

Joined: Sat Dec 28, 2013 1:19 am
Posts: 50
Location: From UK but living in Cyprus
Been Liked: 1 time
I'm running Duplicate Files Deleter

I’ve gone for scanning .mp3 files only and leaving all the .cdg files where they are, I’m worried if I delete all duplicates, the program will delete an MP3 from one folder making the CDG file redundant and vice versa.

_________________
facebook - PJs Karaoke Disco


Top
 Profile Singer's Showcase Profile 
 
PostPosted: Wed Feb 03, 2016 5:10 am 
Offline
Extreme Poster
Extreme Poster
User avatar

Joined: Thu Jul 10, 2008 5:13 pm
Posts: 3801
Images: 1
Location: Florida
Been Liked: 1612 times
Your worry is well founded. Why have them separated?


Top
 Profile Personal album Singer's Showcase Profile 
 
PostPosted: Wed Feb 03, 2016 5:16 am 
Offline
Major Poster
Major Poster

Joined: Sat Dec 28, 2013 1:19 am
Posts: 50
Location: From UK but living in Cyprus
Been Liked: 1 time
mrmarog wrote:
Your worry is well founded. Why have them separated?


Ive not seperated anything, not sure what you mean.

_________________
facebook - PJs Karaoke Disco


Top
 Profile Singer's Showcase Profile 
 
PostPosted: Sat Feb 06, 2016 9:58 am 
Offline
Senior Poster
Senior Poster
User avatar

Joined: Mon May 30, 2011 2:31 pm
Posts: 182
Been Liked: 28 times
kjams has a really good duplicate song finder tool.. It took me minutes to cut mine down.

You might be able to load up the demo and get it done.

File -> New Preset Playlist -> Duplicate flies (loose)


Top
 Profile Singer's Showcase Profile 
 
PostPosted: Mon Feb 08, 2016 1:05 am 
Offline
Major Poster
Major Poster

Joined: Sat Dec 28, 2013 1:19 am
Posts: 50
Location: From UK but living in Cyprus
Been Liked: 1 time
Duplicate file deleter worker, it took the .CDG file with the .mp3 file.

_________________
facebook - PJs Karaoke Disco


Top
 Profile Singer's Showcase Profile 
 
PostPosted: Tue Feb 09, 2016 8:59 am 
Offline
Super Plus Poster
Super Plus Poster
User avatar

Joined: Wed Jul 08, 2015 5:39 am
Posts: 1735
Images: 12
Location: Niagara Falls, Ontario Canada
Been Liked: 190 times
I agree with Alfke.

leave all your karaoke in one folder and just use Song List Generator.
use the duplicate filter and create a fantastic looking book. nothing gets removed from your folders.


Top
 Profile Personal album Singer's Showcase Profile 
 
PostPosted: Thu Feb 18, 2016 1:38 pm 
Offline
Major Poster
Major Poster

Joined: Thu Feb 18, 2016 12:15 pm
Posts: 50
Been Liked: 4 times
I made a Python script that standardizes filenames to:

ARTIST NAME - SONG NAME.mp3

It gets the artist and song name from the ID3 tags. It also saves the original filename in the comment tag of the ID3. If there's interest I can package this so it will process a folder of songs (backup versions!) and then, once the song names are standardized, its pretty easy to get rid of dupes, just dump them all into the same folder.

Or would be easy enough to make a second script that scans all folders for dupes and moves them elsewhere.

On a sidenote, I also made a script that adds ID3 tags to tracks that don't have them. So it'll take a track named either:

LEG103 - 02 - Hall & Oates - Kiss On My List.mp3
LEG103 - 02 - Kiss On My List - Hall & Oates.mp3

And figure out the artist and song name based on position relative to the right, as separated by dashes. If there's no dashes and no ID3 tags then its just hopeless.


Top
 Profile Singer's Showcase Profile 
 
PostPosted: Mon Feb 22, 2016 6:22 pm 
Offline
Major Poster
Major Poster

Joined: Thu Feb 18, 2016 12:15 pm
Posts: 50
Been Liked: 4 times
I just expanded my script so it deletes duplicates files too. It can either go the simple route of searching for duplicate filenames across a bunch of folders, or it can look for files with duplicate checksums (in other words, duplicate files regardless of their filenames). It only compares CDG files, since that's all we're really worried about. When it moves a CDG file it moves its corresponding MP3 too.

It moves the duplicated files to a "duplicates" subfolder, preserving any subfolder names.

So for example if you're scanning the folder f:\karaokes\collections (and all subfolders) for duplicates, and it finds that
"f:\karaoke\collections\whatever\else\song song.cdg" is a duplicate of "f:\karaoke\collections\80s\whatsus.cdg", it'll move "f:\karaoke\collections\whatever\else\song song.cdg" to "f:\karaoke\duplicates\whatever\else\song song.cdg" along with its MP3 file. That way its really easy to restore if you want.

Anyway, let me know if there's interest in developing it further since its easy enough to do.


Top
 Profile Singer's Showcase Profile 
 
PostPosted: Mon Feb 22, 2016 7:26 pm 
Offline
Extreme Poster
Extreme Poster

Joined: Thu Jun 06, 2002 7:26 am
Posts: 4839
Location: In your head rent-free
Been Liked: 582 times
If you are only comparing checksums in the cdg files, then wouldn't only detect those files that are exactly the same graphics?

In other words, it would find the same MM files that happen to be copied and in different folders, but how would you use just checksums to detect the same song by different manufacturers?


Top
 Profile Singer's Showcase Profile 
 
PostPosted: Mon Feb 22, 2016 7:35 pm 
Offline
Major Poster
Major Poster

Joined: Thu Feb 18, 2016 12:15 pm
Posts: 50
Been Liked: 4 times
Correct, comparing checksums doesn't detect the same song by different manufacturers, but I don't necessarily want to, I like different *versions* of a song, but duplicates of the same version are useless.

I haven't figured out how to read text from a cdg file yet, which would be a nice way to detect duplicate versions of a song across different versions and different filenames. Not sure if it's even possible, dunno yet. But for my collection I standardize the filenames to artist - songname.mp3/cdg, so simply detecting duplicate filenames even if they're in different subfolders is enough to remove dupes of songs regardless of version.


Top
 Profile Singer's Showcase Profile 
 
PostPosted: Mon Feb 22, 2016 9:00 pm 
Offline
Extreme Poster
Extreme Poster

Joined: Thu Jun 06, 2002 7:26 am
Posts: 4839
Location: In your head rent-free
Been Liked: 582 times
wrybread wrote:
I haven't figured out how to read text from a cdg file yet, which would be a nice way to detect duplicate versions of a song across different versions and different filenames. Not sure if it's even possible, dunno yet.

It's not readable as text. It is a thin data stream of 16 color bitmapped info.


Top
 Profile Singer's Showcase Profile 
 
PostPosted: Mon Feb 22, 2016 9:07 pm 
Offline
Major Poster
Major Poster

Joined: Thu Feb 18, 2016 12:15 pm
Posts: 50
Been Liked: 4 times
> It is a thin data stream of 16 color bitmapped info.

Aha, that explains why they so often look like graphics from 1980s video games... Especially when they try to get fancy with graphics.

On a sidenote, is there any movement to HD karaoke files? I'm guessing these CDGs are something in the range of 640 x 480 maximum, and get noticeably pixellated when stretched to modern monitor/TV resolutions.


Top
 Profile Singer's Showcase Profile 
 
PostPosted: Mon Feb 22, 2016 11:18 pm 
Offline
Extreme Poster
Extreme Poster

Joined: Thu Jun 06, 2002 7:26 am
Posts: 4839
Location: In your head rent-free
Been Liked: 582 times
wrybread wrote:
I'm guessing these CDGs are something in the range of 640 x 480 maximum, and get noticeably pixellated when stretched to modern monitor/TV resolutions.

More like 230 x 239 range (not the exact numbers, but pretty close).

Here is an ancient tool you can use to play with cd+g files:

https://sourceforge.net/projects/cdgeditor/

It will allow you to change colors and turn on/off different bits.


Top
 Profile Singer's Showcase Profile 
 
PostPosted: Mon Feb 22, 2016 11:29 pm 
Offline
Major Poster
Major Poster

Joined: Thu Feb 18, 2016 12:15 pm
Posts: 50
Been Liked: 4 times
I wonder why it's so antiquated? I'm surprised there isn't cdgV2 yet or some other updated karaoke format. Or maybe there is.


Top
 Profile Singer's Showcase Profile 
 
PostPosted: Tue Feb 23, 2016 3:44 am 
Offline
Extreme Poster
Extreme Poster

Joined: Thu Jun 06, 2002 7:26 am
Posts: 4839
Location: In your head rent-free
Been Liked: 582 times
It's antiquated because the standard is just plain old. It was developed over 30 years ago and used experimentally on a couple regular audio cd's (Jefferson Airplane/Starship comes to mind) but really put to use in 1989 when Daiichi Kosho Ltd. used it on the first commercially available 5-inch karaoke disc. DK-001


Last edited by c. staley on Tue Feb 23, 2016 7:46 am, edited 1 time in total.

Top
 Profile Singer's Showcase Profile 
 
PostPosted: Tue Feb 23, 2016 4:32 am 
Offline
Super Poster
Super Poster

Joined: Wed Dec 16, 2015 4:07 pm
Posts: 576
Been Liked: 108 times
I don't think that HD is needed to sing karaoke. I don't think that I've ever heard a karaoke singer complain about the look of the text on any given karaoke track. I've heard people complain about some of the color combinations used by some karaoke manufacturers and I've heard various complaints about the way some companies swipe their lyrics as opposed to some other companies but I think to the average karaoke singer, the most important thing is the music and how close it is to the original song. Next on the list would probably be getting the correct lyrics.


Top
 Profile Singer's Showcase Profile 
 
PostPosted: Tue Feb 23, 2016 6:54 am 
Offline
Extreme Plus Poster
Extreme Plus Poster
User avatar

Joined: Fri Dec 02, 2011 12:38 pm
Posts: 6085
Images: 1
Location: Redmond, WA
Been Liked: 1663 times
I started downloading HD versions thinking they would catch on but have since reverted back to the MP3+G versions due to their flexibility.

_________________
-Chris


Top
 Profile Personal album Singer's Showcase Profile 
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 57 posts ]  Go to page Previous  1, 2, 3  Next

All times are UTC - 8 hours


Who is online

Users browsing this forum: No registered users and 321 guests


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Powered by phpBB® Forum Software © phpBB Group

Privacy Policy | Anti-Spam Policy | Acceptable Use Policy Copyright © Karaoke Scene Magazine
design & hosting by Cross Web Tech