I've been working on getting my gigabytes of files in order... found this utility and have to give it a rec to the hive.

http://www.clonespy.com/

Using it to search all my files to remove dupes.    I have big "dumps" of unsorted information from various systems, that I have tried to organize lately, and have had trouble with copying the same stuff to different places.   Also a monster MP3 collection, but with a large "uncategorized" folder that contains lots of dupes.  

Its running automated right now, its using all 8 cores on my machine (good coding!) and have gotten rid of 10 gigabytes worth of dupes (about 6000 files so far).   You pick folders and put them into two pools.   Pool 1 is where I select the folders where I want dupes to "survive."   Pool 2 is where I want dupes to be deleted.   If there are files in pool 1 that are duplicated in pool 2 it wipes out the later.    It searches by checksum hashing.   Takes a bit to understand how to use it in power mode, but totally worth it.  

And a free download that gives you the opportunity to install in "portable" mode.

Major +1 for this software.

It's free?

NSA.

Yeah, duplicate gay porn is the worst...

If it's free, then you're not the customer. You're the product.