Find duplicate files on Mac OS X

"I've written a simple python script FileDupeFinder.py that will find file duplicate files on OSX (and probably Linux/*nix) systems. Right now, you pass it a directory root path and a minimum file size and it will walk the directory tree and output a list of files that it believes to be duplicates. It will ignore files that are hard links of each other. You can tell it to exclude directories (right now it just excludes Backups.backupdb, as this script isn't ready to handle Time Machine wackiness) and tell it not to span filesystems (though these aren't currently paramaterized, they are easy enough to set in the script itself.

This script is only minimally tested, but it has worked reasonably enough for me."

"Decloner is another one.

You can choose the minimum file size you want to have checked, and it can eliminate all but one. Doesn't seem to be able to create hard links or symlinks, though, which I'd want."

The most convenient GUI that I have found for this task is Gemini, but a script might be enough for your needs. I personally scan for duplicates just to assess how much of my data is redundant (currently 3/50 GB, or 6% of the data), but I rarely delete anything in case it breaks the internal magic of my file chaos.

"I've been using TidyUp a lot on MacOS X to find duplicate files and sort them out.

The GUI is not necessarily 100% intuitive, but the application is very powerful, offers a lot of options and choices for defining what a duplicate is (same name?, same size, same content, ...) and it also has a powerful interface for displaying duplicate groups and deciding what to do with the duplicates (or some of them).

I never regretted buying it and it was very helpful for me."