Pages: [1] 2   Go Down

Author Topic: Mac application to find and delete duplicate photos?  (Read 181862 times)

louoates

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 836
    • Lou Oates Photography
Mac application to find and delete duplicate photos?
« on: April 03, 2014, 06:08:15 pm »

Help! Anyone have experience with Mac software to help find and delete duplicate photo files across multiple hard drives? My 4TB external backup drives are spilling over and I know I've been paranoid in keeping way too many copies of the same photographs but on different drives. Price is not a factor but not trashing my Mac is.
Logged

StoneNYC

  • Jr. Member
  • **
  • Offline Offline
  • Posts: 56
  • StoneNYC
    • Stone NYC Photography
Re: Mac application to find and delete duplicate photos?
« Reply #1 on: April 03, 2014, 11:15:11 pm »

I'm confused, if you have duplicate backups, why not use clone copy this will duplicate the drive but is you delete one file you just do a "backup clone" and it will erase the same file on all backup drives as well... Or am I misunderstanding what you Are doing?
Logged
~Stone | "...of course, that's just my opinion. I could be wrong." ~Dennis Miller

Eric Kellerman

  • Full Member
  • ***
  • Offline Offline
  • Posts: 140
    • Eric Kellerman Photography
Re: Mac application to find and delete duplicate photos?
« Reply #2 on: April 04, 2014, 10:51:49 am »

Do you want to search for specific files, or are you looking to let the software scan all your files to look for duplicates? If the former, then use Spotlight. If the latter, then perhaps a program like Printwindow5 might help.
Logged

RobSaecker

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 300
    • robsaecker.com
Re: Mac application to find and delete duplicate photos?
« Reply #3 on: April 04, 2014, 11:57:56 am »

There’s PhotoSweeper, on the App Store for $10. Has good reviews; I haven’t used it, so can’t recommend one way or the other. There is also Photo Duplicate Cleaner, free on the App Store, also has good reviews. There are probably more too, those are just the ones I saw on the first page of the Photo category.
Logged
Rob
photo blog - http://robsaecker.com

louoates

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 836
    • Lou Oates Photography
Re: Mac application to find and delete duplicate photos?
« Reply #4 on: April 04, 2014, 06:20:36 pm »

Thanks, all.
I'm trying to delete enough photo files so that Time Machine can put my entire system backup onto a 4TB external drive. I have almost 1 TB too many files. The best solution would be to have a program scan my 4 internal drives and auto-identify identical files that I can manually delete. I know I have duplicate psd files across 2 or 3 drives. I've noticed that some software checks just for identical folders and file names, not for exact file data.
I will probably delete most of my old raw files also.
I am looking at Araxis's FDF (Find Duplicate Files) software and may download a trial version to see if it works. All comments are welcome, especially if you've purchased and used FDF or other apps.
Logged

langier

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 1503
    • Celebrating Rural America, the Balkans and beyond
Re: Mac application to find and delete duplicate photos?
« Reply #5 on: April 04, 2014, 07:05:05 pm »

Why not make it easier on you and get a couple more large drives, one for the files, the other a clone.

Compared to file management and finding dupe files, big drives are cheap. However, the time for go out to shoot and to enjoy photography are priceless!
Logged
Larry Angier
ASMP, ACT, & many more! @sacred_icons
https://angier-fox.photoshelter.com

BobShaw

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 2218
    • Aspiration Images
Re: Mac application to find and delete duplicate photos?
« Reply #6 on: April 13, 2014, 07:52:53 pm »

I agree with langier. Life's too short. If you delete a file and it is a referenced file for something else it will just cause problems. Get a big Drobo or something and stop making duplicates.

I just have one copy on a hard drive and all the programs like Aperture, Capture One, Lightroom reference to the same files. It is actually on a server so all the computers can use it. That drive is TimeMachine backed up each night.
Logged
Website - http://AspirationImages.com
Studio and Commercial Photography

louoates

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 836
    • Lou Oates Photography
Re: Mac application to find and delete duplicate photos?
« Reply #7 on: April 13, 2014, 10:46:25 pm »

I'm taking your advice and not worrying about the dupes. Thanks for all your comments.
Logged

StoneNYC

  • Jr. Member
  • **
  • Offline Offline
  • Posts: 56
  • StoneNYC
    • Stone NYC Photography
Re: Mac application to find and delete duplicate photos?
« Reply #8 on: April 14, 2014, 02:58:46 pm »

Pretty sure Adobe Lightroom has a find duplicates feature... I can't be certain but I think it does.
Logged
~Stone | "...of course, that's just my opinion. I could be wrong." ~Dennis Miller

john beardsworth

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 4755
    • My photography site
Re: Mac application to find and delete duplicate photos?
« Reply #9 on: April 15, 2014, 01:38:43 am »

No it doesn't. It just has a way to avoid importing duplicates.
Logged

StoneNYC

  • Jr. Member
  • **
  • Offline Offline
  • Posts: 56
  • StoneNYC
    • Stone NYC Photography
Re: Mac application to find and delete duplicate photos?
« Reply #10 on: April 15, 2014, 11:41:29 am »

No it doesn't. It just has a way to avoid importing duplicates.

OH, gotcha, I knew I remembered something about that, thanks for the correct info
Logged
~Stone | "...of course, that's just my opinion. I could be wrong." ~Dennis Miller

sharperstill

  • Jr. Member
  • **
  • Offline Offline
  • Posts: 99
Re: Mac application to find and delete duplicate photos?
« Reply #11 on: June 14, 2014, 05:04:38 am »

For the record I have found duplicates using Bridge set to sort by file size. This works well for rendered files like JPG  or TIFF but I imagine won't be at all useful for RAW files.
Logged

red2

  • Newbie
  • *
  • Offline Offline
  • Posts: 33
    • http://
Re: Mac application to find and delete duplicate photos?
« Reply #12 on: June 15, 2014, 11:18:41 pm »

You might check out Gemini:
http://macpaw.com/gemini
Available at the Mac App store
Logged
Regards,
Bob D.

Wayne Folta

  • Newbie
  • *
  • Offline Offline
  • Posts: 2
Re: Mac application to find and delete duplicate photos?
« Reply #13 on: January 06, 2015, 09:32:15 pm »

There’s PhotoSweeper, on the App Store for $10. Has good reviews; I haven’t used it, so can’t recommend one way or the other. There is also Photo Duplicate Cleaner, free on the App Store, also has good reviews. There are probably more too, those are just the ones I saw on the first page of the Photo category.

I bought it last month and used it, and was very pleased. It was flexible, worked well, and gives nice feedback so you can see what you're doing.
Logged

colcr

  • Newbie
  • *
  • Offline Offline
  • Posts: 1
Re: Mac application to find and delete duplicate photos?
« Reply #14 on: March 11, 2015, 09:09:04 am »

Help! Anyone have experience with Mac software to help find and delete duplicate photo files across multiple hard drives? My 4TB external backup drives are spilling over and I know I've been paranoid in keeping way too many copies of the same photographs but on different drives. Price is not a factor but not trashing my Mac is.

Hi,  I was looking for something to manage all my clicked pictures on my Mac (which I had too much). I came across an amazing duplicate photos cleaner which even brings up the similar photos. You can try it from here:

www.duplicatephotofixer.com/Photofixer.aspx?utm_source=frm
Logged

bassman51

  • Full Member
  • ***
  • Offline Offline
  • Posts: 142
Re: Mac application to find and delete duplicate photos?
« Reply #15 on: March 30, 2015, 02:38:34 pm »

The easiest way is to sort your files by size and then name.  If you see two files with the same size and name, then they are almost certainly dups.   HOWEVER: if both copies have ever been added to a cataloging program such as Lightroom, or if you have made different edits which are stored next to each copy in a sidecar file, you will most likely cause problems by deleting one. 

What I did several years ago when face with this issue was to do the 80/20 fix.  I had no catalogs or sidecar files.

0. Make a copy of everything onto an external drive, then disconnect the drive from my system.
1. Using the above sort, I identified the most egregious duplicate folders and deleted them.
2.  Grouped the remaining images into some sort of calendar-based directory structure.  In my case, I established a Photo Master folder, then a YYYY sub folder, then a YYYY-MM subfolder within.
3.  Installed LR and imported everything into the catalog using the "do not move" option to leave the images in the Photo Master folder.
4. Over time, I regrouped, eliminated dups that were obvious and keyworded images I came across.
5. All new imports get copied from the SD card into the appropriate folder within this structure, with a Shoot Name added to the yyyy-mm- folder name. 
Logged
Life is what happens when you're busy making other plans.

digitaldog

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 20630
  • Andrew Rodney
    • http://www.digitaldog.net/
« Last Edit: March 30, 2015, 02:49:02 pm by digitaldog »
Logged
http://www.digitaldog.net/
Author "Color Management for Photographers".

Valdo

  • Newbie
  • *
  • Offline Offline
  • Posts: 20
Re: Mac application to find and delete duplicate photos?
« Reply #17 on: September 05, 2015, 04:12:53 am »

Hi,
try Photo Duplicate. Its simple and works fast.
Logged

speedyk

  • Jr. Member
  • **
  • Offline Offline
  • Posts: 52
Re: Mac application to find and delete duplicate photos?
« Reply #18 on: September 21, 2015, 02:58:19 pm »

First of all, Time Machine sucks for backup. It's okay for version tracking, though. In general I don't trust any Apple-made solutions, I use their OS and that's it. I worked as Applecare support, so maybe I know something.

I use Carbon Copy Cloner --and there is also Super Duper-- for backups. These both make bootable exact clones, no games with symbolic links and not being able to find the real file like with Time Machine.

I have two backup presets. One is called Identical, which I use on drives the same size in case I would need to swap them in to replace my internal drive. it makes an exact copy of what is on my drive. So if I back up using Identical and then reboot from that drive there is no difference in content. I keep a few of these around, it would take maybe 20 minutes to swap that drive into my MacBookPro if the internal drive died. In this mode, if I delete it on my internal drive, it won't be on the backup.

The other preset I call Attic Mode, and it just keeps piling stuff up. So if I have a folder of photos on my desktop and back up, then move it to my Photos folder and back up again, that folder is in both places on that backup drive. This is done on purpose, in case bit rot makes a certain file unopenable. It also allows me to do roughly the same thing as Time Machine, and find something I deleted off my internal drive but which I had backed up at some point. For this I use a drive that is several times larger than the internal drive. It will also be bootable. When it fills up I get another larger one.

Another point of these bootable drives is that after backing up I can boot from one of them and run disk utilities on my internal drive to keep the directories healthy.

Logged

huluvu

  • Newbie
  • *
  • Offline Offline
  • Posts: 17
Re: Mac application to find and delete duplicate photos?
« Reply #19 on: November 09, 2015, 03:33:21 pm »

Thanks for posting your software tips. I tried most of the apps that were mentioned here and they helped me find some dupes already.

However, do you know of an app that actually scans the content of an image (reads and matches the pixels) instead of relying on metadata such as creation date, resolution or file size?

Over the course of years of backing up multiple iPhones through multiple (bad) ways, I have a huge pile of unsorted phone pictures that are both a pain to sift through (since there are so many dupes still) and at the same time quite dear to me.

Any hints?
Logged
Pages: [1] 2   Go Up