Is There A Way To Automate Hard Drive Organization?

Page 1 of 2 12 LastLast

  1. Posts : 35
    Windows 10 Home 64
       #1

    Is There A Way To Automate Hard Drive Organization?


    I use to use Windows SyncToy a lot to mirror drive content as well as some duplicate file finders. I'm wanting to know if those two features can be combined.

    I have crazy amounts of data for various projects, backups, etc on a few 4 & 5 Tb HDD. I would like to organize that data between the drives. Is there something that can analyze drives and find duplicates using name, dates and size and sync the drives?

    I was thinking I could sync 2 drives at a time, then rotate the drives in this process until everything is synced and enormous amounts of free space being the reward.

    Windows 10 Professional
      My Computer

  2. Ghot's Avatar
    Posts : 9,377
    Win 10 Home 10.0.19043.928 (x64) [21H1]
       #2

    @ryevick


    There's a great program called Karen's Replicator. You can set up a schedule to do a lot of things...
    I use it to copy only the newly added files from my working drive to my storage drive.
    Karen's Replicator the Backup Utility for Windows v3.7.6 Released May 25, 2020 | Karen's Power Tools


    As for finding duplicate files, there are many programs that can do that.
      My Computer


  3. Posts : 35
    Windows 10 Home 64
    Thread Starter
       #3

    Ghot said:
    @ryevick


    There's a great program called Karen's Replicator. You can set up a schedule to do a lot of things...
    I use it to copy only the newly added files from my working drive to my storage drive.
    Karen's Replicator the Backup Utility for Windows v3.7.6 Released May 25, 2020 | Karen's Power Tools


    As for finding duplicate files, there are many programs that can do that.
    Thanks for the reply. I'll look into it. I want to plug 2, 5 Tb USB HDD into my W10 Professional PC activate the program and walk away. When I return I want to have zero duplicate files and everything sorted, automatically. Hopefully it can do that.

    - - - Updated - - -

    Yeah, this just appears to be backup software.
      My Computer

  4. Ghot's Avatar
    Posts : 9,377
    Win 10 Home 10.0.19043.928 (x64) [21H1]
       #4

    ryevick said:
    Thanks for the reply. I'll look into it. I want to plug 2, 5 Tb USB HDD into my W10 Professional PC activate the program and walk away. When I return I want to have zero duplicate files and everything sorted, automatically. Hopefully it can do that.

    - - - Updated - - -

    Yeah, this just appears to be backup software.
    I used it for it's backup abilities... sort of like RAID without the RAID.
    But I think you will need to run some duplicate finder software on the drives... one time anyway.

    After you are assured the duplicates are gone...then just set a schedule on Karen's and only use one of those drives as a working drive (that you save to or delete from), and Karen's will take care of the other.



    For exactly what you want, I think you should be looking for a batch file, that you could set up in Task Scheduler.
      My Computer

  5. Berton's Avatar
    Posts : 10,599
    Win10 Pro Versions 2004 and 2009/20H2, Win10 Pro IP_Dev, Win10 Home 1909
       #5

    A tip about dupe finders such as EDF, never run on file names, use the other choices such as for content. The issue is no folder can contain 2 or more files of the exact same name, always need at least one character difference so find by file name shouldn't/doesn't get results. Sorting on content or other choices will take longer.
      My Computers


  6. Posts : 35
    Windows 10 Home 64
    Thread Starter
       #6

    Berton said:
    A tip about dupe finders such as EDF, never run on file names, use the other choices such as for content. The issue is no folder can contain 2 or more files of the exact same name, always need at least one character difference so find by file name shouldn't/doesn't get results. Sorting on content or other choices will take longer.
    Yeah I would only find & sort by date and size
      My Computer


  7. Posts : 161
    Win 10 Pro 20H2 (OS Build 19042.867)
       #7

    Thinking about your use of Synctoy. I've used it for ages (most recent version) in Echo mode (so the destination drive becomes a mirror of the source folder) and trusted it to do its job.

    Then, a few days ago, using both WinDirStat and TreeSize Free I compared the size of a top level folder, many sub-folders, on the source drive with that on the destination drive. The first was nearly twice the size of the latter. Reran SyncToy to make sure. Still the same.

    Deleted much of the contents of the destination folder and reran SyncToy, it copied a few files over but didn't make any significant difference.

    It would seem it wasn't properly navigating the folder hierarchy.

    Might be worth you checking source and destination to make sure SyncToy is actually replicating your files as you think it is.

    Started Googling and it seems I wasn't the only one seeing such oddities. Various suggestions for alternative apps and chose to try FreeFileSync. After trying it and getting used to the way it works I've deleted SyncToy. FreeFileSync is doing all I want. Also it's much more informative about what it's doing and where it's got to, especially helpful with multi-GB synchronisations.
      My Computers

  8. Try3's Avatar
    Posts : 7,534
    Windows 10 Home x64 Version 20H2 Build 19042.928
       #8

    tpriest said:
    Then, a few days ago, using both WinDirStat and TreeSize Free I compared the size of a top level folder, many sub-folders, on the source drive with that on the destination drive. The first was nearly twice the size of the latter. Reran SyncToy to make sure. Still the same.
    SyncToy has always had a reputation for skipping folders/files without necessarily generating error messages.
    - I have a vague recollection that one cause of skipping without notification was in the case of paths-filenames containing what it regarded as awkward characters [but that Windows explorer & File explorer are happy with]. Apostrophes were, I think, a case in point.

    Denis
      My Computer

  9. x509's Avatar
    Posts : 854
    Windows 10 Pro
       #9

    Try3 said:
    SyncToy has always had a reputation for skipping folders/files without necessarily generating error messages.
    - I have a vague recollection that one cause of skipping without notification was in the case of paths-filenames containing what it regarded as awkward characters [but that Windows explorer & File explorer are happy with]. Apostrophes were, I think, a case in point.

    Denis
    On top of what @Try3 is saying, SyncToy sometimes creates a duplicate file with ".1" after the original file name. There are better free alternatives, and there is the commercial Goodsync, Key Features of GoodSync, which is worth every nickel I paid for it. I use it on a daily basis.
      My Computers

  10. ignatzatsonic's Avatar
    Posts : 2,428
    Windows 10 Home, 64-bit
       #10

    Another good mirroring app: SyncBackFree.

    Never had a problem with it or with FreeFileSync, but I like the former's interface better.

    Re finding duplicates AND mirroring:

    I'd be afraid of getting in a confused jam if I tried to do that in one step.

    I'd instead get rid of dupes as best I could and only then do the mirroring.

    The dupe detectors aren't perfect if you are attempting to identify matching pairs by their content....inexplicably. Some won't be caught when you'd expect that they would be.

    I have no idea how well sorting by date or size works.
      My Computer


 
Page 1 of 2 12 LastLast

  Related Discussions
Our Sites
Site Links
About Us
Windows 10 Forums is an independent web site and has not been authorized, sponsored, or otherwise approved by Microsoft Corporation. "Windows 10" and related materials are trademarks of Microsoft Corp.

© Designer Media Ltd
All times are GMT -5. The time now is 08:29.
Find Us




Windows 10 Forums