Delete many tiny files fast?

Page 1 of 2 12 LastLast
  1. vgchat's Avatar
    Posts : 409
    Windows 10 Pro
       #1

    Delete many tiny files fast?


    Hi there, what is a recommended way to delete many small files... fast?

    And by many small files, I'm talking about in excess of 1 million files in one session.

    So what I'm doing is extracting geocities archives, compressing images and rezipping them. In one archive, I'm dealing with way more than 3.2M files measuring over 70GB. Over 100K files is enough to overwhelm the recycle bin usually to a point where it becomes laggy.
    Last edited by vgchat; 12 Feb 2020 at 18:01.
      My Computer

  2. Brink's Avatar
    Posts : 56,483
    64-bit Windows 10 Pro for Workstations build 21364
       #2

    Hello mate,

    I suppose you could see if using the "Permanently delete" context menu added by the tutorial below may work for this. It will permanently delete the selected files without going to the Recycle Bin first.

    Add Permanently Delete to Context Menu in Windows 10
      My Computers

  3. vgchat's Avatar
    Posts : 409
    Windows 10 Pro
    Thread Starter
       #3

    Thanks brink I've added that & I'll give it a shot.
      My Computer

  4. Golden's Avatar
    Posts : 1,635
    Windows 10 Pro x64
       #4

    @vgchat: Another option from the command line:

    Code:
    del /F/Q *.* > nul
    /F = forces deletion of read-only files
    /Q = quiet mode (no prompting)
    > NUL = disable output to the screen

    The > NUL option will save you a lot of time with all those files you are deleting.
      My Computers

  5. vgchat's Avatar
    Posts : 409
    Windows 10 Pro
    Thread Starter
       #5

    Alright thanks for that, I'll definitely be using that.
      My Computer

  6. Golden's Avatar
    Posts : 1,635
    Windows 10 Pro x64
       #6

    vgchat said:
    Alright thanks for that, I'll definitely be using that.
    I'd be interested to see how well it worked. Let us know the outcome.
      My Computers

  7. vgchat's Avatar
    Posts : 409
    Windows 10 Pro
    Thread Starter
       #7

    More than likely I'll be mostly using brinks method due to being able to use it with a context menu.

    I did see a tut on how to add yours to a context menu but I never saw a tut on it that included a bat to automate it.
    Otherwise, dropping it in a folder would delete stuff I'm not yet ready to delete.
      My Computer

  8. Golden's Avatar
    Posts : 1,635
    Windows 10 Pro x64
       #8

    vgchat said:
    More than likely I'll be mostly using brinks method due to being able to use it with a context menu.

    I did see a tut on how to add yours to a context menu but I never saw a tut on it that included a bat to automate it.
    Otherwise, dropping it in a folder would delete stuff I'm not yet ready to delete.
    Maybe this can help?
    Code:
    @ECHO OFF
    ECHO Delete Folder: %CD%?
    PAUSE
    SET FOLDER=%CD%
    CD /
    DEL /F/Q/S "%FOLDER%" > NUL
    RMDIR /Q/S "%FOLDER%"
    EXIT
    How to delete large folders in Windows super fast - gHacks Tech News
      My Computers

  9. vgchat's Avatar
    Posts : 409
    Windows 10 Pro
    Thread Starter
       #9

    I'm going to mark the above as solved but I have another query now...

    Those files I was talking about, do you think it would be safe to move them onto a nvme?

    They will need to be:
    Unzipped
    Scanned with an Malwarebytes (which will be real-time scanning things too)
    Metadata deleted from any found png's & jpeg files from a tool called JPEG & PNG Stripper (which will look at every file trying to find these types.)
    Have Jpegmini run over folders & process all jpegs it can find
    And finally be zipped back up

    I'll be doing this with a working set of data that is over 900GB unzipped and I have no idea how many files there will be but a few million of them compose of a 70GB sample (more than 3M of them). Would this be considered safe to do on a nvme or would it wear the nvme down too much? I know that a nvme can do the job fast but I also don't want to wear the thing down with excessive usage or by doing something that's not recommended.
      My Computer

  10. Golden's Avatar
    Posts : 1,635
    Windows 10 Pro x64
       #10

    Interesting work!

    Unfortunately I don't know enough about how NVMe's work. If it's anything like a traditional SSD, then you might be OK.....I remember the early days of everyone worrying about SSD wearing quickly with lots of read-write, but it turned out to be a red herring.

    Perhaps if you post the make and model of the NVMe, someone more knowledgeable will reply.

    Did you consider using some cheaper traditional hard disks in a RAID0 for this work at all?
      My Computers


 
Page 1 of 2 12 LastLast

  Related Discussions
Our Sites
Site Links
About Us
Windows 10 Forums is an independent web site and has not been authorized, sponsored, or otherwise approved by Microsoft Corporation. "Windows 10" and related materials are trademarks of Microsoft Corp.

Designer Media Ltd
All times are GMT -5. The time now is 05:16.
Find Us




Windows 10 Forums