1.    25 Jul 2016 #1

    NTFS file system with large nr of files SLOOOOOOOOOOOW !!!!


    Hi there

    Copying 2.7 TB of files (music, video) from USB3 ext drive to RAID 0 internal fast HDD on Windows --- nearly 8 hours.

    Copying same 2.7 TB also to RAID 0 on identical system though running Linux with XFS file system on both sets of HDD's 2 hrs 45 mns. !!!

    Not sure if it's the NTFS system or Windows hardware RAID 0 on internal HDD -- but this is appalling compared with Linux.

    On both machines nothing else was running other than the file copy. RAID controller was genuine hardware RAID - both systems showed the RAID 0 target HDD as a 9 TB single drive. Striping parameters identical.

    On a small nr of files NTFS was OK but it gets HIDEOUS when copying 1000's of files. !!!

    Am I doing anything wrong --fortunately I don't normally have to copy that much data.

    Note no file conversions were involved - two identical bits of computer hardware, same make of HDD's. Windows was 100% Windows and Linux 100% linux. Both machines had proper USB 3 ports.

    Cheers
    jimbo
      My System SpecsSystem Spec


  2. Joined : Aug 2014
    Forever West
    Posts : 2,562
    Win10 Home and Pro, Win10 Insider Preview, Win7 Home, Linux Mint
       25 Jul 2016 #2

    Since most versions of Linux [I use Linux Mint] can work with NTFS-formatted drives the NTFS formatting shouldn't have been the issue. Unless of course you let Linux change the formatting of the receiving drives. The main thing about using NTFS storage vesus FAT32 is getting around the 4GB limit single-file-size on FAT32.
      My System SpecsSystem Spec

  3.    26 Jul 2016 #3

    Berton said: View Post
    Since most versions of Linux [I use Linux Mint] can work with NTFS-formatted drives the NTFS formatting shouldn't have been the issue. Unless of course you let Linux change the formatting of the receiving drives. The main thing about using NTFS storage vesus FAT32 is getting around the 4GB limit single-file-size on FAT32.
    Hi there

    No change of format was done -- test was done on identical hardware - one box was 100% Windows with Windows NTFS for the external HDD, other test done 100% Linux (Centos 7) with XFS file system (except one tiny VFAT partition for /boot - grub2 to boot the OS).

    Trying the NTFS file system on Linux gave a slightly faster copy (5 hr 30 min vs 8) but still not as fast as the native XFS system.

    Windows with NTFS was definitely by far the slowest - I'm sure for large file systems NTFS has probably passed it's sell by date. Strange though that Linux handles a Windows file system faster than Windows itself does -- even though there's a kernel module FUSE / NTFS-3g needed to handle it. !!!!

    Normal Windows works fine --not often people are manipulating huge file and datasets of several TB at least on Home systems - although with music / multi-media that could easily change with really large HDD's.

    Thought the test was interesting though to see where Windows starts coming up against its limits. !!

    Cheers
    jimbo
      My System SpecsSystem Spec


 


Similar Threads
Thread Forum
NTFS - time for Ms to create new file system ?
Hi there I posted recently about how slow NTFS was when you were copying large amounts of data - especially if the data consisted essentially of zillions of small files. Here's a reliable test which amply demonstrates that it really is time...
Performance & Maintenance
NTFS vs ExFAT for a non-system SSD
Hello. I have a SSD just for gaming. That is. A standalone partition without boot (only data; Steam and other games are stored there). I am wondering if I would gain any benefit from going from NTFS to ExFAT. Your opinions are welcome.
Performance & Maintenance
File explorer --Very Slow for moving large number of small files
Hi there If you have Loads (and I mean Loads) of small files - e-books, excel data. word docs, emails etc etc then File explorer runs REALLY slow on even fast devices I gave up moving this lot after about 4 hours. (W10 machine). Switched...
Performance & Maintenance
Excessively Large System Files
I have two excessively large system files located in C:\Windows\: {2FD0AD83-973A-11E5-B6B9-ACFDCE21931D} {2FD0AD87-973A-11E5-B6B9-ACFDCE21931D} The first is 43.4 GB and the second is 26.6 GB. Together, they constitute 30% of my total disk...
Performance & Maintenance
Windows 10 File System Error when opening graphics files
This is a clean Windows 10 Pro 64-bit install on a home-built system (ASUS Sabertooth X99 with an i7). When attempting to open graphics files (JPG, GIF, etc) this is the error that pops up: File System Error (-2147098360) 32128
General Support
Our Sites
Site Links
About Us
Windows 10 Forums is an independent web site and has not been authorized, sponsored, or otherwise approved by Microsoft Corporation. "Windows 10" and related materials are trademarks of Microsoft Corp.

© Designer Media Ltd

All times are GMT -5. The time now is 23:07.
Find Us
Twitter Facebook Google+



Windows 10 Forums