Win10 NTFS file copy/backup utility that handles permissions correctly

Page 3 of 5 FirstFirst 12345 LastLast

  1. Posts : 4,666
    Windows 10 Pro x64 21H1 Build 19043.1151 (Branch: Release Preview)
       #21

    An additional note: By any chance, have you been fiddling with C:\Program Files\WindowsApps folder permissions? I don't recommend touching the StoreApp folder permission, since the whole thing is very fragile and can break the whole system. I've done this out of curiosity and MAN was I in trouble for a while. Maybe I locked out the correct user/application by mistake, but got it sorted out in the end though. :)
      My Computers


  2. Posts : 31,459
    10 Home x64 (22H2) (10 Pro on 2nd pc)
       #22

    Win10 User said:
    ...Xcopy/shadowcopy/robocopy probably ... can only do copy anyway (verses sync, where only modified files are copied)...
    Both RoboCopy and Xcopy have a /m option...
    /m Copies only files for which the Archive attribute is set, and resets the Archive attribute.
    ...which I use for backups in a batch file I wrote. I use it to do incremental backups.

    But RoboCopy is more sophisticated than the old DOS Xcopy command. It has many more options available - including mirroring, for example. More info from TechNet here...
    https://social.technet.microsoft.com...s.aspxit's
    And if you aren’t keen on the idea of using a command-line tool, take heart. Microsoft engineer Derk Benisch has written a graphical front end that allows you to build a command by selecting check boxes instead of entering switches.
    https://technet.microsoft.com/en-us/.../ee851678.aspx
      My Computers


  3. Posts : 11,247
    Windows / Linux : Arch Linux
       #23

    Hi folks
    Is the target destination for the copies a NAS / Linux server.

    If it is there's an absolute peach of a program to do all this stuff and a huge amount more . It's a GUI front end to the RSYNC Linux program. Install GRSYNC on your server -- great thing also in running these backup things from a NAS is that you can schedule these backup jobs to run whenever you want (CRONTAB etc).

    For Windows only systems ROBOCOPY is probably your best option but I am always reading that people have problems with it.

    Here's a typical screen shot of GRSYNC - note there's zillions of options too - if you have a NAS type server really have a look at this program. Showing standard basic options but loads of advanced stuff too. Simply connect / mount your Windows share to the server and execute. !!

    Win10 NTFS file copy/backup utility that handles permissions correctly-grsync.png

    Cheers
    jimbo
      My Computer


  4. Posts : 12
    Win10
    Thread Starter
       #24

    slicendice said:
    Let's start with this WU CU issue. What have you done in order to resolve this issue, except for running sfc, dism and system check?
    I've tried pretty much everything under the sun found doing Web searches for solutions.

    But regardless, the _one_ thing that should have worked, booting off the Win10 1709 DVD and using its "sfc /scannow" and live-CD based tools should have fixed the off-line NTFS file system. But, I was totally dismayed when the live-DVD sfc exhibited exactly the same behavior as the on-line sfc, with the "Windows Protection System could not start the repair service" error. This _is_ totally bizarre, as a live-DVD (or alternate running OS) solution should _always_ work fixing an off-line file system. Microsoft engineering failed to understand this simple, basic, concept. And yes, I did explicit-path execution of the sfc.exe from the installation DVD's repair cmd shell to ensure I ran the correct executable.

    Have you tried to disable fast startup, temporarily disable AV and finally, temporarily stopped all WU related services and deleted everything in C:\Windows\SoftwareDistribution\Download folder and rebooted system at least 2 times (first time will end up in WU error message if it was already trying to install something)?
    Yup, tried it all.

    Your WU issue could simply be an issue with AV corrupting your WU downloads or interfering with the configuration step.
    Not running any AV other than Microsoft Windows Defender.

    Perhaps WU downloads are being corrupted, but this is a small likelihood. A failing "sfc /scannow" indicates a much deeper problem.

    What about Hypervisor support? Have you tried booting without hypervisor support? I've solved many issues in the past by doing this in Admin CMD:
    Code:
    bcdedit /set hypervisorlaunchtype off
    shutdown /r /t 0
    
    To re-enable hypervisor type:
    Code:
    bcdedit /set hypervisorlaunchtype on
    OR
    Code:
    bcdedit /set hypervisorlaunchtype auto
    I may try this, but am not hopeful it'll help.

    I'm more inclined to give up on running (on-line) file system fixing because all the ownership/permission issues are inherent road blocks to updating/modifying corrupted files. But, the Windows install DVD repair tools are no help.

    Someone may have to create a Linux live-DVD with appropriate NTFS tools to fix all the broken Windows file system repair mechanisms. Sigh.
      My Computer


  5. Posts : 12
    Win10
    Thread Starter
       #25

    slicendice said:
    An additional note: By any chance, have you been fiddling with C:\Program Files\WindowsApps folder permissions? I don't recommend touching the StoreApp folder permission, since the whole thing is very fragile and can break the whole system. I've done this out of curiosity and MAN was I in trouble for a while. Maybe I locked out the correct user/application by mistake, but got it sorted out in the end though. :)
    Nope.

    I'm a software engineer with several decades of experience.
      My Computer


  6. Posts : 4,666
    Windows 10 Pro x64 21H1 Build 19043.1151 (Branch: Release Preview)
       #26

    Win10 User said:
    Nope.

    I'm a software engineer with several decades of experience.
    Cool! :)

    One more thing that I forgot to ask earlier and could be relevant. Which Windows 10 Edition, Build and Revision are you running and having issues with? Also would it be possible to get a detailed hardware list of your troublesome PC?


    Windows Defender has caused a lot of havoc every now and then on my systems, so disabling this until problem is fixed, eliminates a lot of layers that could go wrong. I think you should try it too.

    There are some builds where sfc online and offline commands were broken for some reason. I don't remember which builds though.
      My Computers


  7. Posts : 21
    Windows 10
       #27

    @Win10 User ; Well, guess that also answers the question of if you've re-registered services and run the Visual C & .NET Library repairs to a definitive "Yes!"

    What about Group Policy management of Windows Updates? We're all too aware our own end that our full set of desired defaults for management of Windows Updates in Group Policy don't work because there are now more bugs than a bait store present in some areas of the Group Policy Manager, and have been for some time. Any possibility you're having a similar issue?

    Also, @slicendice is right, Windows Defender actually has some modules in need of recall because they weren't ready for market and frequently corrupt data as follows:

    [SOURCE URL: https://answers.microsoft.com/en-us/...=1521661574323 ]
    Windows Defender Function C
    - Network Inspection Service (This service is loaded with bugs, and it is suggested to Microsoft's developers that it be removed from ALL versions of Windows until it is retooled and is ready for market because at present all it does is corrupt data)
    Windows Defender Function D - Anti-Exploit Service (This service is also loaded with bugs, and it is suggested to Microsoft's developers that it be removed from ALL versions of Windows until it is retooled and is ready for market because at present all it does is corrupt data)

    The above defective services can be disabled in Group Policy, and with a little extra effort in the Registry can also be permanently disabled as well.


    SLI - IT-IS Team
      My Computer


  8. Posts : 12
    Win10
    Thread Starter
       #28

    StepLadderInc said:
    @Win10 User , You're completely right about that, and all too often Microsoft goes script crazy and just recites "Run SFC /Scannow" & "dism.exe /online /cleanup-image /restorehealth" to a degree that it's almost a cultesque mantra now. Unfortunately it's a mantra that's been catching on in the industry, and keeps people from doing any real troubleshooting because they're constantly having to reset their equipment followed by addressing even more issues related to any corruption that occurs after the reset.
    Yup, the "canned" solutions generally don't work, especially in attempting to fix fundamentally flawed architecture.

    Are you using Group Policy at all to manage Windows Updates?

    The reason we ask is because we often retest a very focused configuration for Windows Updates within Group Policy where everything is setup accordingly in a very specific manner for each setting; however for the past 2 years, it's never worked properly despite the settings being spot on. We do use a minimal configuration to prevent Windows Update from meddling with drivers, but obviously in our configuration, we're just using the straight up Windows Update, and we don't support use of WSUS because we use a Linux-based backend for everything else.
    Haven't played with this, but I suspect it's not the immediate concern. I'm running Win10 Pro. The two or so other Win10 Pro systems I have are doing WU just fine, presumably using the same default policies. This server got data corruption probably because of some recent power-outages that outlasted the UPS.

    If you think it would help, it'll take us some time, but we could post the Windows Updates settings that we do keep configured, and then just bear in mind that all other settings for Windows Updates in our Machine Group Policy are set to non-configured. This approach has kept Windows Updates working for us without any meddling from Microsoft's proprietary and often very mediocre drivers that don't work nearly as well as the hardware component's manufacturers drivers often do. The only exception we've ever found to this is actually using things like Memory Card Reader-Writer assemblies, but that's about all Microsoft Drivers have been good for in our own experience.
    I don't play with policies much, as these are my home machines. But, perhaps the info would enlighten me as to what settings are involved.

    As I've mentioned, at this point a live-DVD or alternate OS repair mechanism makes much more sense. The "damaged" NTFS file system shouldn't be used to fix itself. Too many things locking up on themselves, especially with the convoluted Microsoft "enhanced" protection mechanisms.

    On another of my Win10 systems, the "we'll replace your driver regardless" policy was such a joke, as the specific (Win7) driver for a wireless device I had worked perfectly and Win10 in its infinite wisdom kept on replacing it with a newer but bad one, breaking my network connectivity. Granted that the device vendor screwed up its device ID, but there was no way to say "no" to Win10.

    We're all too aware, you've probably already done this, but instead of our assuming, we have to ask just to cover it; Have you tried re-reregistering services, repairing the Visual C Runtimes, and repairing the Microsoft .NET runtimes?
    Perhaps I'll try this, using my cloned drive (as I don't want to mess up my running drive).

    But, running the repair tools in the Windows install DVD should have not needed any of these things.

    Please let us know if you think any of our offerings would be helpful.
    Thanks for your and everybodies else's help.

    As of now, I'm resigned to use a crippled system...
      My Computer


  9. Posts : 21
    Windows 10
       #29

    We're adding three screenshots that are all self explanatory, and we hope the settings illustrated are helpful to a lot of people and of course you yourself @Win10 User. Microsoft undoubtedly needs to do something about its quality assurance, and these workarounds have been extremely helpful to us. If they also help you, please just pay it forward and help others with the same info.

    Screen shots as follows:

    Disabling Defective Windows Defender - Anti-Exploit Module in Windows 10 Group Policy

    Win10 NTFS file copy/backup utility that handles permissions correctly-ten-forums-group-policy-disabling-defective-windows-defender-anti-exploit-service.png

    Known working Windows Updates Configuration through Group Policy for Windows 10:

    Win10 NTFS file copy/backup utility that handles permissions correctly-ten-forums-group-policy-windows-updates.png

    Disabling Defective Windows Defender Modules in Registry (Includes WdNisSvc)

    Win10 NTFS file copy/backup utility that handles permissions correctly-ten-forums-win10-registry-disabling-defective-windows-10-modules-includes-wdnissvc-.png

    There are some other Group Policies to consider for Windows Defender, so we threw together a little slide show. Hope these additional screen shots are helpful.

    https://drive.google.com/drive/folde...o1VMR9BCCmJn-n

    Please understand one key thing about these settings, we do use our own anti-virus and anti-malware services, and it's not advised to use the configuration that we do without some sort of other anti-virus and anti-malware services and/or protection software present, but at least most anti-virus programs that are commonly and unrelated to Microsoft actually work properly.

    May these be a way out for some of the issues happening, and we hope they help.

    Best Always,

    SLI - IT-IS Team
    Last edited by StepLadderInc; 07 Apr 2018 at 11:31.
      My Computer


  10. Posts : 4,666
    Windows 10 Pro x64 21H1 Build 19043.1151 (Branch: Release Preview)
       #30

    @StepLadderInc

    Thanks for sharing all these GP configurations. Highly appreciated.


    Would it be possible to make a copy of the slides at Google drive and upload them here for archiving purposes? Would help many in the future. Files shared on external sources tend to get lost with time.


    ...just an idea... :)
      My Computers


 

  Related Discussions
Our Sites
Site Links
About Us
Windows 10 Forums is an independent web site and has not been authorized, sponsored, or otherwise approved by Microsoft Corporation. "Windows 10" and related materials are trademarks of Microsoft Corp.

© Designer Media Ltd
All times are GMT -5. The time now is 09:30.
Find Us




Windows 10 Forums