copying 216,452 files , 17453 folders to sd card, doesn't match Laptop

Hi,

For several yrs I've been using Teracopy on W7 to copy/move lg amounts of files as laptop backup to a 250gb SD card with no problems. By no problems I mean when I finished & using "properties" the # of files matched on the SD & Laptop.

In W10 I did not use Teracopy just the W10 copy process and I repeatedly got some strange results:

Files on Laptop: 159 GB, 238,738 files, 19,862 folders.
Files copied to SD card: 141 GB, 216-452 files, 17,453 folders.

Where did I go wrong?

Regards,

klxdrt

When using file explorer copy and paste to an external HD there are often prompts for:
a) file names that are too long
b) duplicate file names

Depending on the choices made the copied folder size can be different.

When using Teracopy had you seen prompts?

If you run file verification how does it compare?

Use Windows 10 Robocopy command. It can replace the standard "copy" command and is extremely fast. It can copy multiple files at one time.

JohnD

Hi,

Most times I copy only my data files & occasionally W10 files like Fonts.

With W7 I had no problems with 8 TB [mine & some w7] data between large USB HD's. Copying/moving is a "mission critical" part of what I do. I'm sure most big business move assets, products, etc. around the world "all the time". Amazon with warehouses all over the world is always moving stuff to balance inventories in order to meet ever changing customer demand especially now with the worldwide Covid 19 problem. Example: FACE MASKS.

As you mention W10 copying function has some quirks, as I noticed searching W10 forum for copying errors.

I'll do more research to find a work around.

Regards,

klxdrt

- - - Updated - - -

Hi John P,

I downloaded the info, WOW, below about RoboCopy & am somewhat gobsmacked.
Looks: [above my pay grade].

John, is there a GUI version? Any addl explanation will be helpful & much appreciated by me.
I'll look for a more user friendly ver.

Regards,

klxdrt

-------------------------------------------------
robocopy

07/25/2018
6 minutes to read
+3

Copies file data.
Syntax

robocopy <Source> <Destination> [<File>[ ...]] [<Options>]

Parameters
Table 1
Parameter Description
<Source> Specifies the path to the source directory.
<Destination> Specifies the path to the destination directory.
<File> Specifies the file or files to be copied. You can use wildcard characters (* or ?), if you want. If the File parameter is not specified, *.* is used as the default value.
<Options> Specifies options to be used with the robocopy command.
Copy options
Table 2
Option Description
/s Copies subdirectories. Note that this option excludes empty directories.
/e Copies subdirectories. Note that this option includes empty directories. For additional information, see Remarks.
/lev:<N> Copies only the top N levels of the source directory tree.
/z Copies files in restartable mode.
/b Copies files in Backup mode.
/zb Uses restartable mode. If access is denied, this option uses Backup mode.
/efsraw Copies all encrypted files in EFS RAW mode.
/copy:<CopyFlags> Specifies the file properties to be copied. The following are the valid values for this option:
D Data
A Attributes
T Time stamps
S NTFS access control list (ACL)
O Owner information
U Auditing information
The default value for CopyFlags is DAT (data, attributes, and time stamps).
/dcopy:<copyflags> Defines what to copy for directories. Default is DA. Options are D = data, A = attributes, and T = timestamps.
/sec Copies files with security (equivalent to /copyATS).
/copyall Copies all file information (equivalent to /copyATSOU).
/nocopy Copies no file information (useful with /purge).
/secfix Fixes file security on all files, even skipped ones.
/timfix Fixes file times on all files, even skipped ones.
/purge Deletes destination files and directories that no longer exist in the source. For additional information, see Remarks.
/mir Mirrors a directory tree (equivalent to /e plus /purge). For additional information, see Remarks.
/mov Moves files, and deletes them from the source after they are copied.
/move Moves files and directories, and deletes them from the source after they are copied.
/a+:[RASHCNET] Adds the specified attributes to copied files.
/a-:[RASHCNET] Removes the specified attributes from copied files.
/create Creates a directory tree and zero-length files only.
/fat Creates destination files by using 8.3 character-length FAT file names only.
/256 Turns off support for very long paths (longer than 256 characters).
/mon:<N> Monitors the source, and runs again when more than N changes are detected.
/mot:<M> Monitors source, and runs again in M minutes if changes are detected.
/MT[:N] Creates multi-threaded copies with N threads. N must be an integer between 1 and 128. The default value for N is 8.
The /MT parameter cannot be used with the /IPG and /EFSRAW parameters.
Redirect output using /LOG option for better performance.
Note: The /MT parameter applies to Windows Server 2008 R2 and Windows 7.
/rh:hhmm-hhmm Specifies run times when new copies may be started.
/pf Checks run times on a per-file (not per-pass) basis.
/ipg:n Specifies the inter-packet gap to free bandwidth on slow lines.
/sl Don't follow symbolic links and instead create a copy of the link.

Important

When using the /SECFIX copy option, specify the type of security information you want to copy by also using one of these additional copy options:

/COPYALL
/COPY:O
/COPY:S
/COPY:U
/SEC

File selection options
Table 3
Option Description
/a Copies only files for which the Archive attribute is set.
/m Copies only files for which the Archive attribute is set, and resets the Archive attribute.
/ia:[RASHCNETO] Includes only files for which any of the specified attributes are set.
/xa:[RASHCNETO] Excludes files for which any of the specified attributes are set.
/xf <FileName>[ ...] Excludes files that match the specified names or paths. Note that FileName can include wildcard characters (* and ?).
/xd <Directory>[ ...] Excludes directories that match the specified names and paths.
/xc Excludes changed files.
/xn Excludes newer files.
/xo Excludes older files.
/xx Excludes extra files and directories.
/xl Excludes "lonely" files and directories.
/is Includes the same files.
/it Includes "tweaked" files.
/max:<N> Specifies the maximum file size (to exclude files bigger than N bytes).
/min:<N> Specifies the minimum file size (to exclude files smaller than N bytes).
/maxage:<N> Specifies the maximum file age (to exclude files older than N days or date).
/minage:<N> Specifies the minimum file age (exclude files newer than N days or date).
/maxlad:<N> Specifies the maximum last access date (excludes files unused since N).
/minlad:<N> Specifies the minimum last access date (excludes files used since N) If N is less than 1900, N specifies the number of days. Otherwise, N specifies a date in the format YYYYMMDD.
/xj Excludes junction points, which are normally included by default.
/fft Assumes FAT file times (two-second precision).
/dst Compensates for one-hour DST time differences.
/xjd Excludes junction points for directories.
/xjf Excludes junction points for files.
Retry options
Table 4
Option Description
/r:<N> Specifies the number of retries on failed copies. The default value of N is 1,000,000 (one million retries).
/w:<N> Specifies the wait time between retries, in seconds. The default value of N is 30 (wait time 30 seconds).
/reg Saves the values specified in the /r and /w options as default settings in the registry.
/tbd Specifies that the system will wait for share names to be defined (retry error 67).
Logging options
Table 5
Option Description
/l Specifies that files are to be listed only (and not copied, deleted, or time stamped).
/x Reports all extra files, not just those that are selected.
/v Produces verbose output, and shows all skipped files.
/ts Includes source file time stamps in the output.
/fp Includes the full path names of the files in the output.
/bytes Prints sizes, as bytes.
/ns Specifies that file sizes are not to be logged.
/nc Specifies that file classes are not to be logged.
/nfl Specifies that file names are not to be logged.
/ndl Specifies that directory names are not to be logged.
/np Specifies that the progress of the copying operation (the number of files or directories copied so far) will not be displayed.
/eta Shows the estimated time of arrival (ETA) of the copied files.
/log:<LogFile> Writes the status output to the log file (overwrites the existing log file).
/log+:<LogFile> Writes the status output to the log file (appends the output to the existing log file).
/unicode Displays the status output as Unicode text.
/unilog:<LogFile> Writes the status output to the log file as Unicode text (overwrites the existing log file).
/unilog+:<LogFile> Writes the status output to the log file as Unicode text (appends the output to the existing log file).
/tee Writes the status output to the console window, as well as to the log file.
/njh Specifies that there is no job header.
/njs Specifies that there is no job summary.
Job options
Table 6
Option Description
/job:<JobName> Specifies that parameters are to be derived from the named job file.
/save:<JobName> Specifies that parameters are to be saved to the named job file.
/quit Quits after processing command line (to view parameters).
/nosd Indicates that no source directory is specified.
/nodd Indicates that no destination directory is specified.
/if Includes the specified files.
Exit (return) codes
Table 7
Value Description
0 No files were copied. No failure was encountered. No files were mismatched. The files already exist in the destination directory; therefore, the copy operation was skipped.
1 All files were copied successfully.
2 There are some additional files in the destination directory that are not present in the source directory. No files were copied.
3 Some files were copied. Additional files were present. No failure was encountered.
5 Some files were copied. Some files were mismatched. No failure was encountered.
6 Additional files and mismatched files exist. No files were copied and no failures were encountered. This means that the files already exist in the destination directory.
7 Files were copied, a file mismatch was present, and additional files were present.
8 Several files did not copy.

Note

Any value greater than 8 indicates that there was at least one failure during the copy operation.
Remarks

The /mir option is equivalent to the /e plus /purge options with one small difference in behavior:
With the /e plus /purge options, if the destination directory exists, the destination directory security settings are not overwritten.
With the /mir option, if the destination directory exists, the destination directory security settings are overwritten.

Additional References

Command-Line Syntax Key

Feedback

Send feedback about

You may also leave feedback directly on GitHub .

6 Open
0 Closed

#4242 opened 2 weeks ago by CeciAc
#4234 opened 2 weeks ago by frandert
#4149 opened a month ago by CBenghi
#3911 opened 3 months ago by momchilok
#3906 opened 3 months ago by leifurhauks
#3847 opened on Feb 6, 2020 by cbailiss

- - - Updated - - -

Thanks will do, I did finally notice the "tiny hard to see thumbs up icon" however what do I do now as I found info about robocopy & have a question, so from my point of view the post is closed yet. I want to do thins the right way.

I went thru post & thanked everyone. With all the research I did on W10, nowhere was it mentioned that W10 rearranged, intro new meanings, small "hard to read" directionals. In essence adding mouse clicks to get to the solution.

You guys have been very helpful & I appreciate it.

Installed UtilitySpotlite below, NOW how do I hook up the "code" above. The website did say it was difficult to set up.

Regards,

klxdrt

Hi klxdrt,

All the options for Robocopy are rather daunting. I created and attached a fairly simple ".bat" file to copy files/folders using Robocopy. You just have to specify where you are copying from and where you are copying to and what you want to copy. It will ask you to enter the appropriate information.

It will create a log in your "Documents" folder of what is copying (you can specify just a count of files/folders or all file/folder names [that might slow things down if you are copying a lot]) as well as display it in the command line screen. It will check for errors and give you a message if an error is found.

One thing you need to be aware of is that typically Robocopy does not copy the "root" folder name to the destination. If you are copying FolderA from one drive to another, it will copy the files and subfolders of FolderA to your destination folder but not the name FolderA. So if you copy C:\FolderA to E:\FolderA, it will copy the contents of C:\FolderA to E:\FolderA, but not the name FolderA. So you would not end up with E:\FolderA\FolderA. I created the script to ask if you want to create the destination folder if it does not exist. I can't guarantee it will work but you are welcome to try it. Please test it thoroughly to verify that it is doing what you want to do.

JohnD

Downloaded/ran your robocopy bat file but it's still a little daunting for me as it runs from the command prompt. I would never be able to enter complete file/folder location with out making mucho mistakes. NON TYPIST, POOR SHORT TERM MEMORY.

I'm also moving files/folders many times a day. TeraCopy was very simple as it was integrated into the mouse menu, I could either use Teracopy W7 copy function.

I'm greatly impressed with your knowledge, thoroughness, & professionalism. W10 is becoming a little too cattiwampus for me, may ditch it & go back to W7 plus it's security is non existent, MS knows all you do.

I just don't want to become "a pain in the butt" on this forum as you guys have been very nice.

Regards,

klxdrt

My typing skills are not much better. To get a folder name to use in the copy, open File Explorer, go to folder you wish to copy, right-click on the File Explorer Address Bar, and select "Copy address as text". Then when the script requests the source folder, paste (use Ctrl-V) what was saved from File Explorer into the line.

JohnD