I remembered watching this a while back and returned to try it out consolidating a bunch of old files on from PETA external USB 2 drives to a 4tb USB 3 external. Holy cow did this make a huge difference! Thanks. Side note, I am testing the addition of /R:3 /W:10 to stop endless retries for files that error when copying (permissions, errors on the drive, etc.).
Dear christ i dont ever comment and probably you wont see this but my god how insanely interesting this was. I do cisco networking for the most part and this has intrigued me that if this is even a glimpse at the power of working with powershell that i wanna look into learning PS more. Incredibly informative vid, gave a like and subscribe instantly and will be sure to check out your other content.
I was using exact command for copying 17+ million files/folders from one external SSD to another. Dell Precision with Intel Xeon, 32 GB. No logs, no validation - took 2.5 hours. Pretty amazing result. thank you!
Tested with a 5.21 GB Crossfire installer files and below are the result Using: File explorer - 3min 09s Powershell Copy-Item - 3min 12s Powershell robocopy (again thing) - 4min 13s any other copy utility software recommendations? I need to transfer a 200GB file. Thanks
Just a note for average viewers like me: not everyone's processor can multithread 32 streams of information. You need to search to find how many threads your CPU can handle.
TIPS, excessive threads (MT) in Robocopy can SLOW DOWN process substantially (depending on other parameters), ALSO, IF you do NOT use LOG, (display on screen)the process will be slower.
This is great thank you so much. On a side note. I couldn't make it work when copying i.e. a cellphone camera folder to an external drive folder. Because the mobile storage is not presented as a drive but rather shared internal storage. So there's no drive letter to point to :(
I have an issue with copying files to do with retro gaming. I know the windows prevents the creation of the files with certain names including con and aux et cetera. Do you know how I can get around this? Have you already got a video about this subject, or can point me in the right direction please?
Hi Jon. Looks like you're into SQL and programming and often moving loads of small files... ;-) Great to stumble upon this video of yours. Good you worked and showed it all methodically. I am into audio-files. Merging large collections. Ao having trouble in getting a NAS on speed. DIY NAS on FreeNAS. Via SMB/Samba going to workstation on Windows. Slow r/w, slow dir.listing in several sw packages, slow file-deletes. Didnt know but tried your Robocopy command and reads go up 50%. Nice and good to see it has an effect (many tunings did nothing). But probably the command-settings can be tuned/improved to my file-situation?
Am having audio-files (from small MP3 to large WAV), file-size-range 4MB-250MB with heavy emphasis on ~10MB and ~35MB. Often moving say 300.000 files from workstation to NAS (via 10Gb-connection). Then waiting-game starts... You gave a command-line that you probably tested and ended up with as best for your (4k-thumbnail-file) situation. Can this be improved upon for the file-situation I have (also: files moving from NAS/Linuxlike to workstation/Windows)? Any input much appreciated. Cheers. Gerard
I know this is an old video by now, but I was wondering if you know of any reasons why robocopy wouldn't work? I've typed in exactly what you did into powershell, both regular and admin mode, moving almost the same amount of files as in your video, and it just sits rather still and not doing anything. The files are all .png and small too btw. I've left it going for hours before and it hasn't done anything yet, not even displaying things by default like I read up on it and it was said to do. Task Manager says powershell is using almost 9% of my cpu, so it must be doing something, but I can't tell what. It isn't logging because I turned all of that off since it's just moving things from one file to the next on a pc rather than a work computer. My computer has a i7-10700KF and 32gb of ram, so there's no hardware reason for this to be the case. I hope that you see this soon, even if its on an old video
dude you are epic unfortunately last one is still slow for me . Doing 3tb data not 1 to 3 min to 7 sec but same slow laborious using various methods like the ones you described. 1hr about 100 gb which is poopy slow.
@13:24 is where the fastest way is demonstrated. The robocopy command didn't show up in my powershell but it does show up in the regular CMD prompt. Any idea why?
@@telejonjensen I have no idea why it wasn't showing up in the path on that day I tested it but it is now showing up just fine. The command was always there, just didn't show up in the path so I had to go into the directory where it was located and run from there. I'm guessing it got fixed in one of the updates that happened recently. My current version of PS is 18362 at present and as I said it's working now. My OS version is 10.0.18263.
How about large files? Have been trying exactly the command recommended in this vid but for large video files instead and after 12 mins it's still stuck at 0%! I just can't seem to find any more specific instructions for such files.
I appreciate you sharing this but what I really want to know is why on earth my 10 year old Window 7 system is so much faster at standard copy/pasting/moving huge numbers of files than my shiny new Windows 10 machine, where on paper the hardware blows the old pc out of the water? The Win 10 box has a new 1tb Samsung SSD plus a 4tb standard HDD and it was slow to handle files from the beginning. I'm almost at the point of exploring ways of running Win 7 safely and switching back.
@@telejonjensen they both have windows defender and nothing else, same chrome extensions, onedrive, Creative Cloud and Office 365. Thank you for your reply! There is mostly the same software installed but I tend to only run a few programs anyway.
One has the heebie-jeebies and the other doesn't. They don't bother giving the "hot-foot" to older systems because they get rarer ever day. Unless of course you are a high-profile pain in their ass!
i really appreciate these how to tutorials, but if the fastest way to transfer files , is to open cmd, etc defeats the whole point of this..i just wanted a faster way to copy & paste, or send to by right clicking on 1 drive to send the data to another, so i am bamboozled by all this..it would take another tutorial to do all this, so this fastest way would take us PC novices longer to do this stuff to improve transfer speed, than it would the old fashioned way, right click & send.......thank you stay safe but i will stick to the Pony Express method, hi ho Silver
Your test are somehow wrong, only first one really copying files everything else is just pasting your ram content to the target disk again and again while you are selecting the same files and robocopy failed 1st time because you were replacing files so on the target were placing more i/o operations instead of just writing on the target disk. Remake your tests by rebooting the machine before each test, find a way to measure time without using an app on the pc, use your phone or a smart watch and delete the target disk (even the partition if its probably a test disk) and recreate.
there is no point to use 32 threads if your computer has only 4 or 8. Learn your basics. Your pc will slow down due to thread management (stoping and starting threads)
Microsoft is still stuck on these problem comparing with Mac its fast transferring files but windows still stuck there i think they never think about it . That's the reason I hit windows I work with big capacity fils and time to move from c to d you need to go take a shower go to gym eat some pasta then you kome back you see the f.... 99.9999999
