[SOLVED] Still having rsync errors to external drive
Linux - GeneralThis Linux forum is for general Linux questions and discussion.
If it is Linux Related and doesn't seem to fit in any other forum then this is the place.
Notices
Welcome to LinuxQuestions.org, a friendly and active Linux Community.
You are currently viewing LQ as a guest. By joining our community you will have the ability to post topics, receive our newsletter, use the advanced search, subscribe to threads and access many other special features. Registration is quick, simple and absolutely free. Join our community today!
Note that registered members see fewer ads, and ContentLink is completely disabled once you log in.
If you have any problems with the registration process or your account login, please contact us. If you need to reset your password, click here.
Having a problem logging in? Please visit this page to clear all LQ-related cookies.
Get a virtual cloud desktop with the Linux distro that you want in less than five minutes with Shells! With over 10 pre-installed distros to choose from, the worry-free installation life is here! Whether you are a digital nomad or just looking for flexibility, Shells can put your Linux machine on the device that you want to use.
Exclusive for LQ members, get up to 45% off per month. Click here for more info.
also, the reason I mentioned for the entire drive, is because i already have a similar folder, batch 1, on this hard drive already. so that maybe it was a total thing
So if it's really per folder, how could I go about rsync'ing just folders who's names start with characters up through say the letter L to one folder on the external drive, then the remaining to another folder? Maybe splitting them up like that would work, and it would be logical for the users to do it alphabetically.
I guess ideally I'd want symbols,numbers, letters through L in one, then M-Z in the other. since that's how i think it naturally sorts them. I just dont know how to do it.
I should probably open a new topic for this, as knowing how to do that might be useful for someone else. Then I can report back here if that solved the problem that I originally posted about.
It's a USB external hard drive with 2 1TB hard disks, that you can either RAID0 for 2TB usable space, or RAID1 for 1TB but redundancy. Wherever I plug the external USB drive in now, it recognizes it as a 1TB external drive. it's not a NAS. I used a utility that came with the drive to setup the RAID1 on the hard drive.
Distribution: Debian /Jessie/Stretch/Sid, Linux Mint DE
Posts: 5,195
Rep:
Frankly I don't think these questions have anything to do with your problem, I am just interested as I am extremely unfamiliar with the latest hardware gadgets. Last year I made a giant leap forward by installing sda RAID in my server.
Do you have a specification of this device? Also I am a bit surprised about that 'own' driver while Linux has tried and true mdadm. But unusable for Win & Mac of course.
Have you checked this page: http://en.wikipedia.org/wiki/File_Allocation_Table for any constraints you are trying to exceed? It is also interesting to see that some limitations are in Windows and not in the FAT specification.
Have you tried to do the copy action on a single drive? That is without using the RAID drivers? If that succeeds, that would preclude problems with VFAT, directory structure, number of files, etc.
I've been able to copy individual folders to my desktop, but i dont have enough space to try the whole thing, unless i copy it to one of these drives that are identical to the one i'm having problems on.
I'd really like to try rsync'ing to two folders separating it half in one half in the other, if i could only figure out how.
I figured out how to do it, and that seems to have fixed my problems. I have only a few folders at the root, then have things broken into other subfolders under that, with the results of ls | wc -l being around 10,000 or so, I seem to be good. think it was related to fat32 and trying to jam too much into folders.
LinuxQuestions.org is looking for people interested in writing
Editorials, Articles, Reviews, and more. If you'd like to contribute
content, let us know.