LinuxQuestions.org
View the Most Wanted LQ Wiki articles.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - General
User Name
Password
Linux - General This Linux forum is for general Linux questions and discussion.
If it is Linux Related and doesn't seem to fit in any other forum then this is the place.

Notices

Reply
 
Search this Thread
Old 01-19-2010, 10:34 AM   #16
GazL
Senior Member
 
Registered: May 2008
Posts: 3,312

Rep: Reputation: Disabled

It's not a limit 'on the entire drive' it's a limit on files/directories contained in a single directory.

As it's failing on "/mnt/usbdrive/Batch 2" I'd be inclined to start by looking at the number of files/directories in that....

ls "/mnt/usbdrive/Batch 2" | wc -l


If you get an answer over 10,000 then it would seem to support the idea that this might indeed be the problem.
 
Old 01-19-2010, 10:49 AM   #17
rjo98
Senior Member
 
Registered: Jun 2009
Location: US
Distribution: RHEL, CentOS
Posts: 1,384

Original Poster
Rep: Reputation: 36
18781
 
Old 01-19-2010, 11:00 AM   #18
rjo98
Senior Member
 
Registered: Jun 2009
Location: US
Distribution: RHEL, CentOS
Posts: 1,384

Original Poster
Rep: Reputation: 36
also, the reason I mentioned for the entire drive, is because i already have a similar folder, batch 1, on this hard drive already. so that maybe it was a total thing
 
Old 01-19-2010, 11:04 AM   #19
rjo98
Senior Member
 
Registered: Jun 2009
Location: US
Distribution: RHEL, CentOS
Posts: 1,384

Original Poster
Rep: Reputation: 36
So if it's really per folder, how could I go about rsync'ing just folders who's names start with characters up through say the letter L to one folder on the external drive, then the remaining to another folder? Maybe splitting them up like that would work, and it would be logical for the users to do it alphabetically.

I guess ideally I'd want symbols,numbers, letters through L in one, then M-Z in the other. since that's how i think it naturally sorts them. I just dont know how to do it.

I should probably open a new topic for this, as knowing how to do that might be useful for someone else. Then I can report back here if that solved the problem that I originally posted about.

Last edited by rjo98; 01-19-2010 at 11:54 AM.
 
Old 01-19-2010, 04:08 PM   #20
jlinkels
Senior Member
 
Registered: Oct 2003
Location: Bonaire
Distribution: Debian Lenny/Squeeze/Wheezy/Sid
Posts: 4,052

Rep: Reputation: 484Reputation: 484Reputation: 484Reputation: 484Reputation: 484
A few posts ago you said that the drive was actually a RAID1 device and it was using the software driver which came with it.

This is not a NAS, or is it? If you have really two separate disks which are RAIDed by software on your computer, do you have drivers for all 3 OS-es?

jlinkels
 
Old 01-19-2010, 04:18 PM   #21
rjo98
Senior Member
 
Registered: Jun 2009
Location: US
Distribution: RHEL, CentOS
Posts: 1,384

Original Poster
Rep: Reputation: 36
It's a USB external hard drive with 2 1TB hard disks, that you can either RAID0 for 2TB usable space, or RAID1 for 1TB but redundancy. Wherever I plug the external USB drive in now, it recognizes it as a 1TB external drive. it's not a NAS. I used a utility that came with the drive to setup the RAID1 on the hard drive.
 
Old 01-19-2010, 04:40 PM   #22
jlinkels
Senior Member
 
Registered: Oct 2003
Location: Bonaire
Distribution: Debian Lenny/Squeeze/Wheezy/Sid
Posts: 4,052

Rep: Reputation: 484Reputation: 484Reputation: 484Reputation: 484Reputation: 484
Frankly I don't think these questions have anything to do with your problem, I am just interested as I am extremely unfamiliar with the latest hardware gadgets. Last year I made a giant leap forward by installing sda RAID in my server.

Do you have a specification of this device? Also I am a bit surprised about that 'own' driver while Linux has tried and true mdadm. But unusable for Win & Mac of course.

Have you checked this page: http://en.wikipedia.org/wiki/File_Allocation_Table for any constraints you are trying to exceed? It is also interesting to see that some limitations are in Windows and not in the FAT specification.

Have you tried to do the copy action on a single drive? That is without using the RAID drivers? If that succeeds, that would preclude problems with VFAT, directory structure, number of files, etc.

jlinkels
 
Old 01-19-2010, 04:44 PM   #23
rjo98
Senior Member
 
Registered: Jun 2009
Location: US
Distribution: RHEL, CentOS
Posts: 1,384

Original Poster
Rep: Reputation: 36
I've been able to copy individual folders to my desktop, but i dont have enough space to try the whole thing, unless i copy it to one of these drives that are identical to the one i'm having problems on.

I'd really like to try rsync'ing to two folders separating it half in one half in the other, if i could only figure out how.
 
Old 01-28-2010, 02:39 PM   #24
rjo98
Senior Member
 
Registered: Jun 2009
Location: US
Distribution: RHEL, CentOS
Posts: 1,384

Original Poster
Rep: Reputation: 36
I figured out how to do it, and that seems to have fixed my problems. I have only a few folders at the root, then have things broken into other subfolders under that, with the results of ls | wc -l being around 10,000 or so, I seem to be good. think it was related to fat32 and trying to jam too much into folders.
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
[SOLVED] rsync chown errors to fat32 usb drive rjo98 Linux - Newbie 12 01-28-2010 02:41 PM
[SOLVED] rsync to an external usb drive rjo98 Linux - General 8 01-28-2010 02:40 PM
[SOLVED] rsync --link-dest not creating hard links on external usb drive quasi3 Linux - General 4 08-26-2009 10:11 AM
[SOLVED] Don't rsync to disconnected external drive MurdinE Linux - General 2 08-08-2009 02:13 PM
Rsync errors to USB drive jstars Linux - Server 8 12-23-2006 11:35 PM


All times are GMT -5. The time now is 02:52 PM.

Main Menu
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
identi.ca: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration