LinuxQuestions.org
Review your favorite Linux distribution.
Go Back   LinuxQuestions.org > Forums > Other *NIX Forums > AIX
User Name
Password
AIX This forum is for the discussion of IBM AIX.
eserver and other IBM related questions are also on topic.

Notices



Reply
 
Search this Thread
Old 05-10-2012, 05:22 PM   #1
Cpare
Member
 
Registered: Aug 2001
Location: Magic City, USA
Distribution: Ubuntu
Posts: 65

Rep: Reputation: 15
rsync errors


Hello,
When trying to rsynch a 1.2TB volume over to our new 12TB volume and getting the error below. We can copy files to the volume using other tools without issue, but we really need rsync to minimize the outage when we put the new volume into production use. Could it be due to the size of the new volume, a security issue, or is there something else going on? If rsynch isn't going to work is there another tool we could use to do the initial copy, then cleanup the delta during our maintenance window?

- ULIMIT is Unlimited, so thats not the issue.

Code:
servername username > /busobjdata/do/temp /opt/apps/busobj/busobjdata/do/frs/input         <                                                                        sending incremental file list                                                                                                                                      
rsync: opendir "/opt/apps/busobj/busobjdata/do/temp" failed: Value too large to be stored in data type (127)                                                       
temp/                                                                                                                                                              
rsync: opendir "/opt/apps/busobj/busobjdata/do/frs/input/temp" failed: Value too large to be stored in data type (127)                                             
                                                                                                                                                                   
sent 46 bytes  received 16 bytes  124.00 bytes/sec                                                                                                                 
total size is 0  speedup is 0.00                                                                                                                                   
rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1039) [sender=3.0.6]
 
Old 05-11-2012, 12:49 PM   #2
amani
Senior Member
 
Registered: Jul 2006
Location: Kolkata, India
Distribution: 64-bit GNU/Linux, Kubuntu64, Fedora QA, Slackware,
Posts: 2,758

Rep: Reputation: Disabled
exact command used?
 
Old 05-17-2012, 03:51 PM   #3
Cpare
Member
 
Registered: Aug 2001
Location: Magic City, USA
Distribution: Ubuntu
Posts: 65

Original Poster
Rep: Reputation: 15
Quote:
Originally Posted by amani View Post
exact command used?
Code:
rsync -rav --delete /opt/apps/busobj/bobj/bobje/data/sleepy/input /opt/apps/busobj/busobjdata/sl/frs/du
 
Old 05-17-2012, 08:33 PM   #4
xj-linux
Member
 
Registered: Feb 2006
Location: Minnesota
Distribution: SUSE - AIX
Posts: 30

Rep: Reputation: 2
Tar would probably work:

cd /path/to/sourcedir
tar -cf - . | (cd /path/to/targetdir ; tar -vxf - )

dd would also probably work.
 
Old 05-17-2012, 08:59 PM   #5
Cpare
Member
 
Registered: Aug 2001
Location: Magic City, USA
Distribution: Ubuntu
Posts: 65

Original Poster
Rep: Reputation: 15
Post

Quote:
Originally Posted by xj-linux View Post
Tar would probably work:

cd /path/to/sourcedir
tar -cf - . | (cd /path/to/targetdir ; tar -vxf - )

dd would also probably work.
We have a 4hr window to move 1tb, our initial tests show a copy is going to take around 11hrs. Even if tar reduced the time by 50% (doubtful) its still not enough. The only option seems to be a full copy, followed by a 2nd pass to synch the Delta we created during the live copy. We create about 10gb/day, and cleanup 2-3gb, something we can easily manage in our window
 
Old 05-18-2012, 12:11 AM   #6
xj-linux
Member
 
Registered: Feb 2006
Location: Minnesota
Distribution: SUSE - AIX
Posts: 30

Rep: Reputation: 2
Quote:
Originally Posted by Cpare View Post
We have a 4hr window to move 1tb, our initial tests show a copy is going to take around 11hrs. Even if tar reduced the time by 50% (doubtful) its still not enough. The only option seems to be a full copy, followed by a 2nd pass to synch the Delta we created during the live copy. We create about 10gb/day, and cleanup 2-3gb, something we can easily manage in our window
Didn't really pick up on a time constraint from the OP. Thought it was more of a "what would work" question.

Is this on the same box? Why not extendvg with the new disk, then migratepv the data from the old disk to the new disk, and then reducevg the old disk out of the vg?
 
Old 05-18-2012, 11:37 PM   #7
Cpare
Member
 
Registered: Aug 2001
Location: Magic City, USA
Distribution: Ubuntu
Posts: 65

Original Poster
Rep: Reputation: 15
Quote:
Originally Posted by xj-linux View Post
Didn't really pick up on a time constraint from the OP. Thought it was more of a "what would work" question.

Is this on the same box? Why not extendvg with the new disk, then migratepv the data from the old disk to the new disk, and then reducevg the old disk out of the vg?
Old volume is a HACMP volume (seen as a local disk when active), new is an isilon NAS. I don't think we could extend like that.

Last edited by Cpare; 05-18-2012 at 11:39 PM.
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
rsync continue on errors? Blash Linux - Newbie 6 10-24-2009 05:30 PM
Rsync Tossing Errors Osiris990 Linux - Server 2 08-03-2009 10:10 AM
disk errors using rsync byhisdeeds Linux - Software 1 03-14-2009 03:54 PM
3 rsync errors at once sunethj Linux - Software 4 04-11-2007 12:18 AM
Rsync Errors during backups shawnbishop Linux - Software 4 05-18-2006 04:26 AM


All times are GMT -5. The time now is 03:25 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
identi.ca: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration