LinuxQuestions.org
LinuxAnswers - the LQ Linux tutorial section.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Software
User Name
Password
Linux - Software This forum is for Software issues.
Having a problem installing a new program? Want to know which application is best for the job? Post your question in this forum.

Notices

Reply
 
Search this Thread
Old 05-31-2012, 03:36 PM   #1
guyboisvert
LQ Newbie
 
Registered: May 2012
Posts: 2

Rep: Reputation: Disabled
rsync 3 verbosity


Hi everybody!

I'm new to this forum. I have a backup script that i've been using for a while and i noticed a change in verbosity level recently. I am running rsync-3.0.6-5.el6_0.1.x86_64 on CentOS Linux 6.2.

Before, i had only what was copied / deleted in the log (+ stats at the end). Now, it is like rsync is logging every file of the "Modules" i'm syncing!

Here is the rsync command i use inside my script:

/usr/bin/rsync \
-a --delete --delete-excluded --stats \
--exclude-from="$EXCLUSION" --modify-window=2 \
$SRCMODULE $TARGETMODTODAY_RS


At the head of my script, i use to trap all the script's output:

BASEPATT=/srv/samba/VolGroup01/backups

datelog=`/bin/date --iso-8601`
outlog=$BASEPATT/logs/$datelog.log


exec 3>&1 4>&2
trap 'exec 2>&4 1>&3' 0 1 2 3
exec 1>$outlog 2>&1


What's the catch? TIA!
 
Old 06-01-2012, 12:10 AM   #2
faginbagin
LQ Newbie
 
Registered: Nov 2007
Distribution: Debian, Ubuntu, Mythbuntu
Posts: 5

Rep: Reputation: 0
Perhaps my experience with rsync can help.

On my client (Ubuntu 10.10 x86_64), rsync --version reports:
Code:
rsync  version 3.0.7  protocol version 30
Copyright (C) 1996-2009 by Andrew Tridgell, Wayne Davison, and others.
Web site: http://rsync.samba.org/
Capabilities:
    64-bit files, 64-bit inums, 64-bit timestamps, 64-bit long ints,
    socketpairs, hardlinks, symlinks, IPv6, batchfiles, inplace,
    append, ACLs, xattrs, iconv, symtimes
On my server (Debian Lenny i686), rsync --version reports:
Code:
rsync  version 3.0.3  protocol version 30
Copyright (C) 1996-2008 by Andrew Tridgell, Wayne Davison, and others.
Web site: http://rsync.samba.org/
Capabilities:
    64-bit files, 64-bit inums, 32-bit timestamps, 64-bit long ints,
    socketpairs, hardlinks, symlinks, IPv6, batchfiles, inplace,
    append, ACLs, xattrs, iconv, symtimes
The client executes commands like the following:
Code:
rsync -ai --delete --stats $BACKUP_ROOT/`uname -n`/ myserver::backup/`uname -n`
The typical output looks like this:
Code:
.d..t...... ./
*deleting   mythconverg-1254-20111229024744.sql.gz
<f..t...... boot-4.lst
<f.st...... boot-4.tgz
<f.st...... common-4.lst
<f.st...... common-4.tgz
<f.st...... etc-4.lst
<f.st...... etc-4.tgz
<f..t...... lucid-4.lst
<f.st...... lucid-4.tgz
<f+++++++++ mythconverg-1254-20120105024147.sql.gz

Number of files: 83
Number of files transferred: 9
Total file size: 4626672361 bytes
Total transferred file size: 28553260 bytes
Literal data: 21919460 bytes
Matched data: 6633800 bytes
File list size: 1297
File list generation time: 0.002 seconds
File list transfer time: 0.000 seconds
Total bytes sent: 21938672
Total bytes received: 43244

sent 21938672 bytes  received 43244 bytes  6280547.43 bytes/sec
total size is 4626672361  speedup is 210.48
As you can see, rsync is NOT listing all 83 files, just the ones it deleted, updated and added. But then, we are using somewhat different options. I use -i, --itemize, and I don't use any exclusion options or --modify-window. Instead, I use ntp to keep my computers' times in sync. Could it be that your computers' times differ by more than 2 seconds?

HTH,
Helen
 
Old 06-01-2012, 10:26 AM   #3
guyboisvert
LQ Newbie
 
Registered: May 2012
Posts: 2

Original Poster
Rep: Reputation: Disabled
Hi!

I use the --modify-window because the remote server is a Windoze box running cwRsync (rsync version 3.0.7). On another CentOS box (version 5.5), i have rsync version 2.6.8 and the logs are normal with the exactly same command parameters. As you can see, i don't use any "v" parameters so i'm surprised that the logs are that big (156 megs of log for a 24 minutes rsync run on 1.6 TB dataset).

Excerpt from log (1st module):


Number of files: 659900
Number of files transferred: 0
Total file size: 752690296788 bytes
Total transferred file size: 0 bytes
Literal data: 0 bytes
Matched data: 0 bytes
File list size: 15638504
File list generation time: 0.156 seconds
File list transfer time: 0.000 seconds
Total bytes sent: 60444
Total bytes received: 15867173

sent 60444 bytes received 15867173 bytes 38990.49 bytes/sec
total size is 752690296788 speedup is 47256.93
2012-05-31_20:12:45 Rsync users completed with 0 in 00:12:44

and i have 659913 lines of log before that!
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
rsync solaris + ld.so.1: rsync: fatal: libiconv.so.2: open failed: xxx_anuj_xxx Solaris / OpenSolaris 25 02-23-2012 04:23 AM
[SOLVED] portage compilation verbosity question... fedoralinuxjunkie Calculate 2 08-15-2010 12:11 AM
KDE error log verbosity settings jlinkels Linux - Software 1 11-07-2009 11:38 AM
Changing X verbosity level atunguyd Linux - Newbie 3 07-24-2008 02:28 AM
no verbosity with boot after 2.6 upgrade fincher69 Slackware 2 09-11-2006 12:03 PM


All times are GMT -5. The time now is 02:02 PM.

Main Menu
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
identi.ca: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration