sed whitespace substitution problem.

jschiwal · 07-17-2009, 09:57 AM

You could use find's -print0 option, and pipe the output to 'xargs -0'. Look at the options for xargs, as it has options that limit the number of arguments that fill the argv array. This prevents a bash out of memory error.

Another option, if you want to backup from a list of files, is to use the `tr' command to replace newlines to nulls, and pipe the output to "xargs -0"
tr <filelist '\n' '0' | xargs -0 -L 1000 cp --target-directory="${target-directory}"

---

Also consider using tar or rsync to replicate files to a backup. Tar can use a snapshot file so that only new files are copied.

BACKUPDIR=/mnt/lacie/backups/
tar -C /home/sambashare/ -g timestamp.snar -cf - . | tar -C "${BACKUPDIR}/ -xvf - >logfile

Suppose you have a fileserver where you save backups to. You can backup to it via ssh even if it is somewhere out on the Internet:
eval $(ssh-agent)
ssh-add
<password>
tar -C /home/sambashare/ -g timestamp.snar -cf - . | ssh user@mrbackup tar -C "${BACKUPDIR}/" -xvf - >logfile
You want to use public key authentication for this.

colucix · 07-17-2009, 10:00 AM

Quote:

Originally Posted by arashi256

Yep.

Code:

./inc.sh: line 10: syntax error near unexpected token `<'
./inc.sh: line 10: `    done < <(cat FILE-LIST.tmp)'

Which shell are you using? It does not work in /bin/sh but in /bin/bash yes:

Code:

$ cat file.txt
My Documents
/home/colucix/name with spaces/file
$ while read filename; do echo "$filename"; done < <(cat file.txt)
My Documents
/home/colucix/name with spaces/file

arashi256 · 07-17-2009, 10:07 AM

Okay, fixed it.

I had to temporarily surpress the IFS default bash "field separator" enviroment variable before doing my thing. Took out the sed stuff as it wasn't necessary as long as I enclosed stuff with spaces in double-quotes.

Thanks all.

Code:

IFS=; for filename in $(cat ~/FILE-LIST.tmp)
do
    # Do stuff...
done

gulfax · 07-17-2009, 11:03 AM

Double quoting the $(...) construct in the for-loop should fix it, i.e.
for filename in "$(cat ~/FILE-LIST.tmp)"