cp progress bar

surfreak · 07-27-2009, 06:43 PM

Found this, anyone want to decode it a bit?

From http://chris-lamb.co.uk/2008/01/24/c...bar-like-wget/ (safe)

#!/bin/sh
cp_p()
{
strace -q -ewrite cp -- "${1}" "${2}" 2>&1 \
| awk '{
count += $NF
if (count % 10 == 0) {
percent = count / total_size * 100
printf "%3d%% [", percent
for (i=0;i<=percent;i++)
printf "="
printf ">"
for (i=percent;i<100;i++)
printf " "
printf "]\r"
}
}
END { print "" }' total_size=$(stat -c '%s' "${1}") count=0
}

Hackeron · 10-02-2009, 01:54 PM

I generally use rsync -aP to copy to see a progress, but it shows a progress on a per file basis and a file count.

Is there anything that will show the overall progress based on size left to copy?

frenchn00b · 11-07-2009, 01:02 AM

Quote:

Originally Posted by homey

Here's another sample which maybe abit more usefull.

Code:

#!/bin/bash
# File copy with progress indicators
# Example: ./test original_file destination_file

usage()
{
   echo "Usage: $0 original_file destination_file"
   exit 1;
}

test $# == 2 || usage

echo Preparing to copy
orig_size=$(stat -c %s $1)

>$2
dest_size=0
cp -f $1 $2 &

while [ $orig_size -gt $dest_size ] ; do
   dest_size=$(stat -c %s $2)
   pct=$((( 100 * $dest_size ) / $orig_size ))

if [ $pct -lt 10 ] ; then
   echo -en "#  $pct%\b\b\b\b"
else
   echo -en "#  $pct%\b\b\b\b\b"
fi
sleep 1
done
echo

And here is another....

Code:

#!/bin/bash
# Example: ./test original_file destination_file
usage()
{
   echo "Usage: $0 original_file destination_file"
   exit 1;
}

test $# == 2 || usage
orig_size=$(stat -c %s $1)

>$2
dest_size=0
cp -f $1 $2 &

while [ $orig_size -gt $dest_size ] ; do
   dest_size=$(stat -c %s $2)
   pct=$((( 69 * $dest_size ) / $orig_size ))

    echo -en "\r["
    for j in `seq 1 $pct`; do
        echo -n "="
    done
    echo -n ">"
    for j in `seq $pct 68`; do
        echo -n "."
    done
    echo -n "] "
    echo -n $((( 100 * $pct ) / 69 ))
    echo -n "%"
done
echo

those results. Could they be in official Debian packages?

that's just a tar.gz to make, and send a file chmoded to :
/usr/bin/ such as hcp
or progressbarcp

It would be could to be in the repositories

or the very best would be to be into cp itself

such as

Code:

cp -p file.ext target.ext

with -p for progress bar added

Damn right you can.

Quote:

#!/bin/sh
cp_p()
{
strace -q -ewrite cp -- "${1}" "${2}" 2>&1 \
| awk '{
count += $NF
if (count % 10 == 0) {
percent = count / total_size * 100
printf "%3d%% [", percent
for (i=0;i<=percent;i++)
printf "="
printf ">"
for (i=percent;i<100;i++)
printf " "
printf "]\r"
}
}
END { print "" }' total_size=$(stat -c '%s' "${1}") count=0
}

In action:

Quote:

% cp_p /mnt/raid/pub/iso/debian/debian-2.2r4potato-i386-netinst.iso /dev/null
76% [===========================================> ]

the not good part 30 to 50pct:

Quote:

Be aware, however, that this adds quite some overhead (30% to 50% in my tests) to the time needed to copy a file. A probably better way would be to use <code>dd</code> under the hood and get its progress status by <code>kill -USR1 $PID</code>. You lose all switches that <code>cp</code> understands, however.
In the end it would probably be better to add a switch to <code>p</code>.

DeNayGo · 01-26-2010, 01:01 PM

I know this thread is getting kinda old, but there doesn't seem to be another _real_ solution, yet, so here's mine:

http://www.beatex.org/web/advancedcopy.html

It's a patch for the original GNU coreutils.

This does exactly what the creator of this thread had in mind. All you have to do is add -g to cp and you have one overall and one per file progress bar to entertain you while you're waiting

frenchn00b · 01-27-2010, 04:42 PM

I experimented :

Code:

rsync -ruva --progress source1 target1

that's the best cuz one can do CTRL + C to break during processss .

no?

frenchn00b · 01-27-2010, 04:44 PM

Quote:

Originally Posted by DeNayGo

I know this thread is getting kinda old, but there doesn't seem to be another _real_ solution, yet, so here's mine:

http://www.beatex.org/web/advancedcopy.html

It's a patch for the original GNU coreutils.

This does exactly what the creator of this thread had in mind. All you have to do is add -g to cp and you have one overall and one per file progress bar to entertain you while you're waiting

that's nice but you have to consider this, that advanced cp has to have too :

cp -R

cp -a

cp -u

...
and so on ... those are highly important for various uses.
Our cp function, the standard, is already very advanced and serves all sorts of uses

Code:

man cp

Devcon · 03-04-2010, 12:09 AM

Quote:

Originally Posted by DeNayGo

I know this thread is getting kinda old, but there doesn't seem to be another _real_ solution, yet, so here's mine:

http://www.beatex.org/web/advancedcopy.html

It's a patch for the original GNU coreutils.

This does exactly what the creator of this thread had in mind. All you have to do is add -g to cp and you have one overall and one per file progress bar to entertain you while you're waiting

Wow. I've been looking for this kind of functionality for some time. I know rsync is a more robust alternative for heavy duty copies, but I consider rsync to be more for scripted operations. A '--progress-bar' option should be a stock option for cp. I compiled your source and copied the executable as 'acp'.

The only thing left is to develop effective resume options.

Thanks for the patch

frenchn00b · 03-07-2010, 02:19 AM

Quote:

Originally Posted by Devcon

Wow. I've been looking for this kind of functionality for some time. I know rsync is a more robust alternative for heavy duty copies, but I consider rsync to be more for scripted operations. A '--progress-bar' option should be a stock option for cp. I compiled your source and copied the executable as 'acp'.

The only thing left is to develop effective resume options.

Thanks for the patch

rsync is bit buggy. Sometimes it hangs saying that configuration files are missing. beware. cp is more robust, by far.

Devcon · 03-07-2010, 05:20 PM

I've never had problems with rsync, although it is all the more reason to push this patch. I've copied many gigs with advanced copy, and am yet to have serious problems. However, it seems the reported speed and time estimations can be a bit erratic.

DanCard · 09-30-2010, 04:39 PM

Quote:

Originally Posted by DeNayGo

I know this thread is getting kinda old, but there doesn't seem to be another _real_ solution, yet, so here's mine:

(removed: not allowed to quote an url)

It's a patch for the original GNU coreutils.

This does exactly what the creator of this thread had in mind. All you have to do is add -g to cp and you have one overall and one per file progress bar to entertain you while you're waiting

Have you submitted this as a patch to GNU coreutils?

Thanks,
Daniel

loopingz · 11-19-2010, 07:22 AM

This post is interesting.

I connect to my NAS in SSH. Then I have cp but no rsync. Is there a way to get rsync running on it or do I have to go a trhough cp and a script?

Thanks

Muhlemmer · 09-04-2011, 08:53 AM

I know this thread is quite old, but could not find the solution in a easy way, but combined solutions find elsewhere. Basically one could use the pv. Pv needs to be installed on you system though. (Package name is sys-apps/pv for gentoo). The following one-liner could be used:

Code:

cp <source> /proc/self/fd/1 | pv -s <size> -p -e -r | cp /proc/self/fd/0 <destination>

cp does not accept to write to standard output by default. It will fail if no input or output is given. So, in order to make it pipe to pv, we use /proc/self/fd/N. fd 0 represent standard input, fd 1 standard output and fd 2 standard error (we don't need that one for this purpose).

To get a process bar, we have to tell pv how much data it will read before we reach 100%. You can find the size of your file with:

Code:

du -h <source>

The size argument accepts K, M and G. Just like du -h gives you.

This will only work with a single file, so not for recursive copy of directories. You could use the rsync alternative for that.