Linux FTP program?

nyk · 10-08-2004, 08:30 AM

Is there a good linux FTP program to download multiple files each in its seperate thread?
Doesn't matter whether it has a GUI or not..

Would just like to enter "get *" and then there is a download thead for file*.ext.
Like in leechFTP in windows..

Or like lftp, but there the pget command doesn't accept wildcard, unfortunately? Or is there a trick with it?

Mega Man X · 10-08-2004, 08:34 AM

Tried gftp or even kbear?. I love the first one

nyk · 10-08-2004, 08:36 AM

yeah tried and didn't like them... but thanks anyway!

chongluo · 10-08-2004, 08:39 AM

how about ncftp

bulliver · 10-08-2004, 09:44 AM

lftp will do what you want...just use mget instead of pget.

Code:

lftp anonymous@somewhere:/> help mget
Usage: mget [OPTS] <files>
Gets selected files with expanded wildcards
 -c  continue, reget
 -d  create directories the same as in file names and get the
     files into them instead of current directory
 -E  delete remote files after successful transfer
 -a  use ascii mode (binary is the default)
 -O <base> specifies base directory or URL where files should be placed
lftp anonymous@somewhere:/> mget *.ext

nyk · 10-08-2004, 10:08 AM

but I want it to download all the files in seperate threads in PARALLEL!

bulliver · 10-08-2004, 10:14 AM

I see, not sure if I've ever heard of something that can do that. Sounds like a job for a python script.

nyk · 10-08-2004, 02:07 PM

I wrote a perl script now that sends all the files to a background ncftp transfer.

Now I only have to write a script, that calculates the total transfer rate and tells me, when all transfers all done.

Code:

#!/usr/bin/perl

# pass ftp directory whose content you want to download as argument
# works with a windows ftp, dont know for unix yet.... (regex for dir listing)
# creates the directory you download localy
use Net::FTP;
$dir=shift;$serv="server_adress";$port="server_port";$user="username";$pass="password";
$ftp=Net::FTP->new($serv,Port=>$port,Passive=>1);
$ftp->login($user,$pass);@list=$ftp->dir($dir);
if ($dir=~/\/(.+)$/) {$ldir=$1} else {die}
mkdir($ldir) or die;
for ($i=0;$i<@list;$i++) {
	if ($list[$i]=~/^.+ (.+)$/) {$fn=$1} else {$fn=0}
	if ($fn=~/^\./) {$fn=0}
	$c="nohup ncftpget -c \'ftp:\/\/$user:$pass\@$serv:$port\/$dir\/$fn\' >\'$ldir\/$fn\' &";
	if ($fn) {print "$fn\n";system($c);$flist[$k]=$fn;$k++;}
}