Downloading a list of files from a remote server using a list

ralcocer · 02-10-2009, 03:02 AM

I am trying to get this script to work.
The purpose is to download a list of modules from the slax.org
the list consist of a list of module numbers.
What I am trying to do is Download the file or the file name corresponding to the number in the list.the list is comma delimited.
this is what I have done so far and I am a stand still.

#!/bin/sh

# Wget script to retrieve modules from slax.org modules

#

# ----Begin of user defined values -----

# Path to wget
WGETPATH="/usr/bin"
list_file="/tmp/build.txt"
# modules list file
HLIST="/tmp/build.txt"

#

# output directory
# DOWNLOADIR="/tmp/download
DOWNLOADIR="/tmp/download"

LOGFILE=wgetmodulelog-`date +%m-%d-%y-%H:%M`.log

# Verify download directory exists.
if [ ! -d $DOWNLOADIR ];then
echo ""
echo "$DOWNLOADIR download directory does not exist."
echo "Please create directory $DOWNLOADIR."
exit
fi

for line in `cat ${HLIST}`;do

echo "line" $line

echo "Downloading " ${line}
echo ""#

${WGETPATH}/wget -v "http://www.slax.org/modules/${line}/dl/" ${DOWNLOADIR}/${line} >> ${LOGFILE} 2>&1

done

# "http://www.slax.org/modules.php?action=detail&id=2163" from here to
#http://www.slax.org/modules/2163/ndiswarapper.lzm here

#########################################################
Thanks for your help

Rafael Alcocer
Linux user # 458372
To follow the path:
look to the master,
follow the master,
walk with the master,
see through the master,
become the master.

raskin · 02-11-2009, 12:36 PM

Bash splits only spaces, not commas. Try `cat ${HLIST} | sed -e 's/,/ /g'`

theNbomr · 02-11-2009, 01:02 PM

You haven't exactly explained what part is failing. Can you be more specific about what you need help with?
Here is a snippet of shell script that does the essence of what you seem to be trying:

Code:

cd $DOWNLOADDIR
while read url; 
do 
    wget http://www.slax.org/modules/${url}/dl/; 
done < /tmp/build.txt

(Note how much mode readable code is, when posted in [CODE] tags).

--- rod.