I'm having a problem using wget with ftp sites and verifying that a file is in existence on the ftp server here is my code:

for i in `seq 1 $loop` ; do
cut -d, -f$i web > site
wget -O file.html -i site -T 10 -t 2 --no-remove-listing
check=`grep 12.tgz file.html`
if [ ! "$check" ]
then cat site >> broken
else cat site >> verified
fi
rm .listing
done

I have a master file that I use to pull ftp sites out of and run it in a loop I get about half of the sites that are valid are listing as bad I also tried this by grep'ing the .listing file but the same results.

Thanks in advance.

aren't old versions of the file.html file being used in failing loops? try putting an explicit rm command at the end of the loop to delete that file each time.

Thanks got it going.

i'd say you appear to be really complication what sounds like a reasonably trivial problem...

while read site < sitelist
do
curl -I $site/12.tgz && echo $site OK! || echo $site BAD!
done