[SOLVED] Dead link checker in bash

sopier · 12-16-2011, 10:11 AM

Hi, I have a code like this:

Code:

#!/bin/bash

function isLive {
    wget -q --spider $1
}

isLive "http://supremecourtofindia.nic.in/ecommittee/25%20Salient%20Features%20of%20Ubuntu%20Linux%20OS%20DVD.pdf"

if [ $? -eq 0 ]; then
    echo "Good link"
else
    echo "Broken link"
fi

The link is live, I can download the pdf using browser, but the script can't process the url, and hang...

Any solution on this?

H_TeXMeX_H · 12-16-2011, 10:16 AM

Try:

Code:

wget -q --spider --user-agent="Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.0.1) Gecko/20060111 Firefox/1.5.0.1" http://supremecourtofindia.nic.in/ecommittee/25%20Salient%20Features%20of%20Ubuntu%20Linux%20OS%20DVD.pdf

sopier · 12-16-2011, 10:36 AM

Thank you... it works like charm....

sopier · 12-16-2011, 07:38 PM

Hey, I'm improving the script like below:

Code:

#!/bin/bash

function isLive {
    wget -q --spider --spider --connect-timeout=5 --user-agent="Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.0.1) Gecko/20060111 Firefox/1.5.0.1" $1
}

isLive "http://reksio.ftj.agh.edu.pl/~azrael/ubuntu/marketing/po_polsku/wersje%20robocze/Ubuntu_wallet.pdf"

if [ $? -eq 0 ]; then
    echo "Good link"
else
    echo "Broken link"
fi

and when I run the script, it freeze out... How to set timeout properly? So, if after xx seconds frozen, it can be categorized as broken links...

sopier · 12-16-2011, 07:44 PM

Never mind, it's solved, I add the --tries=xx argument in the wget option, so the script will looks like this:

Code:

#!/bin/bash

function isLive {
    wget -q --spider --spider --connect-timeout=5 --tries=3 --user-agent="Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.0.1) Gecko/20060111 Firefox/1.5.0.1" $1
}

isLive "http://reksio.ftj.agh.edu.pl/~azrael/ubuntu/marketing/po_polsku/wersje%20robocze/Ubuntu_wallet.pdf"

if [ $? -eq 0 ]; then
    echo "Good link"
else
    echo "Broken link"
fi

grail · 12-17-2011, 10:14 PM

As you are using bash you can also use 'if' to do the test for you:

Code:

if command; then
    <if true>
else
    <if false>
fi