Command to get output of a URL

ikinnu · 07-22-2008, 05:46 AM

Hi,

Given a URL and only the command line, is there any command i can use such that the page output of the URL will be displayed on the command-line screen? I cannot use a browser and also i want to parse the text lines of the resulting page of the URL.

Thanks

Vit77 · 07-22-2008, 05:51 AM

Download it using wget and then parse it.

ikinnu · 07-22-2008, 06:09 AM

Is there anyway i can output that in the command line instead of a file?

Vit77 · 07-22-2008, 06:19 AM

If you mean analysing the downloaded file without saving it on HDD, try this:

wget -O - http://url | <your parsing code>

ikinnu · 07-22-2008, 06:47 AM

i have piped this to grep but it doesn't seem to be working. It still outputs the text to screen. I am checking options to wget.

Vit77 · 07-22-2008, 06:58 AM

You see the output to the stderr device.
To get rid of it redirect the stream to /dev/null:

wget -O - http://www/index.html 2>/dev/null | grep 'TD'