LinuxQuestions.org
Download your favorite Linux distribution at LQ ISO.
Go Back   LinuxQuestions.org > Forums > Non-*NIX Forums > Programming
User Name
Password
Programming This forum is for all programming questions.
The question does not have to be directly related to Linux and any language is fair game.

Notices


Reply
  Search this Thread
Old 10-22-2003, 08:45 AM   #1
BBQ_Matt
LQ Newbie
 
Registered: Sep 2003
Location: Sydney, Australia
Distribution: ubuntu, suse, redhat
Posts: 18

Rep: Reputation: 0
Question Web Page Retrieval & Processing with PERL


I want to retrieve a web page (which I can't list due to posting rules) and retrieve the stock information for storage in a file.

I've tried wget and it's doesn't seem to work properly. I believe wget doesn't work properly because to wed page is .jsp file with multiple options.

I'm trying to do this in PERL as I'm a bit more familar with processing the data in PERL line by line. I just need to be able to retrieve the data in an automated way.

Does anybody have any tips?
 
Old 10-22-2003, 10:07 PM   #2
ToniT
Senior Member
 
Registered: Oct 2003
Location: Zurich, Switzerland
Distribution: Debian/unstable
Posts: 1,357

Rep: Reputation: 47
You could use the curl.

Or read the 'man perlipc' to find out how you can connect by yourself. The http-protocol
is easy to speak. Something like:[code]
$netcat www.hut.fi 80
GET http://www.hut.fi/index.html http/1.0

[code] gives me a web-page.
 
Old 10-23-2003, 02:01 PM   #3
david_ross
Moderator
 
Registered: Mar 2003
Location: Scotland
Distribution: Slackware, RedHat, Debian
Posts: 12,047

Rep: Reputation: 79
You can use the LWP module - lots of info available if google.
 
Old 10-25-2003, 09:20 AM   #4
silatts
LQ Newbie
 
Registered: Oct 2003
Posts: 19

Rep: Reputation: 0
http://search.cpan.org/~gaas/libwww-....74/lib/LWP.pm

all you probably need is lwp-mirror - try http://search.cpan.org for mirror

Sil
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
Cant make web server run my local web page... Nik0s Linux - Newbie 22 10-08-2006 10:30 PM
my web browser "mozilla fire fox" isn't rendering the page, rather opening the page amolgupta Linux - Software 2 07-26-2005 12:41 AM
Wireless Router D-Link DSL-G604T - intermittent web page retrieval on Fedora Core 4 shogunmike Linux - Wireless Networking 3 07-05-2005 01:29 AM
Apache Web Server w/PHP & Perl Mark Grinstead Linux - Software 2 07-18-2003 07:23 AM
Jerky mouse when web browsers download web page stodge Linux - Software 1 07-08-2003 10:29 PM

LinuxQuestions.org > Forums > Non-*NIX Forums > Programming

All times are GMT -5. The time now is 05:07 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration