LinuxQuestions.org
Latest LQ Deal: Latest LQ Deals
Go Back   LinuxQuestions.org > Forums > Non-*NIX Forums > Programming
User Name
Password
Programming This forum is for all programming questions.
The question does not have to be directly related to Linux and any language is fair game.

Notices


Reply
  Search this Thread
Old 09-23-2006, 04:07 AM   #1
pankaj99
Member
 
Registered: Mar 2006
Location: India
Distribution: Fedora
Posts: 47

Rep: Reputation: 15
script to download a webpage


somebody please give me a perl/python script to download a url.
 
Old 09-23-2006, 04:12 AM   #2
ghostdog74
Senior Member
 
Registered: Aug 2006
Posts: 2,697
Blog Entries: 5

Rep: Reputation: 244Reputation: 244Reputation: 244
Quote:
Originally Posted by pankaj99
somebody please give me a perl/python script to download a url.
Instead of giving it to you, you can do a search on the web and try to program it yourself after reading an example like this:
http://docs.python.org/lib/module-urllib2.html
http://www.voidspace.org.uk/python/a.../urllib2.shtml

or this
http://www.perl.com/pub/a/2002/08/20/perlandlwp.html
 
Old 09-23-2006, 04:22 AM   #3
pankaj99
Member
 
Registered: Mar 2006
Location: India
Distribution: Fedora
Posts: 47

Original Poster
Rep: Reputation: 15
thanks ghostdog74.
Actually, I don't know perl/python just trying out something ,and for that
I need to download a webpage and parse it.

Anyway,
now how do i tunnel my request through a proxy server?
does perl provides any mechanism to use a proxy ?
 
Old 09-23-2006, 05:56 AM   #4
ghostdog74
Senior Member
 
Registered: Aug 2006
Posts: 2,697
Blog Entries: 5

Rep: Reputation: 244Reputation: 244Reputation: 244
Quote:
Originally Posted by pankaj99
thanks ghostdog74.
Actually, I don't know perl/python just trying out something ,and for that
I need to download a webpage and parse it.

Anyway,
now how do i tunnel my request through a proxy server?
does perl provides any mechanism to use a proxy ?
Perl:
http://www.oreilly.com/openbook/webc...h05.html#34288
look for "Using LWP::UserAgent"
 
Old 09-23-2006, 06:28 AM   #5
pankaj99
Member
 
Registered: Mar 2006
Location: India
Distribution: Fedora
Posts: 47

Original Poster
Rep: Reputation: 15
thanks that was really helpful.
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
wget will not download full webpage with images hedpe Linux - Software 2 02-15-2006 11:46 PM
CGI script problem: Send/Expect command echo on webpage rajatgarg Programming 2 07-11-2004 04:38 PM
executing script via webpage through apache server feetyouwell Linux - Software 7 02-08-2004 03:23 PM
Stalled WebPage Load/No Download DigitMole Mandriva 2 02-02-2004 05:09 PM
script to update my webpage yank_ Linux - General 0 02-16-2001 05:56 PM

LinuxQuestions.org > Forums > Non-*NIX Forums > Programming

All times are GMT -5. The time now is 10:48 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration