LinuxQuestions.org
Review your favorite Linux distribution.
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - General
User Name
Password
Linux - General This Linux forum is for general Linux questions and discussion.
If it is Linux Related and doesn't seem to fit in any other forum then this is the place.

Notices


Reply
  Search this Thread
Old 08-09-2011, 11:56 AM   #1
acctman
LQ Newbie
 
Registered: Feb 2009
Posts: 12

Rep: Reputation: 0
Submitting a link with Wget and Proxy?


Is it possible to do something like this with wget and a Shell script or another method?

1. Load wget
2. load proxy list file (prox.lst)
3. load links list file (timesheets.lst)
4. process go to Link using proxy ... loop through proxy for every link (if proxy timeout skip and use next)
5. continue till all links have been processed/submitted.

example:
wget proxy 1.1.11.1 http://post.server.com/send?11213
wget proxy 45.1.41.1 http://post.server.com/send?199967
 
Old 08-10-2011, 01:03 PM   #2
janhe
Member
 
Registered: Jul 2007
Location: Belgium
Distribution: slackware64 14.2, slackware 13.1
Posts: 371

Rep: Reputation: 54
you can set the proxy with the "http_proxy" environment variable
you can use for loops to go through all proxies in a file with something like this:
Code:
for i in $(cat prox.lst)
do
  http_proxy="$i"
  # do wget stuff
done
You could check the exit status of wget to determine if you should stay in the loop or not.
 
  


Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
[ask] using wget through SOCKS proxy arroquant Linux - Software 5 09-30-2009 06:12 PM
wget - where is it getting proxy information? gandalfrat Linux - Newbie 3 04-21-2007 11:38 PM
wget through proxy TheRealDeal Linux - Networking 5 09-14-2005 06:07 AM
wget with proxy? Cornholio Linux - Software 8 01-13-2005 02:12 AM
Submitting a link LinuxLala LQ Suggestions & Feedback 8 02-12-2004 11:44 AM

LinuxQuestions.org > Forums > Linux Forums > Linux - General

All times are GMT -5. The time now is 10:03 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration