LinuxQuestions.org
Help answer threads with 0 replies.
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Non-*NIX Forums > Programming
User Name
Password
Programming This forum is for all programming questions.
The question does not have to be directly related to Linux and any language is fair game.

Notices


Reply
  Search this Thread
Old 01-01-2005, 07:43 PM   #1
blinux1
Member
 
Registered: Nov 2002
Location: Pennsylvania
Distribution: Mandrake 9.1 and Redhat 9
Posts: 144

Rep: Reputation: 15
http file downloader


hi there. I'm currently searching a data collection site that has massive amounts of files. One one of the pages there are a thousand or so files, but it seems they can only be accesssed for downloading one at a time. This is not an FTP server, but each file can be clicked and a single download will occur. Is there a way to write a script that automatically downloads all of these files at once? Thanks.

--ben
 
Old 01-01-2005, 07:47 PM   #2
jlliagre
Moderator
 
Registered: Feb 2004
Location: Outside Paris
Distribution: Solaris 11.4, Oracle Linux, Mint, Debian/WSL
Posts: 9,789

Rep: Reputation: 492Reputation: 492Reputation: 492Reputation: 492Reputation: 492
Did you try with wget ?
 
Old 01-01-2005, 07:53 PM   #3
blinux1
Member
 
Registered: Nov 2002
Location: Pennsylvania
Distribution: Mandrake 9.1 and Redhat 9
Posts: 144

Original Poster
Rep: Reputation: 15
do you know if there's a window's counterpart to that? (internet connection isn't working right now under linux). Thanks.

--ben
 
Old 01-01-2005, 08:10 PM   #4
jlliagre
Moderator
 
Registered: Feb 2004
Location: Outside Paris
Distribution: Solaris 11.4, Oracle Linux, Mint, Debian/WSL
Posts: 9,789

Rep: Reputation: 492Reputation: 492Reputation: 492Reputation: 492Reputation: 492
wget works under windows / cygwin.
 
Old 01-01-2005, 08:11 PM   #5
Dodgeram01
Member
 
Registered: Jun 2003
Distribution: Gentoo and Ubuntu
Posts: 95

Rep: Reputation: 15
You can find a windows version of wget here.
 
Old 01-01-2005, 11:54 PM   #6
blinux1
Member
 
Registered: Nov 2002
Location: Pennsylvania
Distribution: Mandrake 9.1 and Redhat 9
Posts: 144

Original Poster
Rep: Reputation: 15
thank you. wget is working in the windows console....i discovered of course that the page i was trying to download from resulted from a php script so I couldn't really massively download. But i found another HTML directory tree and it worked fine. thanks a bunch!
 
  


Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
Http Linux file server doc54963 Linux - Enterprise 3 10-14-2004 10:10 PM
problems with http file uploading baczer Linux - Software 0 06-30-2004 08:26 AM
Making An Http File Server? AFI_Flame Linux - Software 4 06-06-2004 10:33 PM
Determining Whether HTTP File Exists overbored Linux - Software 1 05-22-2004 01:30 AM
Default HTTP.conf file please? richhoward Linux - General 3 09-14-2003 02:31 PM

LinuxQuestions.org > Forums > Non-*NIX Forums > Programming

All times are GMT -5. The time now is 04:25 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration