LinuxQuestions.org
Share your knowledge at the LQ Wiki.
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Software
User Name
Password
Linux - Software This forum is for Software issues.
Having a problem installing a new program? Want to know which application is best for the job? Post your question in this forum.

Notices


Reply
  Search this Thread
Old 02-08-2008, 02:02 PM   #1
gnashley
Amigo developer
 
Registered: Dec 2003
Location: Germany
Distribution: Slackware
Posts: 4,928

Rep: Reputation: 612Reputation: 612Reputation: 612Reputation: 612Reputation: 612Reputation: 612
Recursive directory listing over http or ftp


I'm trying find out if there is way to get a recursive directory listing over http, ftp or other protocols from websites where I cannot logon.

I've looked at some lynx commands using -crawl and -traversal which do what I want -sort of. I'm trying to implement a search function which can return the dir contents of mostly ftp and http download sites where I am unable to use ssh or other authenticated login.

Does anyone have any ideas for doing this.
 
Old 02-09-2008, 07:03 AM   #2
Su-Shee
Member
 
Registered: Sep 2007
Location: Berlin
Distribution: Slackware
Posts: 510

Rep: Reputation: 53
If I come to a point where wget or curl isn't enough, I use Perl's LWP for that.

It's essentially a crawler/spider/act like my browser bundle - but as it is a regular Perl module it's very flexible.
 
  


Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
Recursive listing? bkone Linux - Newbie 5 09-29-2007 08:09 AM
Save ftp directory listing into a file Vitalie Ciubotaru Linux - Software 1 06-30-2007 06:37 PM
Recursive directories listing cdog Linux - General 11 12-09-2006 07:04 AM
Spiffing up Apache HTTP directory listing? orange400 Linux - Software 11 06-11-2004 02:51 AM
how can I restrict ftp users listing files from a pure-ftp server adrianmak Linux - Networking 2 12-31-2002 08:23 AM

LinuxQuestions.org > Forums > Linux Forums > Linux - Software

All times are GMT -5. The time now is 05:15 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration