Perl Run Script on all Files in folder on webserver

baddah · 07-10-2008, 07:48 AM

Hi,

I have a perl script that connect to a webserver and downloads a file and do some calculations with the file. Something like the following..

Code:

my $url = "http://localhost/test/file1.txt";
my $content = get $url;

while ($content =~ m/(\S+) (\S+) (\S+) (\S+) (\S+) (\S+)/g) {
       # Each file has 6 columns, thats why i split it up
       #do calculations

}

All this is fine, but i want to change this so that the script will auto run on all files in the specified folder. So something like a 'ls' of the directory and then a loop to get the output from ls (or whatever) and run the calculations on the file one by one.. something like

Code:

ls into variable $filename        #not sure how to do this part

while ($filename) {
     my $url = "http://localhost/test/$filename";
     my $content = get $url;

     while ($content =~ m/(\S+) (\S+) (\S+) (\S+) (\S+) (\S+)/g) {
       #do calculations
     }
}

Any suggestion how to get that first part right? i.e To list the files in the directory one by one into a variable of some sort and then get the files one by one?

Thanks for any help

baddah · 07-10-2008, 08:19 AM

Hi,

Thanks, i figured something out.

Maybe theres a better way, but the following is good enough for me at the moment.

Code:

open(LS,"ls --format single-column /var/www/html/test |") || die "Failed: $!\n";
while ( <LS> ) {

        $filename = $_;
        print "Filename = $filename";
         
        my $url = "http://localhost/test/$filename";
        my $content = get $url;

        while ($content =~ m/(\S+) (\S+) (\S+) (\S+) (\S+) (\S+)/g) {
          #do calculations
        }
}

theNbomr · 07-10-2008, 03:26 PM

That works if the script is running on the same host as the web server. In that case, I recommend the perl function opendir(), followed by readdir(), closedir().
If you need to get a list of files on a remote web site, it must be configured co-operatively to provide index listings. The format of said listings can be variable, and you will also have to parse the filenames and other attributes out of the HTML code.
--- rod.