Perl URL redirect question

amboxer21 · 12-03-2013, 12:51 AM

I have a URL(A) that redirects me to another URL(B). This URL(B) will redirect me to the final URL(C) and has an access code inside of the address bar. So a total of 3 redirects.

I can get the second URL(B), the redirect URL(B), but in order to obtain the 3rd redirect URL(C), I need to use the system call and open the URL(B) in the browser which redirects me to the third URL(C) which has the access code i need.

I need to get the access code with inside the address bar URL(C) without opening a browser tab. How can I accomplish this?

amboxer21 · 12-03-2013, 04:08 AM

This does it

Code:

my $ua = LWP::UserAgent->new;
my $response = $ua->get($uri);
print $response->request->uri . "\n";

But i recieve this error ->

Code:

https://www.facebook.com/unsupportedbrowser

I would assume because I am running it from a terminal.

NevemTeve · 12-03-2013, 06:47 AM

Maybe you should 'emulate' some actual 'User-Agent' header, eg:

Mozilla/5.0 (X11; Linux i686 on x86_64; rv:25.0) Gecko/20100101 Firefox/25.0

sundialsvcs · 12-03-2013, 07:00 AM

This might be a question better posed at http://www.perlmonks.org.

Also, consider your overall approach. Facebook has a programmatic API that is intended for "program-to-program" activities, vs. those which rely upon a heavily JavaScript-driven browser. And, Perl has CPAN modules to interface with it (see http://search.cpan.org.

Articles like this one http://developeronline.blogspot.com/...ok-part-i.html are also plentiful and useful.

Yes indeed, FB does query your browser-type and will not go far if it doesn't recognize what your LWP instance claims to be. However, also note that FB "will not go far," in general, without resorting to JavaScript ... which is much more difficult to programmatically emulate. They're a pretty busy bunch of coders, constantly fiddling with their system's guts even when the external UI doesn't change visibly. Build your code with flexibility in mind, and put it under source-code control (such as "git") so that you can change it easily when they do.

amboxer21 · 12-03-2013, 12:34 PM

Quote:

Originally Posted by NevemTeve

Maybe you should 'emulate' some actual 'User-Agent' header, eg:

Mozilla/5.0 (X11; Linux i686 on x86_64; rv:25.0) Gecko/20100101 Firefox/25.0

I think thats exactly what I need to do. Maybe the Mechanize constructor will do. Thanks!

amboxer21 · 12-03-2013, 12:42 PM

Quote:

Originally Posted by sundialsvcs

This might be a question better posed at http://www.perlmonks.org.

OK. I just figure there are so many intelligent and talente members here, yo never know what someone might be knowlegable about! I guess perlmonks wold be better suited though huh?

Quote:

Originally Posted by sundialsvcs

Also, consider your overall approach. Facebook has a programmatic API that is intended for "program-to-program" activities, vs. those which rely upon a heavily JavaScript-driven browser. And, Perl has CPAN modules to interface with it (see http://search.cpan.org.

I am using the Facebook Graph module made for Perl. That only goes so far. I have a program up and running. I already wrote a GUI, have the login, OAuth, access token manipulation sub routines suited for the programs needs, etc. I am trying to fully automate my program. This browser redirect is the last step but i think NevemTeve, has the right idea!

Quote:

Originally Posted by sundialsvcs

Articles like this one http://developeronline.blogspot.com/...ok-part-i.html are also plentiful and useful.

Thanks, I'l have a look.

Quote:

Originally Posted by sundialsvcs

Yes indeed, FB does query your browser-type and will not go far if it doesn't recognize what your LWP instance claims to be. However, also note that FB "will not go far," in general, without resorting to JavaScript ... which is much more difficult to programmatically emulate. They're a pretty busy bunch of coders, constantly fiddling with their system's guts even when the external UI doesn't change visibly. Build your code with flexibility in mind, and put it under source-code control (such as "git") so that you can change it easily when they do.

I could use the selenium module if i wanted to use/interface with JS while using Perl.