wget/curl problems. redirection after post method
Note: if Wget is redirected after the POST request is completed, it will not send the POST data to the redirected URL. This is because URLs that process POST often respond with a redirection to a regular page (although that's technically disallowed), which does not desire or accept POST. It is not yet clear that this behavior is optimal; if it doesn't work out, it will be changed.
that's what annoys me. I'm writting a bot to crawl through certain website, but there is a form, that redirects after the submission. Saying simply
on page page1.php there is set a form to page3.php
when i try to download page3.php that redirects to page2.php i don't get the page3.php content, which is important for my bot. I obviously can't get page3.php content because of the note above.
is there any way to go around this problem?
|