Firefox automation

pixellany · 06-29-2007, 08:19 PM

I have done some searching here and on Google. I find some links, but nothing that appears to tell the whole story.

What are the best tools for automation of web browsing using Firefox? On thing that looked promising was "Chickenfoot".

I need something that will download a page and record a couple of bits of data. It has to be able to read cookies or otherwise be able to identify me as a known user of the site.

archtoad6 · 07-11-2007, 04:48 PM

Why does it have to be FF?

I suspect that wget, perhaps better, curl can do what you want. Both can "lie" about who they are & deal w/ cookies in & out.

Oh yes, both man pages are long & complex.

BTW, what are you up to?

pixellany · 07-11-2007, 06:04 PM

I have also found twill, which seems to work quite well so far. It is Python-based, which has no got me re-learning Python.

The problem has to do with repeatedly accessing a web site with different parameters---For example, you might have a url with "id=123456" at the end. I'd like to do several accesses with different numbers.

Thanks for the input.

jonwatson · 07-12-2007, 12:43 AM

lynx with the --dump command might work as well.