wget with the user firefox cookies?

Xeratul · 10-10-2011, 01:36 PM

Hello World,

I would like to use wget (with user agent mozilla) using the user firefox cookies which are stored into .mozilla.

Would it please be possible ?

thank you very much for your expertise

Ian John Locke II · 10-10-2011, 01:46 PM

This should be helpful https://www.gnu.org/software/wget/ma...P-Options.html

Using curl may be easier than wget though. http://curl.haxx.se/docs/httpscripting.html

To be honest, while I know you can manipulate user-agent strings in both, I'm uncertain of whether you can use firefox cookies stored in .mozilla/.

Depending on what you're trying to do, you may be better off scripting something in Python, PHP, Ruby or Perl (I'm sure there are other languages with ways of storing Cookies). I'm particularly familiar with Python and the mechanize module (non-standard).

David the H. · 10-11-2011, 09:41 AM

Firefox cookies are now stored in an sqlite database file. There's an extension or two that can export them, or you can use sqlite3. These are the notes I made for myself when I was working on the same thing:

Code:

Extracting cookies from the firefox sqlite database:
Firefox locks the database when running, so be sure to shut down first,
or else create a copy of the database and use that instead.

To get all cookies in the database, printed as-is, use this:

	sqlite3 -separator $'\t' cookies.sqlite 'select * from moz_cookies'

The order of fields output from the above is:

	id name value host path expiry isSecure isHttpOnly lastAccessed

But cookies.txt needs to be in this format:

	domain flag path secure expiration name value

Translated to database values (field number in parens):

	host(4) "0" path(5) isSecure(7) expiry(6) name(2) value(3)

	(The flag field isn't stored in the database, so set it to 0)

So to get all cookies in the proper order, use:

	sqlite3 -separator $'\t' cookies.sqlite 'select host,"0",path,isSecure,expiry,name,value from moz_cookies'

Or just filter the raw format command through awk:

	awk -v OFS='\t' '{print $4,"0",$5,$7,$6,$2, $3}'

Once you have a cookies.txt, you can use it in wget with the --load-cookies option.