Using the cookies.sqlite from Firefox 3 in wget

jimbo1708 · 07-02-2008, 11:22 PM

Hey everyone,

I am trying to automate a periodic downloading script I have for a website. I want to use wget to grab the file, but I need to use my cookies from Firefox 3 to bypass the login. Wget allows you to specify a cookies.txt file when you invoke wget, but Firefox 3 does not use cookies.txt but rather cookies.sqlite. Does anyone know if a firefox extension is in the works to create a work around. Does anyone have any other suggestions?

Thanks,
- Jim

storkus · 07-03-2008, 04:18 AM

I would suggest taking this up in a FF3 or wget-specific group since this is such a specific question.

Mike

jimbo1708 · 07-03-2008, 06:02 PM

Quote:

Originally Posted by storkus

I would suggest taking this up in a FF3 or wget-specific group since this is such a specific question.

Mike

Do you know of any such communities.? I am use to using LQ as my main resource. With the release of FF3 so recently, I hope their is a solution.

- Jim

ogn.alice · 07-04-2008, 04:17 AM

Jim, I had the same problem. I found a solution from icewind in this blog post. It uses a python script to extract the data from cookies.sqlite.

The post is written in German, but a version of the script (heavily) commented in English is also provided. The link to it is labelled "vollständig dokumentierte Version des Scriptes" and appears just after the python code.

- Alice

jimbo1708 · 07-05-2008, 12:26 PM

Quote:

Originally Posted by ogn.alice

Jim, I had the same problem. I found a solution from icewind in this blog post. It uses a python script to extract the data from cookies.sqlite.

The post is written in German, but a version of the script (heavily) commented in English is also provided. The link to it is labelled "vollständig dokumentierte Version des Scriptes" and appears just after the python code.

- Alice

Thanks, the python script worked. It took me a little bit to figure out that i needed to pass in an argument to search for, but its working well for my purposes.

- Jim

ssokolow · 08-01-2008, 03:33 PM

For future reference, there's now an extension in development for this (experimental as of this posting) available at https://addons.mozilla.org/en-US/firefox/addon/8154

Ladadadada · 03-12-2009, 06:22 PM

If you have sqlite3 on your system (Mac OS X does by default and I'm sure most Linux distros do by default too) then you can just type this in the appropriate folder:

sqlite3 -separator ' ' cookies.sqlite 'select * from moz_cookies' > cookies.txt

(That's a tab-space in the quotes after -separator. If you need to type a tab-space on the command line, type a ctrl-v first.)

You can also use sqlite3 to edit and selectively delete cookies if you know a little bit of SQL.

sandhawke · 03-25-2009, 12:13 AM

Quote:

Originally Posted by Ladadadada

If you have sqlite3 on your system (Mac OS X does by default and I'm sure most Linux distros do by default too) then you can just type this in the appropriate folder:

sqlite3 -separator ' ' cookies.sqlite 'select * from moz_cookies' > cookies.txt

(That's a tab-space in the quotes after -separator. If you need to type a tab-space on the command line, type a ctrl-v first.)

You can also use sqlite3 to edit and selectively delete cookies if you know a little bit of SQL.

That didn't work for me, but the python script did. On my system, the order of the columns in the sqlite database is wrong; maybe mozilla changed it.

The schema for me (running 3.0.7) is:

Code:

    CREATE TABLE moz_cookies (id INTEGER PRIMARY KEY, name TEXT, value TEXT, host TEXT, path TEXT,expiry INTEGER, lastAccessed INTEGER, isSecure INTEGER, isHttpOnly INTEGER);

This schema also has isSecure and isHttpOnly as integers instead of "TRUE"/"FALSE". I don't know how to convert those on output in sqlite. For my app, I just hard-coded them, and this worked:

Code:

   sqlite3 -separator '    ' $HOME/.mozilla/firefox/$PROFILE.default/cookies.sqlite 'select host, "TRUE", path, "FALSE", expiry, name, value from moz_cookies' > cookies.txt

(Again, that separator is a tab character.)

koyeung · 05-25-2009, 03:26 AM

you may try this script: (passing $HOME/.mozilla/firefox/$PROFILE.default/cookies.sqlite as the 1st parameter)

Quote:

#!/bin/bash
#

sqlite3 $1 <<EOF
.mode tabs
.header off
select host as domain,
case substr(host,1,1)='.' when 0 then 'FALSE' else 'TRUE' end as flag,
path,
case isSecure when 0 then 'FALSE' else 'TRUE' end as secure,
expiry as expiration, name, value from moz_cookies;

EOF

allasso · 08-11-2009, 10:04 PM

I tried the python script, but get this message:

Traceback (most recent call last):
File "./exp_ff_cky.py", line 21, in ?
import sqlite3 as db
ImportError: No module named sqlite3

sqlite3 is installed on my computer...

???

Wim Sturkenboom · 08-12-2009, 01:16 AM

You probably have to install a python module (or whatever it is called) to support sqlite3 in python.

http://www.sqlite.org/cvstrac/wiki?p=SqliteWrappers ; search for python

ikarib · 03-14-2011, 04:19 AM

Use this statement

Code:

echo ".mode tabs
select host, case when host glob '.*' then 'TRUE' else 'FALSE' end, path,
case when isSecure then 'TRUE' else 'FALSE' end, expiry, name, value
from moz_cookies;" | sqlite3 ~/.mozilla/firefox/*.default/cookies.sqlite

cooltra · 10-23-2012, 06:29 AM

Quote:

Originally Posted by ikarib

Use this statement

Code:

echo ".mode tabs
select host, case when host glob '.*' then 'TRUE' else 'FALSE' end, path,
case when isSecure then 'TRUE' else 'FALSE' end, expiry, name, value
from moz_cookies;" | sqlite3 ~/.mozilla/firefox/*.default/cookies.sqlite

I get this Err:

Code:

Error: near line 2: file is encrypted or is not a database

?

koyeung · 10-24-2012, 07:42 AM

you need to locate the cookies.sqlite properly first and replace "~/.mozilla/firefox/*.default/cookies.sqlite" by the actual path to the file

cooltra · 10-25-2012, 01:35 AM

Quote:

you need to locate the cookies.sqlite properly first and replace "~/.mozilla/firefox/*.default/cookies.sqlite" by the actual path to the file

I did, but that error again:

Code:

cool@TRA:~$ echo ".mode tabs
> select host, case when host glob '.*' then 'TRUE' else 'FALSE' end, path,
> case when isSecure then 'TRUE' else 'FALSE' end, expiry, name, value
> from moz_cookies;" | sqlite3 /home/cool/.mozilla/firefox/cyote601.default/cookies.sqlite

Error: near line 2: file is encrypted or is not a database