i am looking for a firefox extension to (when turned on) save the contents of every URL it requests over every protOcol, especially HTTPS. doing this at a proxy server will just get encrypted content for HTTPS. i want to see it all in the clear as the browser gets it. it should name the files the same as the URL. it's like an infinite cache with clear naming.

i've tried to look through what mozilla.org has, but there are just way too many to check. i don't know what something like this would be called.

Will wget suffice for this? I have some familiarity with pulling files with wget but I am certain others have much more experience.

there's an extension called wget?

this needs to operate within Firefox so it can archive what i am browsing, when i turn it on. i also want to get timing info, like connection start, connection complete, request send, each request read, connection close, etc.

if HTTP proxies understand a browser asking for the proxy to make an HTTPS request, then an extension having Firefox pass HTTPS URLs to the proxy like it passes HTTP URLs, might be a way to go. i think it might be easier to get a proxy to do this. currently, Firefox passes HTTPS to a proxy as an encrypted connection forwarding request, making capture unworkable.

I do not think such a plugin exists. You can use Firefox's build-in network monitor to record the traffic but it does not save the webpages that you have visited.

If search Firefox extensions for "save web pages," you will find a number of choices. I have not used any of them.

wget is command line program that is normally included in Linux distros that can fetch remote content. See man wget for more.

i know about wget. i have a few scripts that use it. it can get the exposed files of an HTTP(S) server recursively. a couple of my scripts do that. but some websites have rules on certain files to limit their download unless a specific referrer is used (BTDT back in my ISP manager days). others have files with names generated by Javascript code (BTDT, too) so they are unlinked unless you run the Javascript.

i want to save whatever is sent, be that HTML, CSS, Javascript, image files, sound files, video segments, other extension i'm downloading, etc. if it has a crazy dynamic URL (another BTDT), then that becomes the path name. it will need to make directories as needed.

a version that saves into AWS S3 or an equivalent service would be great (it would solve a technical issue i foresee).

it looks like all this finds are extensions that can save the current web page as a single HTML file. i thought that kind of thing was already built in. whet i want should be simple enough if the right hooks are available. for every request of content by a URL, create any needed parent directories and open an output file with a name like the URL, in the designated directory. as content arrives, write a copy of it to that output file. that copy may begin with received headers.

if i could write extensions and implemented this, i'd include a way to handle repeat requests getting different content.