Browser of the Year

hydrurga · 03-06-2019, 02:59 PM

Quote:

Originally Posted by Reziac

Guessing these connections are mostly prefetch for FF's default homepage, with all its myriad news and advertising feeds. Would be interesting to know if its behavior differs if you set Home to about:blank before ever letting it see a network connection. Or if it matters if you disable cache.

For info, Teckk mentioned in their earlier post that they set Firefox to open with a blank page. I'm not sure that caching was included in the Mozilla page about turning off auto connections whose instructions Teckk followed, but prefetching was.

teckk · 03-06-2019, 03:19 PM

Quote:

There's a possibility that these are calls to Amazon Web Services or other CDN services.

If you can use this. I needed to find a list of them a while back.

Code:

#! /usr/bin/env python 

#Get AWS IP4 addresses

import requests

url = 'https://ip-ranges.amazonaws.com/ip-ranges.json'

def GetAmazon():
    ip_ranges = requests.get(url).json()['prefixes'] 
    
    amazon_ips = ([item['ip_prefix'] for item in ip_ranges 
                    if item["service"] == "AMAZON"]) 
                    
    ec2_ips = ([item['ip_prefix'] for item in ip_ranges 
                    if item["service"] == "EC2"]) 
                    
    amazon_ips_less_ec2 = [] 

    for ip in amazon_ips:
        if (ip not in ec2_ips) and (ip not in amazon_ips_less_ec2):
           amazon_ips_less_ec2.append(ip) 

    def ip_to_tuple(ip_str):
        ip = ip_str.split('/')[0]
        ip = ip.split('.')
        return tuple(map(int, ip))

    sorted_list = (sorted(amazon_ips_less_ec2, key=ip_to_tuple))

    for i in sorted_list:
        with open('amazon_ip.txt','a') as f:
            f.write((i)+ '\n')
    print ("Saved to amazon_ip.txt")
                
def main():
    GetAmazon()
    
if __name__ == "__main__":
    main()

ondoho · 03-07-2019, 01:07 PM

@teckk: a belated thank you from me, too!
that was very in-depth.

ondoho · 03-07-2019, 01:16 PM

Quote:

Originally Posted by hydrurga

http://forums.mozillazine.org/viewto...f=38&t=2929835

it seems to come down to this post in the end (same result on the google plus thread).

teckk · 03-07-2019, 01:53 PM

You're welcome. Glad that I could contribute something.

Everything connects to Amazon. I blocked the whole bunch a while back.
That's why I made that python script. But then half of the websites
would not work. Even PBS videos use them.

Work has a piece of hardware from AT&T that connects to the internet.
An arris bgw210-700. It is widely used across the US for fibre
customers. I tried to pick it apart to see how it works.

It has a little hidden web sever in it. That little web server takes
the last free IP address in your DHCP range and uses it for itself.
And it sits there and talks to Amazon and others all day. I made a script
to monitor it, posted it here:
https://bbs.archlinux.org/viewtopic....28996#p1828996

and then some firewall rules in the device itself to block anything to it
or from it. Here is a partial log of what that little web server tries to
send out. Unsolicited. 192.168.0.50 is the address that the device claimed
for itself. It's the last address in the DHCP range of IP's that I set it
up to have. You can change that range to something else, it will take the
last one.

Code:

2019-02-10T11:39:45.267567	192.168.0.50	52.35.178.59	TCP	Policy (filtersets, etc.)
2019-02-10T11:39:48.271627	192.168.0.50	52.35.178.59	TCP	Policy (filtersets, etc.)
2019-02-10T11:39:53.963748	192.168.0.50	69.164.202.202	UDP	Policy (filtersets, etc.)
2019-02-10T11:40:00.277873	192.168.0.50	52.88.149.42	TCP	Policy (filtersets, etc.)
2019-02-10T11:40:03.281927	192.168.0.50	52.88.149.42	TCP	Policy (filtersets, etc.)
2019-02-10T11:40:07.736024	192.168.0.50	35.164.160.198	TCP	Policy (filtersets, etc.)
2019-02-10T11:40:10.742081	192.168.0.50	35.164.160.198	TCP	Policy (filtersets, etc.)
2019-02-10T11:40:13.292125	192.168.0.50	52.32.208.31	TCP	Policy (filtersets, etc.)
2019-02-10T11:40:14.656154	192.168.0.50	54.202.198.148	TCP	Policy (filtersets, etc.)
2019-02-10T11:40:35.152569	192.168.0.50	52.42.41.123	TCP	Policy (filtersets, etc.)
2019-02-10T11:40:38.160633	192.168.0.50	52.42.41.123	TCP	Policy (filtersets, etc.)
2019-02-10T11:40:44.180748	192.168.0.50	52.42.41.123	TCP	Policy (filtersets, etc.)
2019-02-10T11:40:56.220988	192.168.0.50	52.42.41.123	TCP	Policy (filtersets, etc.)
2019-02-10T11:41:05.333172	192.168.0.50	52.35.178.59	TCP	Policy (filtersets, etc.)
2019-02-10T11:41:08.341240	192.168.0.50	52.35.178.59	TCP	Policy (filtersets, etc.)
2019-02-10T11:41:14.361351	192.168.0.50	52.35.178.59	TCP	Policy (filtersets, etc.)
2019-02-10T11:41:20.321479	192.168.0.50	54.200.170.21	TCP	Policy (filtersets, etc.)
2019-02-10T11:41:23.321534	192.168.0.50	54.200.170.21	TCP	Policy (filtersets, etc.)
2019-02-10T11:41:27.773618	192.168.0.50	52.88.149.42	TCP	Policy (filtersets, etc.)
2019-02-10T11:41:30.781684	192.168.0.50	52.88.149.42	TCP	Policy (filtersets, etc.)
2019-02-10T11:41:33.327746	192.168.0.50	52.27.31.241	TCP	Policy (filtersets, etc.)
2019-02-10T11:41:55.234170	192.168.0.50	52.42.41.123	TCP	Policy (filtersets, etc.)
2019-02-10T11:41:58.242241	192.168.0.50	52.42.41.123	TCP	Policy (filtersets, etc.)
2019-02-10T11:42:04.262378	192.168.0.50	52.42.41.123	TCP	Policy (filtersets, etc.)
2019-02-10T11:42:09.296442	192.168.0.50	200.89.75.198	UDP	Policy (filtersets, etc.)
2019-02-10T11:42:25.416782	192.168.0.50	35.164.160.198	TCP	Policy (filtersets, etc.)
2019-02-10T11:42:28.422845	192.168.0.50	35.164.160.198	TCP	Policy (filtersets, etc.)
2019-02-10T11:42:34.442954	192.168.0.50	35.164.160.198	TCP	Policy (filtersets, etc.)
2019-02-10T11:42:40.407082	192.168.0.50	52.35.178.59	TCP	Policy (filtersets, etc.)
2019-02-10T11:42:43.411144	192.168.0.50	52.35.178.59	TCP	Policy (filtersets, etc.)
2019-02-10T11:42:47.863227	192.168.0.50	52.42.7.58	    TCP	Policy (filtersets, etc.)
2019-02-10T11:42:50.871281	192.168.0.50	52.42.7.58	    TCP	Policy (filtersets, etc.)
2019-02-10T11:42:53.407345	192.168.0.50	52.32.208.31	TCP	Policy (filtersets, etc.)
2019-02-10T11:42:55.285373	192.168.0.50	52.88.149.42	TCP	Policy (filtersets, etc.)
2019-02-10T11:42:58.291444	192.168.0.50	52.88.149.42	TCP	Policy (filtersets, etc.)
2019-02-10T11:43:04.301553	192.168.0.50	52.88.149.42	TCP	Policy (filtersets, etc.)
2019-02-10T11:43:16.341795	192.168.0.50	52.88.149.42	TCP	Policy (filtersets, etc.)
2019-02-10T11:43:25.447983	192.168.0.50	52.42.7.58	    TCP	Policy (filtersets, etc.)
2019-02-10T11:43:28.452038	192.168.0.50	52.42.7.58	    TCP	Policy (filtersets, etc.)
2019-02-10T11:43:34.462163	192.168.0.50	52.42.7.58	    TCP	Policy (filtersets, etc.)
2019-02-10T11:43:39.468256	192.168.0.50	103.105.51.156	UDP	Policy (filtersets, etc.)
2019-02-10T11:43:43.452339	192.168.0.50	52.35.178.59	TCP	Policy (filtersets, etc.)
2019-02-10T11:43:47.912426	192.168.0.50	35.164.160.198	TCP	Policy (filtersets, etc.)
2019-02-10T11:43:50.920489	192.168.0.50	35.164.160.198	TCP	Policy (filtersets, etc.)
2019-02-10T11:43:53.462538	192.168.0.50	52.39.47.72	    TCP	Policy (filtersets, etc.)
2019-02-10T11:43:54.834581	192.168.0.50	54.202.198.148	TCP	Policy (filtersets, etc.)
2019-02-10T11:43:58.352633	192.168.0.50	52.27.31.241	TCP	Policy (filtersets, etc.)
2019-02-10T11:44:04.360755	192.168.0.50	52.27.31.241	TCP	Policy (filtersets, etc.)
2019-02-10T11:44:16.381011	192.168.0.50	52.27.31.241	TCP	Policy (filtersets, etc.)
2019-02-10T11:44:24.557143	192.168.0.50	66.228.48.38	UDP	Policy (filtersets, etc.)
2019-02-10T11:44:28.521234	192.168.0.50	35.164.160.198	TCP	Policy (filtersets, etc.)
2019-02-10T11:44:34.541369	192.168.0.50	35.164.160.198	TCP	Policy (filtersets, etc.)
2019-02-10T11:44:40.507489	192.168.0.50	50.112.165.103	TCP	Policy (filtersets, etc.)
2019-02-10T11:44:43.511546	192.168.0.50	50.112.165.103	TCP	Policy (filtersets, etc.)
2019-02-10T11:44:47.973662	192.168.0.50	52.39.47.72	    TCP	Policy (filtersets, etc.)
2019-02-10T11:44:50.981702	192.168.0.50	52.39.47.72	    TCP	Policy (filtersets, etc.)
2019-02-10T11:44:53.521744	192.168.0.50	54.200.170.21	TCP	Policy (filtersets, etc.)
2019-02-10T11:44:54.885786	192.168.0.50	54.202.198.148	TCP	Policy (filtersets, etc.)
2019-02-10T11:44:58.451839	192.168.0.50	34.211.59.64	TCP	Policy (filtersets, etc.)
2019-02-10T11:45:04.461964	192.168.0.50	34.211.59.64	TCP	Policy (filtersets, etc.)
2019-02-10T11:45:09.636062	192.168.0.50	193.104.228.123	UDP	Policy (filtersets, etc.)
2019-02-10T11:45:16.502201	192.168.0.50	34.211.59.64	TCP	Policy (filtersets, etc.)
2019-02-10T11:45:25.622389	192.168.0.50	34.212.244.47	TCP	Policy (filtersets, etc.)
2019-02-10T11:45:28.630448	192.168.0.50	34.212.244.47	TCP	Policy (filtersets, etc.)
2019-02-10T11:45:34.642571	192.168.0.50	34.212.244.47	TCP	Policy (filtersets, etc.)
2019-02-10T11:45:40.612683	192.168.0.50	34.213.218.20	TCP	Policy (filtersets, etc.)
2019-02-10T11:45:43.622743	192.168.0.50	34.213.218.20	TCP	Policy (filtersets, etc.)
2019-02-10T11:45:48.074839	192.168.0.50	34.215.202.194	TCP	Policy (filtersets, etc.)
2019-02-10T11:45:51.082890	192.168.0.50	34.215.202.194	TCP	Policy (filtersets, etc.)

That's when it is idle. Doing nothing. It's not responding to a page request.

Amazon is an advertising/data collection monster, has it's claws in everything. Used to be
that google was the monster. AT&T has partnered with them.

I also don't blame the Firefox devs for making money somehow. Just something that's
good to know.

Slackware_fan_Fred · 03-07-2019, 10:38 PM

So Firefox phones "home" to Amazon even without the Amazon Assistant?

ondoho · 03-08-2019, 12:35 PM

Quote:

Originally Posted by Slackware_fan_Fred

So Firefox phones "home" to Amazon even without the Amazon Assistant?

some of us clicked a few links and did some reading (it's all there in the last few posts) and the answer is quite different.
not sure there's a one word explanation, but if there is it's "captive portal detection".

kooth · 04-18-2019, 11:15 AM

Chrome