Read html source when browsing from a python script

KlaasJan · 09-13-2020, 05:16 AM

In a python script i start the midori browser with subprocess:
subprocess.run(['midori',someurl])
That shows the correct web page.
But now I want to read/use in that same script the data in the source of that web page.
Is That possible ? How ?

berndbausch · 09-13-2020, 06:19 AM

One method to read the web page is urllib. Here is a tutorial (I just casually googled it without trying or even reading in-depth): https://muddoo.com/tutorials/how-to-...-using-python/.

You can also parse and analyse the web page. I believe beautifulsoup is the de-facto standard library for that.

dugan · 09-13-2020, 02:55 PM

Selenium, PhantomJS, or both.