LinuxQuestions.org
Download your favorite Linux distribution at LQ ISO.
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Non-*NIX Forums > General
User Name
Password
General This forum is for non-technical general discussion which can include both Linux and non-Linux topics. Have fun!

Notices


Reply
  Search this Thread
Old 02-01-2021, 04:22 AM   #1306
business_kid
LQ Guru
 
Registered: Jan 2006
Location: Ireland
Distribution: Slackware, Slarm64 & Android
Posts: 16,304

Rep: Reputation: 2324Reputation: 2324Reputation: 2324Reputation: 2324Reputation: 2324Reputation: 2324Reputation: 2324Reputation: 2324Reputation: 2324Reputation: 2324Reputation: 2324

Very good, teckk. [Post #1303]

You got it - I didn't.
Code:
ERROR: Unable to download webpage: HTTP Error 404: Not Found (caused by HTTPError());
It may be a dns issue here. I'll investigate.
 
Old 02-01-2021, 08:41 AM   #1307
teckk
LQ Guru
 
Registered: Oct 2004
Distribution: Arch
Posts: 5,138
Blog Entries: 6

Rep: Reputation: 1827Reputation: 1827Reputation: 1827Reputation: 1827Reputation: 1827Reputation: 1827Reputation: 1827Reputation: 1827Reputation: 1827Reputation: 1827Reputation: 1827
@business_kid

You can't wait 24 hours on those cloud server generated virtual urls's. They go away...

How about this?
Code:
https://storage.googleapis.com/13462196017448900c9d/81d2d/19413521aed43b8368a10404237700cd.mp4

wget --spider https://storage.googleapis.com/13462196017448900c9d/81d2d/19413521aed43b8368a10404237700cd.mp4
Spider mode enabled. Check if remote file exists.
--2021-02-01 08:34:52--  https://storage.googleapis.com/13462196017448900c9d/81d2d/19413521aed43b8368a10404237700cd.mp4
Loaded CA certificate '/etc/ssl/certs/ca-certificates.crt'
Resolving storage.googleapis.com (storage.googleapis.com)... 172.217.4.208, 172.217.4.80, 172.217.4.240, ...
Connecting to storage.googleapis.com (storage.googleapis.com)|172.217.4.208|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 983968326 (938M) [video/mp4]
Here they are again:
Code:
a="https://nnor.mcloud2.to/b36a0bea25a39c0689ab919a3614fed30\
f242c3b75a9ecc22a9f0a6cfe1af8a005a7d6a7a619b6a56925557b7c\
32fee24bb65309f0be82d48df406eded5d87ff5c998fcd5df7d04f6554\
30aa61b22eb81b6ae1f3c8378d776ed87b3baba4464a13dbd314fc43a2\
26e318b74761c84016/m/hls/720/720.m3u8"

b="https://dwqlq.mcloud2.to/f3924d7c38a34f0b892a671d845685c96fe\
5a302557cf22b53e936982d5d5924644856f117f8cda12b11d5c53e3ebf3\
159626ffa477989c97dc2219b8d6015b2ea57154566d7918a63ec1d8633c\
da352293a911e6a253ccc9ef8fae884a4e36804d2d8d6fc12beb8f83c1b6\
d597ac43d/m/hls/720/720.m3u8"

c="https://mmav.mcloud2.to/e7ce53f0c4f342fd6779f5eda7e59bdd7fb32\
b71e6f92397e677cb74af135548f38e52c754ccb09f8c13bd765c3b95f2b0\
c30eb705e0c24eeae6b42e1bba816d0dc65b9e9221af32de6575472be0f55\
f4d56f57c714e91c0d90182d5cc23e09db42c7d60db57ca705fec1a529c1a\
0b49/m/hls/720/720.m3u8"
Code:
youtube-dl -f 0 "$a" -o Vera1_1.mp4
#Ctrl+C to stop, I don't want it all

ffprobe Vera1_1.mp4.part
...
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'Vera1_1.mp4.part':
  Metadata:
    major_brand     : isom
    minor_version   : 512
    compatible_brands: isomiso2avc1mp41
    encoder         : Lavf58.45.100
  Duration: 00:00:18.71, start: 0.000000, bitrate: 508 kb/s
    Stream #0:0(und): Video: h264 (High) (avc1 / 0x31637661), yuv420p, 1280x718 [SAR 3493:3506 DAR 638737:359625], 377 kb/s, 24 fps, 24 tbr, 90k tbn, 48 tbc (default)
    Metadata:
      handler_name    : VideoHandler
    Stream #0:1(und): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, stereo, fltp, 128 kb/s (default)
    Metadata:
      handler_name    : SoundHandler

Last edited by teckk; 02-01-2021 at 08:42 AM.
 
Old 02-01-2021, 11:26 AM   #1308
business_kid
LQ Guru
 
Registered: Jan 2006
Location: Ireland
Distribution: Slackware, Slarm64 & Android
Posts: 16,304

Rep: Reputation: 2324Reputation: 2324Reputation: 2324Reputation: 2324Reputation: 2324Reputation: 2324Reputation: 2324Reputation: 2324Reputation: 2324Reputation: 2324Reputation: 2324
Quote:
Originally Posted by teckk View Post
@business_kid

You can't wait 24 hours on those cloud server generated virtual urls's. They go away...
I DIDN'T! I'm 5-8 hours ahead of you (direct on UTC & GMT, methinks) so the earliest you could have answered me was while I was sipping wine with my dear lady, and grabbed them 1st thing this morning, 12 hours or so.

Quote:
Originally Posted by teckk View Post
That one was good.

$a, $b, & $c give error 404s. You win a lot, teckk, but you didn't win those. Thanks for trying.

EDIT: I checked them with the wget --spider trick, and they throw
Quote:
Remote file does not exist -- broken link!!!

Last edited by business_kid; 02-01-2021 at 11:29 AM.
 
Old 02-01-2021, 11:33 AM   #1309
teckk
LQ Guru
 
Registered: Oct 2004
Distribution: Arch
Posts: 5,138
Blog Entries: 6

Rep: Reputation: 1827Reputation: 1827Reputation: 1827Reputation: 1827Reputation: 1827Reputation: 1827Reputation: 1827Reputation: 1827Reputation: 1827Reputation: 1827Reputation: 1827
Would someone who lives in continental Europe test this. That server is in France.

Code:
a="https://nnor.mcloud2.to/b36a0bea25a39c0689ab919a3614fed30\
f242c3b75a9ecc22a9f0a6cfe1af8a005a7d6a7a619b6a56925557b7c\
32fee24bb65309f0be82d48df406eded5d87ff5c998fcd5df7d04f6554\
30aa61b22eb81b6ae1f3c8378d776ed87b3baba4464a13dbd314fc43a2\
26e318b74761c84016/m/hls/720/720.m3u8"

curl "$a"
Should get something that ends in
Code:
1778.ts
#EXTINF:3.000000,
1779.ts
#EXTINF:0.583333,
1780.ts
#EXT-X-ENDLIST
Thank you.
 
Old 02-01-2021, 12:02 PM   #1310
business_kid
LQ Guru
 
Registered: Jan 2006
Location: Ireland
Distribution: Slackware, Slarm64 & Android
Posts: 16,304

Rep: Reputation: 2324Reputation: 2324Reputation: 2324Reputation: 2324Reputation: 2324Reputation: 2324Reputation: 2324Reputation: 2324Reputation: 2324Reputation: 2324Reputation: 2324
From Ireland, I get
Code:
bash-5.0$ a="https://nnor.mcloud2.to/b36a0bea25a39c0689ab919a3614fed30\
> f242c3b75a9ecc22a9f0a6cfe1af8a005a7d6a7a619b6a56925557b7c\
> 32fee24bb65309f0be82d48df406eded5d87ff5c998fcd5df7d04f6554\
> 30aa61b22eb81b6ae1f3c8378d776ed87b3baba4464a13dbd314fc43a2\
> 26e318b74761c84016/m/hls/720/720.m3u8"
bash-5.0$ 
bash-5.0$ curl "$a"
<html>
<head><title>404 Not Found</title></head>
<body>
<center><h1>404 Not Found</h1></center>
<hr><center>openresty</center>
</body>
</html>
bash-5.0$
I have a son with a Mac in Barcelona. I'll email him and have word back tmw.
 
Old 02-01-2021, 12:56 PM   #1311
business_kid
LQ Guru
 
Registered: Jan 2006
Location: Ireland
Distribution: Slackware, Slarm64 & Android
Posts: 16,304

Rep: Reputation: 2324Reputation: 2324Reputation: 2324Reputation: 2324Reputation: 2324Reputation: 2324Reputation: 2324Reputation: 2324Reputation: 2324Reputation: 2324Reputation: 2324
My son in Spain just got back. He gets 404s. There's zero chance of that being geo ip blocked, as there's language overlap along the Spanish/French border. There's traditionally French people in what is actually Spain, and vice-versa.
 
Old 02-01-2021, 12:57 PM   #1312
teckk
LQ Guru
 
Registered: Oct 2004
Distribution: Arch
Posts: 5,138
Blog Entries: 6

Rep: Reputation: 1827Reputation: 1827Reputation: 1827Reputation: 1827Reputation: 1827Reputation: 1827Reputation: 1827Reputation: 1827Reputation: 1827Reputation: 1827Reputation: 1827
Ok, thanks for that.
 
Old 02-01-2021, 02:42 PM   #1313
ondoho
LQ Addict
 
Registered: Dec 2013
Posts: 19,872
Blog Entries: 12

Rep: Reputation: 6053Reputation: 6053Reputation: 6053Reputation: 6053Reputation: 6053Reputation: 6053Reputation: 6053Reputation: 6053Reputation: 6053Reputation: 6053Reputation: 6053
^ I got the same 404 page (Finland).

Quote:
Originally Posted by business_kid View Post
Is there a technique for scraping the url? Does it require a VPN? There must be a technique, because once I pointed you at an RTE show, you were able to scrape a cloud url? I would like to be able to explore BBC, ITV,(geo-ip blocked) and Virgin Media (50/50 ads & program, even online).
Definitely play more with youtube-dl.
Then, those PBS films I cannot access with youtube-dl through their webpage url, although they should be supported, but those direct playlist links teckk provides work.

Try pressing F12 in your browser, it should open the Web Inspector. Takes a while to get through, but it often helps to get at "hidden" media URLs.
 
Old 02-01-2021, 03:26 PM   #1314
business_kid
LQ Guru
 
Registered: Jan 2006
Location: Ireland
Distribution: Slackware, Slarm64 & Android
Posts: 16,304

Rep: Reputation: 2324Reputation: 2324Reputation: 2324Reputation: 2324Reputation: 2324Reputation: 2324Reputation: 2324Reputation: 2324Reputation: 2324Reputation: 2324Reputation: 2324
Quote:
Originally Posted by ondoho
Try pressing F12 in your browser, it should open the Web Inspector. Takes a while to get through, but it often helps to get at "hidden" media URLs.
Good one, and I assure you I will. Palemoon, the firefox GPL fork, also has the F12, and that's my preferred choice of browser. Palemoon is not owned by anyone (Yet).
 
Old 02-01-2021, 04:22 PM   #1315
igadoter
Senior Member
 
Registered: Sep 2006
Location: wroclaw, poland
Distribution: many, primary Slackware
Posts: 2,717
Blog Entries: 1

Rep: Reputation: 625Reputation: 625Reputation: 625Reputation: 625Reputation: 625Reputation: 625
Some nice movie to watch with Naomi Watts, what do you suggest? She has kind of different pronunciation. Can't understand what she says. But sounds good.
 
Old 02-02-2021, 11:56 AM   #1316
teckk
LQ Guru
 
Registered: Oct 2004
Distribution: Arch
Posts: 5,138
Blog Entries: 6

Rep: Reputation: 1827Reputation: 1827Reputation: 1827Reputation: 1827Reputation: 1827Reputation: 1827Reputation: 1827Reputation: 1827Reputation: 1827Reputation: 1827Reputation: 1827
There are so may full episodes of shows on utube, it's a tv channel.

Nicholas and Alexandra
https://m.youtube.com/watch?v=BwofhKnA9PI
https://m.youtube.com/watch?v=DAd_roiMDY0

Black death
https://m.youtube.com/watch?v=WfRJEm96Lgo

King Arthur
https://m.youtube.com/watch?v=1ywMge_E1ik

Lusitania
https://m.youtube.com/watch?v=zWKxWR7rehw

The B36 Bomber
https://m.youtube.com/watch?v=5NvnbpJeHrE

Roman Dilemma
https://m.youtube.com/watch?v=5KvUtmoS3CI

Julius Cesar
https://m.youtube.com/watch?v=pC8JB1bsu5c

Titus
https://m.youtube.com/watch?v=G0SqKWx14TE

Trajan
https://m.youtube.com/watch?v=G0SqKWx14TE

Henry VI
https://m.youtube.com/watch?v=go98UsxbbJg

Elizabeth I Music
https://m.youtube.com/watch?v=VKxEbA6Lsd0

Stalin's Spys
https://m.youtube.com/watch?v=jxtyFW4MBz0

Radar
https://m.youtube.com/watch?v=G0SqKWx14TE

Jack the ripper
https://m.youtube.com/watch?v=G0SqKWx14TE

Princess Dianna
https://m.youtube.com/watch?v=G0SqKWx14TE

British witches
https://m.youtube.com/watch?v=g_DE2riKKhw

King ruined
https://m.youtube.com/watch?v=G0SqKWx14TE

Baby Stealers
https://m.youtube.com/watch?v=7ix5jbCmiDU

Prussia
https://m.youtube.com/watch?v=vBu6A0CcXdk

Spain
https://m.youtube.com/watch?v=Vr1PaqKMrMc

Corfu
https://m.youtube.com/watch?v=fGn7cvhH-vc

Patton
https://m.youtube.com/watch?v=FbV8Rfiq1Ko

Sherpa
https://m.youtube.com/watch?v=wENjJ8g_uB8

Ardverikie Estate
https://m.youtube.com/watch?v=xzs9GfzS7No

Inverness
https://m.youtube.com/watch?v=qRNjaZuJUlI
https://m.youtube.com/watch?v=YHk_qySj0F8

Culloden
https://m.youtube.com/watch?v=wIDW62wmU04
https://m.youtube.com/watch?v=-iR9aJCIq_k

War that changed world
https://m.youtube.com/watch?v=1Wb6P8lI8xY

Impossible peace
https://m.youtube.com/watch?v=uzD1wOrcQNI

Africa rising
https://m.youtube.com/watch?v=RJNJT0kD2pg

Aryan Brotherhood
https://m.youtube.com/watch?v=TIFpTzdAbwI

Operation Ghost
https://m.youtube.com/watch?v=t7olH4BmOFo

Triumph of the Turbo
https://m.youtube.com/watch?v=9SmNGGligD0

Solar system
https://m.youtube.com/watch?v=pQ9VBLLprpo

Roman hell
https://m.youtube.com/watch?v=HTQZreirbew

1000 AD
https://m.youtube.com/watch?v=HapGfrGR_gE

Great history quiz
https://m.youtube.com/watch?v=XkSq6tArP9o

Brian Greene
(Particle Physics, Quantum mechanics, Dark matter, Gravity, Quantum entanglement, Higgs boson, etc)
https://m.youtube.com/watch?v=G0SqKWx14TE
https://m.youtube.com/watch?v=CKJuC5CUMgU
https://m.youtube.com/watch?v=7obuj1OHt2c
https://m.youtube.com/watch?v=9gAcHKraVWE
https://m.youtube.com/watch?v=xk48z8N-sl0
https://m.youtube.com/watch?v=7oCQuvhQY6o
https://m.youtube.com/watch?v=pMXSKt9g1TE
https://m.youtube.com/watch?v=GmXB7IqbM1o
https://m.youtube.com/watch?v=lcsLMvNTGeY
https://m.youtube.com/watch?v=GfRJZbsywPQ

Last edited by teckk; 02-02-2021 at 11:57 AM.
 
Old 02-03-2021, 12:45 AM   #1317
ondoho
LQ Addict
 
Registered: Dec 2013
Posts: 19,872
Blog Entries: 12

Rep: Reputation: 6053Reputation: 6053Reputation: 6053Reputation: 6053Reputation: 6053Reputation: 6053Reputation: 6053Reputation: 6053Reputation: 6053Reputation: 6053Reputation: 6053
Quote:
Originally Posted by teckk View Post
Frontline Trump's American Carnage
https://www.pbs.org/video/trumps-ame...arnage-cgbssm/
Code:
https://ga.video.cdn.pbs.org/videos/frontline/63b48771-2c85-4f66-84a5-a2aa8f239932/2000216328/hd-16x9-mezzanine-1080p/00003910-hls-16x9-1080p.m3u8
Thank you , I was looking for something like that - a critical summary of Orange Baby's presidency, a description of the slope that led to the final showoff (which was all too predictable to those that paid attention in the years before).

Quote:
Originally Posted by business_kid View Post
Palemoon is not owned by anyone
That's debatable on so many levels... but I won't.
 
Old 02-04-2021, 07:08 AM   #1318
teckk
LQ Guru
 
Registered: Oct 2004
Distribution: Arch
Posts: 5,138
Blog Entries: 6

Rep: Reputation: 1827Reputation: 1827Reputation: 1827Reputation: 1827Reputation: 1827Reputation: 1827Reputation: 1827Reputation: 1827Reputation: 1827Reputation: 1827Reputation: 1827
Nature Pumas: Legends of the Ice Mountains
https://www.pbs.org/video/pumas-lege...ntains-xkdxvc/
Code:
#Make a user agent string
agent="Mozilla/5.0 (Windows NT 10.1; Win64; x64; rv:82.0) Gecko/20100101 Firefox/82.0"

#Master playlist reported from web server
https://ga.video.cdn.pbs.org/videos/nature/749ddc93-136b-4ead-9583-\
e53859daa734/2000216154/hd-16x9-mezzanine-1080p/naat3903-hls-16x9-1080p.m3u8

#Example - 768x432 stream in master playlist
https://ga.video.cdn.pbs.org/videos/nature/749ddc93-136b-4ead-9583-\
e53859daa734/2000216154/hd-16x9-mezzanine-1080p/naat3903-hls-16x9-1080p-432p-1100k.m3u8

#curl from 768x432 playlist
curl -A "$agent" https://ga.video.cdn.pbs.org/videos/nature/749ddc93-136b-4ead-9583-\
e53859daa734/2000216154/hd-16x9-mezzanine-1080p/naat3903-hls-16x9-1080p-432p-1100k_[00000-00532].ts -o - >> Pumas.ts

#wget from 768x432 playlist
for i in {00000..00532}; do
wget -U "$agent" https://ga.video.cdn.pbs.org/videos/nature/749ddc93-136b-4ead-9583-\
e53859daa734/2000216154/hd-16x9-mezzanine-1080p/naat3903-hls-16x9-1080p-432p-1100k_"$i".ts -O - >> Pumas.ts
done

#ffmpeg manually on transport stream file
ffmpeg -i Puma.ts -c:a copy -c:v copy Puma.mp4

###or

#youtube-dl from 768x432 playlist in Master playlist, found with youtube-dl -F
youtube-dl --user-agent "$agent" -f 1267 https://ga.video.cdn.pbs.org/videos/nature/749ddc93-136b-4ead-9583-\
e53859daa734/2000216154/hd-16x9-mezzanine-1080p/naat3903-hls-16x9-1080p.m3u8 -o Puma.mp4
Can't show how that's done any clearer, if you are a newbie looking at this.

NOVA Beyond the Elements: Reactions
https://www.pbs.org/video/beyond-the...ctions-rxepnw/
Code:
https://ga.video.cdn.pbs.org/videos/nova/8415ae00-9d68-4000-877b-\
622c01be4ff8/2000217398/hd-16x9-mezzanine-1080p/nova4717_r3-hls-16x9-1080p.m3u8
Europe's New Wild The Missing Lynx
https://www.pbs.org/video/the-missing-lynx-8iphcn/
Code:
https://ga.video.cdn.pbs.org/videos/europes-new-wild/d7d497c0-32a5-\
4687-bb74-b61d058a8496/2000216891/hd-16x9-mezzanine-1080p/eunw101-hls-16x9-1080p.m3u8
See:
man curl
man wget
man youtube-dl
man ffmpeg
 
Old 02-04-2021, 07:25 AM   #1319
jamison20000e
Senior Member
 
Registered: Nov 2005
Location: ...uncanny valley... infinity\1975; (randomly born:) Milwaukee, WI, US( + travel,) Earth&Mars (I wish,) END BORDER$!◣◢┌∩┐ Fe26-E,e...
Distribution: any GPL that work on freest-HW; has been KDE, CLI, Novena-SBC but open.. http://goo.gl/NqgqJx &c ;-)
Posts: 4,888
Blog Entries: 2

Rep: Reputation: 1567Reputation: 1567Reputation: 1567Reputation: 1567Reputation: 1567Reputation: 1567Reputation: 1567Reputation: 1567Reputation: 1567Reputation: 1567Reputation: 1567
Quote:
Originally Posted by rokytnji View Post
Not like they needed to kill off dwarfs and hide it...

Now it's just groups of opinions or in the way!

tho (opinions) shall not learn

Lions and tigers and bears, evolution needs help if it scares!

Last edited by jamison20000e; 02-04-2021 at 07:48 AM.
 
Old 02-04-2021, 08:42 AM   #1320
business_kid
LQ Guru
 
Registered: Jan 2006
Location: Ireland
Distribution: Slackware, Slarm64 & Android
Posts: 16,304

Rep: Reputation: 2324Reputation: 2324Reputation: 2324Reputation: 2324Reputation: 2324Reputation: 2324Reputation: 2324Reputation: 2324Reputation: 2324Reputation: 2324Reputation: 2324
On those links, is there a natty way around this short of Tor?
Code:
bash-5.0$ youtube-dl -o Roman_Dilemma https://m.youtube.com/watch?v=5KvUtmoS3CI
[youtube] 5KvUtmoS3CI: Downloading webpage
ERROR: The uploader has not made this video available in your country
You don't get this often on youtube, to be fair.

EDIT: A lot of those youtube links don't lead to what you've titled them on this side of the pond. The Roman_Dilemma is 12 minutes on the life of Emperor Titus.

Last edited by business_kid; 02-04-2021 at 09:35 AM.
 
  


Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
Best Way to watch a movie? Dutch72 General 3 10-16-2008 07:26 AM
Cannot watch DVD movie nerzack Linux - Hardware 2 03-08-2006 06:31 PM
how to watch movie by firefox lnthai2002 Linux - Software 1 03-25-2005 10:34 AM
how to watch movie online?? gk_linux Linux - Software 2 11-23-2003 06:31 AM

LinuxQuestions.org > Forums > Non-*NIX Forums > General

All times are GMT -5. The time now is 07:57 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration