LinuxQuestions.org
Download your favorite Linux distribution at LQ ISO.
Go Back   LinuxQuestions.org > Forums > Non-*NIX Forums > Programming
User Name
Password
Programming This forum is for all programming questions.
The question does not have to be directly related to Linux and any language is fair game.

Notices


Reply
  Search this Thread
Old 10-04-2020, 05:36 AM   #1
pedropt
Member
 
Registered: Aug 2014
Distribution: Devuan
Posts: 292

Rep: Reputation: Disabled
Download Dropbox Webpage


Hello , i have benn trying with wget and lynx to view or download the entire webpage and somehow it appears empty .
Is there anyway to dump the webpage ?

example link with 3 wav files from windows
https://www.dropbox.com/sh/amaeuqdkb...oZikkUpda?dl=0

Not working
Code:
wget --no-check-cert -q --refer=http://google.com user-agent="Mozilla/61.0 Firefox/61.0.0" https://www.dropbox.com/sh/amaeuqdkb2sgddv/AACd9zfKF7PgGyPtoZikkUpda/ -O tmpfile
Code:
lynx -dump -listonly https://www.dropbox.com/sh/amaeuqdkb2sgddv/AACd9zfKF7PgGyPtoZikkUpda/
Any ideas ?
Note : Dont even think in writing here "Why dont you install the dropbox tool from their website".

Thank you
 
Old 10-04-2020, 11:21 AM   #2
bathory
LQ Guru
 
Registered: Jun 2004
Location: Piraeus
Distribution: Slackware
Posts: 12,793

Rep: Reputation: 1859Reputation: 1859Reputation: 1859Reputation: 1859Reputation: 1859Reputation: 1859Reputation: 1859Reputation: 1859Reputation: 1859Reputation: 1859Reputation: 1859
Hi,

Running the following will download a zip archive containing the 3 wav files:
Code:
curl https://www.dropbox.com/sh/amaeuqdkb2sgddv/AACd9zfKF7PgGyPtoZikkUpda -L -o file.zip
 
Old 10-04-2020, 11:24 AM   #3
pedropt
Member
 
Registered: Aug 2014
Distribution: Devuan
Posts: 292

Original Poster
Rep: Reputation: Disabled
The problem is that i want the webpage .
 
Old 10-04-2020, 11:25 AM   #4
SoftSprocket
Member
 
Registered: Nov 2014
Posts: 399

Rep: Reputation: Disabled
wget creates a file. If you inspect the head of the file you can see it's a zip file - rename with a .zip extension and unzip will open it. You get the wav files in the dropbox.

As for the webpage - you can use the developer tools for your browser and inspect it if you really want to unravel it.
 
Old 10-04-2020, 11:50 AM   #5
pedropt
Member
 
Registered: Aug 2014
Distribution: Devuan
Posts: 292

Original Poster
Rep: Reputation: Disabled
Quote:
Hello , i have benn trying with wget and lynx to view or download the entire webpage and somehow it appears empty .
Is there anyway to dump the webpage ?
Quote:
wget creates a file. If you inspect the head of the file you can see it's a zip file
You are missing the point here of the purpose of this thread .
And when i speak about lynx and wget then i am not speaking in graphic user interface but CLI or terminal , basically bash , and i posted on the programming thread , witch means i am looking for a solution over the terminal .
I am pretty aware that firefox does that , but what i am writing must be executed on a shell , so firefox is out of the question .
 
Old 10-04-2020, 11:53 AM   #6
sgosnell
Senior Member
 
Registered: Jan 2008
Location: Baja Oklahoma
Distribution: Debian Stable and Unstable
Posts: 1,945

Rep: Reputation: 536Reputation: 536Reputation: 536Reputation: 536Reputation: 536Reputation: 536
Have you looked at curl?

Last edited by sgosnell; 10-04-2020 at 11:55 AM.
 
Old 10-04-2020, 12:10 PM   #7
dugan
LQ Guru
 
Registered: Nov 2003
Location: Canada
Distribution: distro hopper
Posts: 9,929

Rep: Reputation: 4501Reputation: 4501Reputation: 4501Reputation: 4501Reputation: 4501Reputation: 4501Reputation: 4501Reputation: 4501Reputation: 4501Reputation: 4501Reputation: 4501
I was able to get a non-empty HTML response with HTTPie.

My command was literally just

Code:
http https://www.dropbox.com/sh/amaeuqdkb2sgddv/AACd9zfKF7PgGyPtoZikkUpda/

Last edited by dugan; 10-04-2020 at 12:12 PM.
 
1 members found this post helpful.
Old 10-04-2020, 12:22 PM   #8
pedropt
Member
 
Registered: Aug 2014
Distribution: Devuan
Posts: 292

Original Poster
Rep: Reputation: Disabled
Thank you Dugan , that was exactly what i was looking for .
 
Old 10-04-2020, 12:30 PM   #9
pedropt
Member
 
Registered: Aug 2014
Distribution: Devuan
Posts: 292

Original Poster
Rep: Reputation: Disabled
Forgot to mention that using dugan solution piping to a file will do the desired output like :

Code:
http https://www.dropbox.com/sh/amaeuqdkb2sgddv/AACd9zfKF7PgGyPtoZikkUpda/ > tmp.file
or using the switches from own tool like

Code:
http https://www.dropbox.com/sh/amaeuqdkb2sgddv/AACd9zfKF7PgGyPtoZikkUpda/ -o tmp.file
will do the desired trick requested .

And to grab all the links in case you need then just use this line :
Code:
grep -Eo "https?://\S+?\dl=0" tmp.file | sort | uniq

Last edited by pedropt; 10-04-2020 at 01:14 PM.
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
Dropbox - no "Dropbox -> Copy Dropbox Link" on right click in Nautilus Chris Watts Linux - Software 7 12-19-2020 01:34 PM
LXer: How to Install Dropbox and Dropbox-cli on Debian 10 LXer Syndicated Linux News 0 07-04-2020 09:21 PM
LXer: Dropbox To Stop Following Symlinks To Items Outside The Dropbox Folder LXer Syndicated Linux News 0 09-06-2019 02:32 AM
[SOLVED] New user problem with Dropbox and sudo relating to "Can't monitor Dropbox folder" error. globetrotterdk Slackware 9 03-22-2018 10:15 AM
webpage in webpage? kalleanka Programming 6 06-07-2009 05:13 PM

LinuxQuestions.org > Forums > Non-*NIX Forums > Programming

All times are GMT -5. The time now is 12:36 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration