LinuxQuestions.org
Share your knowledge at the LQ Wiki.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Newbie
User Name
Password
Linux - Newbie This Linux forum is for members that are new to Linux.
Just starting out and have a question? If it is not in the man pages or the how-to's this is the place!

Notices


Reply
  Search this Thread
Old 09-16-2015, 02:40 AM   #1
ulto
Member
 
Registered: Apr 2004
Posts: 52

Rep: Reputation: 1
Wget or Curl Issue


I am trying to download a tar.gz file using either wget or curl. However, the direct file is behind a URL.
https://pm.puppetlabs.com/cgi-bin/do..._64&ver=latest

Therefore when the options I have tried it only downloads about 112k worth of data rather then the 300MB it should download.
Any hints. I know this should be straightforward but am I missing something?
 
Old 09-16-2015, 07:51 AM   #2
grail
LQ Guru
 
Registered: Sep 2009
Location: Perth
Distribution: Manjaro
Posts: 9,245

Rep: Reputation: 2684Reputation: 2684Reputation: 2684Reputation: 2684Reputation: 2684Reputation: 2684Reputation: 2684Reputation: 2684Reputation: 2684Reputation: 2684Reputation: 2684
Please show the command you are using?
 
Old 09-16-2015, 08:33 AM   #3
schneidz
LQ Guru
 
Registered: May 2005
Location: boston, usa
Distribution: fc-15/ fc-20-live-usb/ aix
Posts: 5,027

Rep: Reputation: 845Reputation: 845Reputation: 845Reputation: 845Reputation: 845Reputation: 845Reputation: 845
this worx for me:
Code:
[schneidz@hyper ~]$ wget 'https://pm.puppetlabs.com/cgi-bin/download.cgi?dist=el&rel=6&arch=x86_64&ver=latest'
--2015-09-16 08:30:23--  https://pm.puppetlabs.com/cgi-bin/download.cgi?dist=el&rel=6&arch=x86_64&ver=latest
Resolving pm.puppetlabs.com (pm.puppetlabs.com)... 192.155.89.90, 2600:3c03::f03c:91ff:fedb:6b1d
Connecting to pm.puppetlabs.com (pm.puppetlabs.com)|192.155.89.90|:443... connected.
HTTP request sent, awaiting response... 302 Moved
Location: https://pm.puppetlabs.com/puppet-enterprise/2015.2.0/puppet-enterprise-2015.2.0-el-6-x86_64.tar.gz [following]
--2015-09-16 08:30:23--  https://pm.puppetlabs.com/puppet-enterprise/2015.2.0/puppet-enterprise-2015.2.0-el-6-x86_64.tar.gz
Reusing existing connection to pm.puppetlabs.com:443.
HTTP request sent, awaiting response... 302 Found
Location: https://s3.amazonaws.com/pe-builds/released/2015.2.0/puppet-enterprise-2015.2.0-el-6-x86_64.tar.gz [following]
--2015-09-16 08:30:23--  https://s3.amazonaws.com/pe-builds/released/2015.2.0/puppet-enterprise-2015.2.0-el-6-x86_64.tar.gz
Resolving s3.amazonaws.com (s3.amazonaws.com)... 54.231.81.187
Connecting to s3.amazonaws.com (s3.amazonaws.com)|54.231.81.187|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 317684759 (303M) [application/x-tar]
Saving to: download.cgi?dist=el&rel=6&arch=x86_64&ver=latest

download.cgi?dist=el&rel=6&a 100[===============================================>] 302.97M  1.46MB/s   in 3m 11s 

2015-09-16 08:33:35 (1.59 MB/s) - download.cgi?dist=el&rel=6&arch=x86_64&ver=latest saved [317684759/317684759]
 
2 members found this post helpful.
Old 09-17-2015, 02:12 AM   #4
ulto
Member
 
Registered: Apr 2004
Posts: 52

Original Poster
Rep: Reputation: 1
Yes, with the' ' it works for me as well.
Thanks
 
Old 09-17-2015, 08:14 AM   #5
grail
LQ Guru
 
Registered: Sep 2009
Location: Perth
Distribution: Manjaro
Posts: 9,245

Rep: Reputation: 2684Reputation: 2684Reputation: 2684Reputation: 2684Reputation: 2684Reputation: 2684Reputation: 2684Reputation: 2684Reputation: 2684Reputation: 2684Reputation: 2684
Please remember to mark as solved once you have a solution.
 
Old 09-17-2015, 08:21 AM   #6
jpollard
Senior Member
 
Registered: Dec 2012
Location: Washington DC area
Distribution: Fedora, CentOS, Slackware
Posts: 4,602

Rep: Reputation: 1241Reputation: 1241Reputation: 1241Reputation: 1241Reputation: 1241Reputation: 1241Reputation: 1241Reputation: 1241Reputation: 1241
The "Why it works" is because of the special characters used in the URL: the ? and & characters. the ? is the wildcard substitution and & for putting the command into the background.
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
Cant Download the file using wget or curl apirani Linux - Newbie 3 02-18-2014 12:35 AM
How to send sms using wget or curl ? bobbera Linux - General 5 01-15-2012 12:14 PM
wget/curl problems PLS HELP tommmmmm Linux - Software 0 08-19-2005 04:58 AM
YOU for SUSE 9.1 - curl or wget? djc SUSE / openSUSE 1 02-15-2005 04:26 PM
Wget and cURL can't connect umberleigh Linux - Newbie 0 09-21-2004 06:59 PM


All times are GMT -5. The time now is 10:27 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration