LinuxQuestions.org
Download your favorite Linux distribution at LQ ISO.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Software
User Name
Password
Linux - Software This forum is for Software issues.
Having a problem installing a new program? Want to know which application is best for the job? Post your question in this forum.

Notices


Reply
  Search this Thread
Old 04-21-2013, 04:55 AM   #1
Si14
LQ Newbie
 
Registered: Mar 2013
Posts: 14

Rep: Reputation: Disabled
wget: download if file size does not match any file in folder


I have the download link to pdf files, stored in links.txt

Some of the pdf files have same content (with different names, but same size). I do not want to download same content several times. That means I want to download all the files that have unique file size.
Is it possible to do this with wget?

For example, 1.pdf is downloaded. Next, 2.pdf is checked for the size, if there is any file in the folder which is the same size of 2.pdf, then 2.pdf is not downloaded. Otherwise, it is downloaded to the folder, and 3.pdf is checked and so on.

Please let me know if you have any suggestions.

Thank you for your help.
 
Old 04-21-2013, 07:00 AM   #2
pan64
LQ Addict
 
Registered: Mar 2012
Location: Hungary
Distribution: debian/ubuntu/suse ...
Posts: 23,501

Rep: Reputation: 7775Reputation: 7775Reputation: 7775Reputation: 7775Reputation: 7775Reputation: 7775Reputation: 7775Reputation: 7775Reputation: 7775Reputation: 7775Reputation: 7775
no, it is not possible with wget. You should try rsync instead if possible or some other tool (ftp?) to get info and decide.
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
download file via wget ust Linux - Newbie 18 03-08-2011 04:44 AM
wget - how to download more than one file at once instead of file after file? De-M-oN Linux - Server 15 09-24-2010 06:35 PM
wGet is there a command for file size? SonoranFun Linux - Software 2 01-02-2006 04:56 PM
File size limit exceeded with wget jimdaworm Slackware 1 04-24-2005 04:06 AM
how can i default the max folder file size when it create inside a folder antony_csf Linux - Software 1 06-17-2004 03:26 AM

LinuxQuestions.org > Forums > Linux Forums > Linux - Software

All times are GMT -5. The time now is 08:19 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration