LinuxQuestions.org
Download your favorite Linux distribution at LQ ISO.
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Distributions > Fedora
User Name
Password
Fedora This forum is for the discussion of the Fedora Project.

Notices


Reply
  Search this Thread
Old 05-04-2020, 09:12 PM   #1
Doug Hutcheson
Member
 
Registered: Jun 2009
Location: Philippines
Distribution: Fedora 36; Homebrew desktop with Ryzen 5600G and 32Gb. Using Red Hat since 1998
Posts: 304

Rep: Reputation: 22
Alternative to dnf that restarts downloads without discarding?


I have recently moved from high speed broadband in Australia to the end of a very unreliable and slow internet link in regional Philippines. Now, dnf struggles to download during the day and often drops hundreds of megabytes of download in an update session when retries are exceeded. This is chewing up my limited Gb allowance. Is there an alternative method of download which will continue a half finished action? If I can't do it in Fedora, which I have used since the late 90s, is there another distro with a better downloader that I can switch to? Tearing my hair out.

By the way, dnf is the only download process across my laptop and two android devices which throws away precious downloads. Updates to Android work fine and even good old YouTube knows how to continue after an interruption, so it is not as though the technology is not well proven.

Any help would be greatly appreciated, as I am ready to upgrade to Fedora 32 and I'm not willing to risk it until this issue is sorted. "8-)
 
Old 05-04-2020, 09:20 PM   #2
syg00
LQ Veteran
 
Registered: Aug 2003
Location: Australia
Distribution: Lots ...
Posts: 21,126

Rep: Reputation: 4120Reputation: 4120Reputation: 4120Reputation: 4120Reputation: 4120Reputation: 4120Reputation: 4120Reputation: 4120Reputation: 4120Reputation: 4120Reputation: 4120
Well I live at the end of a dodgy NBN link, and I've never had Fedora chuck incomplete downloads away. But I do the updates from a terminal and have the check turned off. Don't use --refresh unless you really have to - although that should only refresh the package list, which is maybe what you are seeing fail.
Also make sure you are using a local mirror for the repos.
 
Old 05-04-2020, 09:34 PM   #3
Doug Hutcheson
Member
 
Registered: Jun 2009
Location: Philippines
Distribution: Fedora 36; Homebrew desktop with Ryzen 5600G and 32Gb. Using Red Hat since 1998
Posts: 304

Original Poster
Rep: Reputation: 22
Quote:
Originally Posted by syg00 View Post
Well I live at the end of a dodgy NBN link, and I've never had Fedora chuck incomplete downloads away. But I do the updates from a terminal and have the check turned off. Don't use --refresh unless you really have to - although that should only refresh the package list, which is maybe what you are seeing fail.
Also make sure you are using a local mirror for the repos.
Thanks syg00.

I have only experienced these failures here, not in Oz. The link is sooooo slooooow that downloads time out, even with the threshold set way down to 1Kb per minute and given a timeout of three minutes. When this happens, dnf discards whatever it has already downloaded and starts afresh at the next mirror it can find. I have no idea if there is the concept of a local mirror here - probably some of the bigger universities do, but whether they make them public ...?

My internet service comes via wireless to the modem from a local tower, which I believe is merely a repeater from the nearest bigger town anyway, so reliability and speed are woeful at the best of times. Now the population is locked down at home, everybody is trying to stream video ... sigh!

The key to the problem is dnf throwing away what it has partly downloaded. Research to date indicates this is a 'feature' of the way dnf does business. Obviously this is a bad choice and I need to change horses if I am to get updates to complete. Currently it can take two days to successfully download an update including kernel, Libre Office, glib and a few other biggies. During these two days, I generally have to restart the update numerous times after timeouts have caused all mirrors to be tried on major packages and this is where my Gb allowance is disappearing.
 
Old 05-04-2020, 11:01 PM   #4
syg00
LQ Veteran
 
Registered: Aug 2003
Location: Australia
Distribution: Lots ...
Posts: 21,126

Rep: Reputation: 4120Reputation: 4120Reputation: 4120Reputation: 4120Reputation: 4120Reputation: 4120Reputation: 4120Reputation: 4120Reputation: 4120Reputation: 4120Reputation: 4120
OK, for completeness I tried a test on an old (slow) laptop. Hasn't been updated in a while and it found 1.3G of updates (for F30). I powered off the broadband modem while it was syncing the repos - restarted fine after it all came back up. I used --refresh (as I had to) so it restarted in full. Then after a few packages I killed the wifi whilst the kernel was downloading. Waited for all the error messages, then retried (without wifi) and it whinged about unable to find the repos. Restarted wifi, restarted dnf update, and as expected it listed all the previously downloaded packages as just that, and skipped the re-download. Then resumed (not restarted) the kernel.
As I said, check your mirrors to ensure they are local to you, rather than coming via rusty copper under the ocean.
 
Old 05-05-2020, 12:36 AM   #5
Doug Hutcheson
Member
 
Registered: Jun 2009
Location: Philippines
Distribution: Fedora 36; Homebrew desktop with Ryzen 5600G and 32Gb. Using Red Hat since 1998
Posts: 304

Original Poster
Rep: Reputation: 22
Quote:
Originally Posted by syg00 View Post
Then resumed (not restarted) the kernel.
Thanks for your efforts, but we are not comparing apples with apples.

I have no way of knowing how local the mirror is, but that is not the issue - it is the intervening communication technology that is not up to the job.


I can assure you, what I originally wrote is indeed happening. During a dnf update session, all files successfully downloaded in a previous session are skipped, but any partials are thrown away and restarted from the beginning.

After a mirror is abandoned for lack adequate speed, the currently downloaded file fragment is discarded. This can be proved by looking at the download statistics on the last line of the dnf output: for example, when a kernel is being downloaded as part of an update, I might get to say 400Mb download reported, then the file fragment is discarded, the download total drops back to say 300Mb and the next mirror is tried.

Whatever causes this, the partial download is thrown away and this wastes precious time, money and allocation. It is a known issue with dnf, as I have searched on this previously. The question is how to update without using this broken system. If Fedora can only use dnf, I will have to try to find a distro that does NOT discard partial downloads during update.
 
Old 05-05-2020, 04:47 AM   #6
shruggy
Senior Member
 
Registered: Mar 2020
Posts: 3,670

Rep: Reputation: Disabled
Quote:
Originally Posted by Doug Hutcheson View Post
I have no way of knowing how local the mirror is
Have you tried http://mirror.pregi.net/?
 
Old 05-05-2020, 07:57 AM   #7
dc.901
Senior Member
 
Registered: Aug 2018
Location: Atlanta, GA - USA
Distribution: CentOS/RHEL, openSuSE/SLES, Ubuntu
Posts: 1,005

Rep: Reputation: 370Reputation: 370Reputation: 370Reputation: 370
Here is list of mirrors: https://admin.fedoraproject.org/mirr...dora/32/x86_64
I see couple of mirrors in Philippines on that list
 
  


Reply

Tags
dnf, download, slow internet



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
LXer: The Difference Between DNF and YUM, Why is Yum Replaced by DNF? LXer Syndicated Linux News 0 02-03-2020 02:02 PM
[SOLVED] Fedora, updating notices and packages : dnf updateinfo & dnf check-update fanoflq Linux - Newbie 9 05-20-2017 07:07 PM
[SOLVED] dnf remove repo, dnf command help ? mshlinux Fedora 2 10-01-2015 10:00 PM
fetchmail Not Discarding on 553 MQMan Linux - Software 1 12-01-2009 03:39 PM
knetworkmanager 'Setting '802-1x' is empty, discarding' Mark_667 Linux - Software 2 09-14-2008 05:14 AM

LinuxQuestions.org > Forums > Linux Forums > Linux - Distributions > Fedora

All times are GMT -5. The time now is 02:39 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration