LinuxQuestions.org
Help answer threads with 0 replies.
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Distributions > Fedora
User Name
Password
Fedora This forum is for the discussion of the Fedora Project.

Notices


Reply
  Search this Thread
Old 06-02-2023, 09:58 PM   #1
terry-duell
Member
 
Registered: Jan 2007
Location: Melbourne, Australia
Distribution: Fedora 38 x86_64
Posts: 539

Rep: Reputation: 59
Fedora 36, very slow file transfer from SD card


I regularly transfer image files from an SD card to my system SSD disc, via a USB3 card reader.
Normally, the files transfer at a rate of about 95 MB/s, but just recently the transfer rate is down at about 6.3 MB/s.
My system (Fedora 36) is up to date, and I'm not aware of any recent changes I have made that might have caused this.
Any ideas as where I should look for the cause?
[edit] Sorry, I'm on Fedora 37.
Cheers,
Terry

Last edited by terry-duell; 06-02-2023 at 09:59 PM. Reason: Correction
 
Old 06-03-2023, 10:31 AM   #2
business_kid
LQ Guru
 
Registered: Jan 2006
Location: Ireland
Distribution: Slackware, Slarm64 & Android
Posts: 16,286

Rep: Reputation: 2322Reputation: 2322Reputation: 2322Reputation: 2322Reputation: 2322Reputation: 2322Reputation: 2322Reputation: 2322Reputation: 2322Reputation: 2322Reputation: 2322
There is a cache that the kernel uses to buffer those usb transfers. I need to transfer 10-12G at a time to program up my RazPi. If you use an optimal blocksize, you can get most of the first 2G transferred before it starts to slow drastically. I use
Code:
dd if=/somefile.img of=/dev/whatever bs=1M status=progress
and you can see the rate as you go.

When dd finishes, it syncs the sdcard and prints a final speed rate, which is always to date under 10MB/S. I confess to using cheap sd cards but since sdcards generally last about as long as chewing gum, what's the point of spending money?
 
Old 06-03-2023, 12:03 PM   #3
jailbait
LQ Guru
 
Registered: Feb 2003
Location: Virginia, USA
Distribution: Debian 12
Posts: 8,337

Rep: Reputation: 548Reputation: 548Reputation: 548Reputation: 548Reputation: 548Reputation: 548
95 MB/s is in the speed range of USB 3.0 reads. The write speed of a SSD is somewhere between 5 and 10 times the USB 3.0 read speed. Since the SSD is so much faster than the USB 3.0 you are not accumulating buffers in the cache. The cache only fills up when the write device is slower than the read device. So the problem is either that the SSD write speed or the SD card read speed has dropped to 6.3 MB/s. You did not complain that you have a degradation of speed for your entire system so I would start by checking out the speed of the SD card.

I suggest that you make sure that nothing else such as internet or a copy is running and try a few tests on the SD card.

You could swap for a known good SD card and try that.

You could copy the SD card to /dev/null and see what speed you get.


On second thought the cache would fill up if the SSD write speed dropped below the USB 3.0 read speed of 95 MB/s.

Last edited by jailbait; 06-03-2023 at 12:08 PM. Reason: a second thought
 
Old 06-03-2023, 06:10 PM   #4
terry-duell
Member
 
Registered: Jan 2007
Location: Melbourne, Australia
Distribution: Fedora 38 x86_64
Posts: 539

Original Poster
Rep: Reputation: 59
Thanks to all who have posted. A look at the system monitor indicates that clamscan is active and chews up resources. I'll run a test shortly with clamscan off and see if I get my normal result.

Cheers,
Terry
 
Old 06-03-2023, 06:13 PM   #5
terry-duell
Member
 
Registered: Jan 2007
Location: Melbourne, Australia
Distribution: Fedora 38 x86_64
Posts: 539

Original Poster
Rep: Reputation: 59
Quote:
Originally Posted by business_kid View Post
I confess to using cheap sd cards but since sdcards generally last about as long as chewing gum, what's the point of spending money?
Interesting.
I purchase premium fast SD cards, and over many years of constant activity, I have never had one fail.

Cheers,
Terry
 
Old 06-04-2023, 05:02 AM   #6
business_kid
LQ Guru
 
Registered: Jan 2006
Location: Ireland
Distribution: Slackware, Slarm64 & Android
Posts: 16,286

Rep: Reputation: 2322Reputation: 2322Reputation: 2322Reputation: 2322Reputation: 2322Reputation: 2322Reputation: 2322Reputation: 2322Reputation: 2322Reputation: 2322Reputation: 2322
Quote:
Originally Posted by terry-duell View Post
Interesting.
I purchase premium fast SD cards, and over many years of constant activity, I have never had one fail.

Cheers,
Terry
Not one? Which sdcards? Try a big image (e.g. 10G) and post the final rate from dd. The slarm64 ones are a good size, although you need zstd to unarchive them.

The devs from various Arm SBC distros use decent high-spec sdcards and talk about a lifespan of ≅6 months. They all have a low write count, so if they're not dying, you're not using them much. The sd cards are also marked with a speed classification, and you can get details online.
 
Old 06-04-2023, 07:55 PM   #7
terry-duell
Member
 
Registered: Jan 2007
Location: Melbourne, Australia
Distribution: Fedora 38 x86_64
Posts: 539

Original Poster
Rep: Reputation: 59
Quote:
Originally Posted by business_kid View Post
Not one? Which sdcards?
No, many...each of my cameras has 2 cards. I have been using Sandisk Extreme Plus 32 GB and 64 GB cards.

Cheers,
Terry
 
Old 06-05-2023, 04:04 AM   #8
business_kid
LQ Guru
 
Registered: Jan 2006
Location: Ireland
Distribution: Slackware, Slarm64 & Android
Posts: 16,286

Rep: Reputation: 2322Reputation: 2322Reputation: 2322Reputation: 2322Reputation: 2322Reputation: 2322Reputation: 2322Reputation: 2322Reputation: 2322Reputation: 2322Reputation: 2322
Ah. Camera sdcards are a bigger size. There's a lot of profit taking on camera sd cards, so price isn't necessarily a guide. I use mainly sandisk & kingston micro sdcards which I referred to as chesap sdcards.
 
  


Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
[SOLVED] vobcopy is very very very slow fredak Linux - Software 9 05-03-2013 04:45 PM
Squid Server Very Very Very Slow jatender Linux - Server 1 09-28-2007 11:44 PM
A very very very very big problem!! Elbryan Linux - Software 2 09-23-2005 05:56 AM
very-very slow transfer fineass Linux - Networking 5 05-10-2004 08:50 AM
Lindows very very very slow jfi Linspire/Freespire 15 03-28-2004 09:06 AM

LinuxQuestions.org > Forums > Linux Forums > Linux - Distributions > Fedora

All times are GMT -5. The time now is 07:46 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration