Fedora 36, very slow file transfer from SD card
I regularly transfer image files from an SD card to my system SSD disc, via a USB3 card reader.
Normally, the files transfer at a rate of about 95 MB/s, but just recently the transfer rate is down at about 6.3 MB/s. My system (Fedora 36) is up to date, and I'm not aware of any recent changes I have made that might have caused this. Any ideas as where I should look for the cause? [edit] Sorry, I'm on Fedora 37. Cheers, Terry |
There is a cache that the kernel uses to buffer those usb transfers. I need to transfer 10-12G at a time to program up my RazPi. If you use an optimal blocksize, you can get most of the first 2G transferred before it starts to slow drastically. I use
Code:
dd if=/somefile.img of=/dev/whatever bs=1M status=progress When dd finishes, it syncs the sdcard and prints a final speed rate, which is always to date under 10MB/S. I confess to using cheap sd cards but since sdcards generally last about as long as chewing gum, what's the point of spending money? |
95 MB/s is in the speed range of USB 3.0 reads. The write speed of a SSD is somewhere between 5 and 10 times the USB 3.0 read speed. Since the SSD is so much faster than the USB 3.0 you are not accumulating buffers in the cache. The cache only fills up when the write device is slower than the read device. So the problem is either that the SSD write speed or the SD card read speed has dropped to 6.3 MB/s. You did not complain that you have a degradation of speed for your entire system so I would start by checking out the speed of the SD card.
I suggest that you make sure that nothing else such as internet or a copy is running and try a few tests on the SD card. You could swap for a known good SD card and try that. You could copy the SD card to /dev/null and see what speed you get. On second thought the cache would fill up if the SSD write speed dropped below the USB 3.0 read speed of 95 MB/s. |
Thanks to all who have posted. A look at the system monitor indicates that clamscan is active and chews up resources. I'll run a test shortly with clamscan off and see if I get my normal result.
Cheers, Terry |
Quote:
I purchase premium fast SD cards, and over many years of constant activity, I have never had one fail. Cheers, Terry |
Quote:
The devs from various Arm SBC distros use decent high-spec sdcards and talk about a lifespan of ≅6 months. They all have a low write count, so if they're not dying, you're not using them much. The sd cards are also marked with a speed classification, and you can get details online. |
Quote:
Cheers, Terry |
Ah. Camera sdcards are a bigger size. There's a lot of profit taking on camera sd cards, so price isn't necessarily a guide. I use mainly sandisk & kingston micro sdcards which I referred to as chesap sdcards.
|
All times are GMT -5. The time now is 06:02 AM. |