LinuxQuestions.org
Welcome to the most active Linux Forum on the web.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Distributions > Slackware > Slackware - ARM
User Name
Password
Slackware - ARM This forum is for the discussion of Slackware ARM.

Notices


Reply
  Search this Thread
Old 06-17-2022, 01:04 PM   #1
enorbet
LQ Guru
 
Registered: Jun 2003
Location: Virginia
Distribution: Slackware = Main OpSys
Posts: 5,064

Rep: Reputation: 4700Reputation: 4700Reputation: 4700Reputation: 4700Reputation: 4700Reputation: 4700Reputation: 4700Reputation: 4700Reputation: 4700Reputation: 4700Reputation: 4700
RockPro64 as NAS - Slow Transfers


Greetings
I sincerely hope I can even start out making sense since despite experience in building and tweaking hardware under Linux for more than 2 decades, I'm new at ARM, new at NAS, new at RAID, and new at BTRFS.

Basic issue: I am getting what seems like very slow transfer rates. I rsynced a ~70GB partition and it took around 36 hours.

At first I figured it was the slower ethernet hardware on RockPro as it is apparently 1Gb/s and does behave oddly. For example I have fiber service which is roughly 2:1 assymetrical, 2 down, 1 up, yet on RockPro64 I'm getting ~280 down and ~380 up in online fibertest apps. By contrast my Main which has 5Gb/s ethernet, gets ~900 down and 480 up. Those speed seem basically inline but the symmetry is odd on RockPro... why is Up higher than Down?

I have tried a few NAS oriented tweaks I found from NASA, here -
https://www.nas.nasa.gov/hecc/assets...2012_03_07.pdf

and

https://www.nas.nasa.gov/hecc/suppor...Linux_138.html

specifically

Code:
##/etc/sysctl.conf
net.core.wmem_max = 11960320
net.core.rmem_max = 11960320
net.ipv4.tcp_rmem = 4096 524288 11960320
net.core.netdev_max_backlog = 30000
net.ipv4.tcp_wmem = 4096 524288 11960320
net.ipv4.tcp_no_metrics_save = 1
net.ipv4.tcp_window_scaling =1
net.ipv4.tcp_timestamps = 1
net.ipv4.tcp_sack = 1
Anyway I doubt that is the file transfer problem. It's more likely a RAID 1 configuration problem or perhaps the SATA controller addon PCIe card.

All the sites I find about benchmarking (as with iostat, fio, etc) are unfamiliar and quite steep learning curve and many are very old and even predate BTRFS.

So my first questions are -

Anybody else using RockPro64 as NAS?

What storage arrangement? (RAID, Single, File system?)

What transfer rates are you getting?

and possibly

How do you benchmark RAID 1? especially with BTRFS?

Last edited by enorbet; 06-17-2022 at 01:05 PM.
 
Old 06-17-2022, 02:37 PM   #2
mralk3
Slackware Contributor
 
Registered: May 2015
Distribution: Slackware
Posts: 1,926

Rep: Reputation: 1073Reputation: 1073Reputation: 1073Reputation: 1073Reputation: 1073Reputation: 1073Reputation: 1073Reputation: 1073
I do not have a RAID configuration currently. I use a samba share with AES-256-GCM encryption and AES-128-GMAC signing on a 100Mb/s LAN. I have a 10Gb/s switch I am currently not using due to my x86 system only providing a 100Mb/s Ethernet port. I opted for the f2fs file system on ROOT and DATA partitions. I then back up my rockpro64 NAS to an external USB 3 Samsung SSD of some type. While rotating external drives to my fire safe. I rotate between 3 externals once every month.

You may also consider a battery backup in case of power outages and a powered USB hub for external drives or other peripherals.

My guess is that the bottle neck is your RAID 1 setup. Nothing to do about that.
 
Old 06-17-2022, 02:49 PM   #3
enorbet
LQ Guru
 
Registered: Jun 2003
Location: Virginia
Distribution: Slackware = Main OpSys
Posts: 5,064

Original Poster
Rep: Reputation: 4700Reputation: 4700Reputation: 4700Reputation: 4700Reputation: 4700Reputation: 4700Reputation: 4700Reputation: 4700Reputation: 4700Reputation: 4700Reputation: 4700
Thanks mralk3, we agree on the likely bottleneck being RAID but I still want to know how to benchmark it that won't have problems with BTRFS or if that is even an issue in RAID1. I have other backup options but I would like to optimize my NAS. If I have to backup the backup and change RAID config or file system, that's OK.

As for power, I'm on a UPS and the main PSU is a real one with decent VRs, not just a wall wart.
 
Old 06-17-2022, 06:26 PM   #4
mralk3
Slackware Contributor
 
Registered: May 2015
Distribution: Slackware
Posts: 1,926

Rep: Reputation: 1073Reputation: 1073Reputation: 1073Reputation: 1073Reputation: 1073Reputation: 1073Reputation: 1073Reputation: 1073
Network speed testing I use iperf3.
https://slackbuilds.org/repository/15.0/network/iperf3/

There is also sysbench, which is a bench-marking suite.
https://slackbuilds.org/repository/1...stem/sysbench/

A quick google found this page: https://btrfs.wiki.kernel.org/index....AID1.2C_RAID10

Quote:
RAID1, RAID10
The simple redundancy RAID levels utilize different mirrors in a way that does not achieve the maximum performance.
I also found information discussing btrfs compression as a possible bottle neck.
 
Old 06-18-2022, 06:35 AM   #5
enorbet
LQ Guru
 
Registered: Jun 2003
Location: Virginia
Distribution: Slackware = Main OpSys
Posts: 5,064

Original Poster
Rep: Reputation: 4700Reputation: 4700Reputation: 4700Reputation: 4700Reputation: 4700Reputation: 4700Reputation: 4700Reputation: 4700Reputation: 4700Reputation: 4700Reputation: 4700
Thanks. Ill try those and look deeper into BTRFS tweaks.
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
[SOLVED] ROCKPro64 RK3399 (aarch64) sndwvs Slackware - ARM 36 12-07-2021 09:24 AM
RockPro64 questions justwantin Slackware - ARM 18 03-31-2021 03:05 AM
nextcloud - support for UDP file transfers or faster TCP file transfers robertkwild CentOS 0 10-20-2017 10:57 PM
[SOLVED] embeded ubuntu nas from usb stick slow transfers beowulfnode Ubuntu 3 12-03-2010 10:28 PM

LinuxQuestions.org > Forums > Linux Forums > Linux - Distributions > Slackware > Slackware - ARM

All times are GMT -5. The time now is 07:05 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration