LinuxQuestions.org
Download your favorite Linux distribution at LQ ISO.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Desktop
User Name
Password
Linux - Desktop This forum is for the discussion of all Linux Software used in a desktop context.

Notices

Reply
 
Search this Thread
Old 12-05-2012, 02:10 AM   #1
bucovaina78
Member
 
Registered: Oct 2004
Location: Belgium / Antwerp
Distribution: Debian,Ubuntu,Finnix,LFS
Posts: 264

Rep: Reputation: 31
ZFS performance issue / isolating bottlenecks


Hi,

I'm experimenting with ZFS but encountering perfomance issues.

Setup:

Ubuntu 12.10 AMD64 live CD with zfs-fuse installed. 32GB RAM DDR3 1600MHz intel I3 2100. 4x 3TB of same model/make, 2 pools in stripe of 6TB. I'm copying the contents of pool 1 to pool 2. The disks of pool one are connected to SATA300, pool 2 is connected on SATA600. The software I use for the copy is midnight commander.

I see the progress bar progressing in mc but no write activity on pool2, then the progress bar stops, I see a lot of write on pool2 and finally the progress bar continues again.

I see the same kind of speeds/behaviour when I'm copying from a RAID array on an areca RAID controller to my mainboard so I guess it's not because both pools/devices are sharing the available bandwidth. I know the CPU isn't the best but I only rarely see peaks of 50% load so I guess that's not the bottleneck either.

I don't know whether this is an hardware issue or a ZFS tweak somewhere?

If you don't know anything about ZFS, you might be of help by telling what great method you use for spotting bottlenecks in systems
 
Old 12-07-2012, 03:12 PM   #2
Pearlseattle
Member
 
Registered: Aug 2007
Location: Switzerland
Distribution: Gentoo
Posts: 701

Rep: Reputation: 80
Hi
Isn't this "normal"?
I think that the normal kernel parameters say something like this: "whenever dirty buffers (stuff that hasn't yet been written to HDD) show up, start flusing them to the HDD only if they reach at least 10% of the available RAM or their age is older then 30 seconds".

This behaviour can be configured in the kernel parameters.

I ideally wanted the following added to the above: "...or flush them now if the HDD is doing nothing"
but of course the problem is that the "now" will be the future when the HDD will start writing and that you don't have any knowledge of what the HDD will be doing in the future... .
So, I think that your ZFS setup is ok and that your "source" disks are just faster than the timeout set by the kernel.
Even if you lower the settings in your kernel I think that you will end up in the same situation with just shorter timespans before "that" happens.
Pls. correct me if I'm wrong or if I misinterpreted your question.
Cheers
 
Old 09-24-2013, 07:13 AM   #3
bucovaina78
Member
 
Registered: Oct 2004
Location: Belgium / Antwerp
Distribution: Debian,Ubuntu,Finnix,LFS
Posts: 264

Original Poster
Rep: Reputation: 31
I completely forgot I started this topic a long time ago but I got this one solved by installing zfs-native instead of zfs-fuse (http://zfsonlinux.org)

Thanks to this topic:

http://www.linuxquestions.org/questi...es-4175474512/
 
  


Reply

Tags
zfs performance


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
LXer: UFS vs. ZFS File-System Performance On FreeBSD 9.0 LXer Syndicated Linux News 0 12-12-2011 07:00 PM
LXer: Article ZFS data integrity testing and more random ZFS thoughts. LXer Syndicated Linux News 0 05-15-2010 12:51 PM
solaris with ZFS and informix DB memory issue. LinuxLover Solaris / OpenSolaris 3 03-11-2010 02:23 AM
ZFS Root / Boot into ZFS from a usb flash drive Kataku Solaris / OpenSolaris 1 07-15-2006 04:13 AM
Computer Bottlenecks RySk8er30 Mandriva 1 05-16-2005 09:18 PM


All times are GMT -5. The time now is 11:45 PM.

Main Menu
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
identi.ca: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration