LinuxQuestions.org
Download your favorite Linux distribution at LQ ISO.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Software
User Name
Password
Linux - Software This forum is for Software issues.
Having a problem installing a new program? Want to know which application is best for the job? Post your question in this forum.

Notices


Reply
  Search this Thread
Old 11-11-2013, 10:43 AM   #1
whynotkeithberg
LQ Newbie
 
Registered: Nov 2013
Location: Murder Dubs... Oakland CA
Distribution: RHEL
Posts: 20

Rep: Reputation: Disabled
Hardware Monitoring for Application Benchmarking


Hello everyone! This is my first of what will hopefully be many posts here. I would apologize that my first post is a question... But I'm guessing that's what many people's first post is. However, I do plan on giving back to the community.

Anywho... Here's what I have going on.

I have two servers both running latest CentOS I'm going to be benchmarking & comparing against each other. One has a $20,000 FUsionIO disk in it & the other is using RAID' SSD's. Going to try and get a price to performance comparison.

So anyways that's all besides the point. I have setup a Jmeter test plan that will hit an apache server & crawl through the pages using regex. Apache will then be hitting the database which is on the servers I"m testing.

I currently use Nagios with op5's merlin, mk_livestatus, op5lib & ninja. I also use MRTG to monitor bandwidth (I know it can do more than that) as well as a few others not worth mentioning.

Jmeter will handle all of the apache information and we will be able to pull all the slow queries & other information out of the MySQL database afterwards to get an idea on how MySQL was able to fare.

However, I'm having a hard time figuring out what to use to monitor the hardware in realtime without harming it's performance and have it save the data to be looked over at a regular date. If it graphs & displays it pictorially that is even better.

I hope I explained this well enough. I would use Nagios but it's not made for realtime polling. I was contemplating using MRTG with SNMP & just have a script that loops through it every couple little bit. But I"m doubting that's the best way either.

So any ideas are welcome. Thanks for your time!
 
Old 11-12-2013, 11:46 AM   #2
mjose
LQ Newbie
 
Registered: Aug 2009
Posts: 2

Rep: Reputation: 0
That sounds awesome. I'd be really interested in seeing the results, partly because of my general interest in benchmarks and partly to see what we can do better kn terms of performance (I work for op5).

The simplest way to monitor the system resources (i/o, cpu and memory) is probably vmstat. It is very light-weight but captures a lot of information. Dig into the man page for details, but just vmstat 5 | tee vmstat.log should go a long way.
 
Old 11-12-2013, 12:38 PM   #3
Habitual
LQ Addict
 
Registered: Jan 2011
Posts: 8,472
Blog Entries: 11

Rep: Reputation: 2382Reputation: 2382Reputation: 2382Reputation: 2382Reputation: 2382Reputation: 2382Reputation: 2382Reputation: 2382Reputation: 2382Reputation: 2382Reputation: 2382
http://collectl.sourceforge.net/ too!
 
Old 11-12-2013, 12:42 PM   #4
whynotkeithberg
LQ Newbie
 
Registered: Nov 2013
Location: Murder Dubs... Oakland CA
Distribution: RHEL
Posts: 20

Original Poster
Rep: Reputation: Disabled
Quote:
Originally Posted by Habitual View Post
BRILLIANT!! Thank you so much... I don't know how interesting the data I get will be. But I'll be more than happy to come back & share my experiences after it's completed. Could be a week or more not 100% sure on timeline. But will post back later.

Again... Habitual. Thank you I've heard of collectl before but it never even crossed my mind & it appears to be just what I need.

--
WhyNotKeithberg
 
Old 11-12-2013, 01:58 PM   #5
Habitual
LQ Addict
 
Registered: Jan 2011
Posts: 8,472
Blog Entries: 11

Rep: Reputation: 2382Reputation: 2382Reputation: 2382Reputation: 2382Reputation: 2382Reputation: 2382Reputation: 2382Reputation: 2382Reputation: 2382Reputation: 2382Reputation: 2382
Quote:
Originally Posted by whynotkeithberg View Post
BRILLIANT!! Thank you so much... I don't know how interesting the data I get will be. But I'll be more than happy to come back & share my experiences after it's completed. Could be a week or more not 100% sure on timeline. But will post back later.

Again... Habitual. Thank you I've heard of collectl before but it never even crossed my mind & it appears to be just what I need.

--
WhyNotKeithberg
It's a "keeper".
I did a short write up here about running in the modes
(Record and Playback) and a browsing a collected log with yesterday's "date"...
very generic and boring, unless you're as sick as I am an love c-line?

plotting stuff here...
http://martincarstenbach.wordpress.c...-utils-part-i/

The author (Mark Seger) has been sighted on LQ

Have fun.
Subscribed with interest...
 
Old 11-19-2013, 05:43 PM   #6
whynotkeithberg
LQ Newbie
 
Registered: Nov 2013
Location: Murder Dubs... Oakland CA
Distribution: RHEL
Posts: 20

Original Poster
Rep: Reputation: Disabled
Quote:
Originally Posted by Habitual View Post
It's a "keeper".
I did a short write up here about running in the modes
(Record and Playback) and a browsing a collected log with yesterday's "date"...
very generic and boring, unless you're as sick as I am an love c-line?

plotting stuff here...
http://martincarstenbach.wordpress.c...-utils-part-i/

The author (Mark Seger) has been sighted on LQ

Have fun.
Subscribed with interest...
Thanks again for this additional information. Just wanted to let you know the thread is not abandoned. I'm doing another project real quick while the lead developer is finishing up some other stuff. I'm running a test plan tomorrow or the next day so I may be able to post a little data that won't mean much. However, I'm hoping to hit the actual benchmarking this week next week at the latest. So like I said will keep it updated. Pretty excited to get it started & see how it comes out. Played around with collectl... You nailed it with that recommendation.
 
Old 12-05-2013, 04:19 AM   #7
mjose
LQ Newbie
 
Registered: Aug 2009
Posts: 2

Rep: Reputation: 0
Any results yet? *curious* :-)
 
Old 12-06-2013, 12:24 PM   #8
whynotkeithberg
LQ Newbie
 
Registered: Nov 2013
Location: Murder Dubs... Oakland CA
Distribution: RHEL
Posts: 20

Original Poster
Rep: Reputation: Disabled
Quote:
Originally Posted by mjose View Post
Any results yet? *curious* :-)
Unfortunately no... I did very small testing. I used Regex Extractors on Jmeter to make it hit my homepage & then automatically crawl any links also on my own server (ignoring links to outside sites) and hit them as well. I just did a very, very basic page it had nothing but a Link & a few words to provide data. It wasn't hitting the database.

The project will still happen... It's just my clients funding has been delayed till January or February. But it will happen... Mike Seashols from Oracle has requested & agreed to be on the company board. Once they get the funding I'm actually going to shut my consulting down & jump in full time with them. But unfortunately, I'm on a temporary hiatus with this client.

But, I'm a man of my word. As soon as I get to do the work I'll post my data & documentation.

I actually may write up some of my documentation soon & create a walkthrough on basic setup & usage of collectl, jmeter etc.

I do really appreciate your help on this even if it's unfortunately postponed for a bit. But I'll find another way to give back. I keep good documentation so I'm going to get my IT blog back up & start posting different guides for linux administration.

Also, I'll be sure to give credit where it's due to those of you who pointed me in the right direction.
 
Old 12-06-2013, 03:12 PM   #9
fnordpojk
LQ Newbie
 
Registered: Dec 2013
Location: Sweden
Distribution: Ubuntu
Posts: 1

Rep: Reputation: 0
Quote:
Originally Posted by whynotkeithberg View Post
I would use Nagios but it's not made for realtime polling.
You're right. However, is realtime data actually what you need?

(disclaimer: I also work for op5)

I did a number of tests on our new appliance machines to see how much (Nagios) load they could handle, and being that we're a monitoring shop, I used op5 Monitor (based on Nagios) to get the data, in one minute intervals. The performance impact of fetching data once a minute is negligible, and I'm not sure I would have better data (or rather, a better idea based on the data) if I'd had realtime data. Unless you're actually looking for the performance hit of, say, a single transaction, you're probably better off with a slight aggregate than with raw or realtime data.

Of course, your situation is a bit different from mine, but you might be able to pick up some ideas from what I did.

My report (and scripts and data) is here:

https://kb.op5.com/x/egI6
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
LXer: This Week: Benchmarking, Benchmarking, & IGDNG LXer Syndicated Linux News 0 08-16-2009 10:50 PM
LXer: Benchmarking hardware RAID vs. Linux kernel software RAID LXer Syndicated Linux News 0 07-15-2008 03:50 PM
Monitoring free memory with enterprise monitoring application Steelb Linux - Enterprise 2 02-13-2008 10:10 AM
Benchmarking Hardware TigerLinux Linux - Hardware 1 03-16-2006 05:22 AM
Benchmarking an application JAllegraud Programming 2 11-04-2004 09:24 AM

LinuxQuestions.org > Forums > Linux Forums > Linux - Software

All times are GMT -5. The time now is 01:58 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration