LinuxQuestions.org
LinuxAnswers - the LQ Linux tutorial section.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - General
User Name
Password
Linux - General This Linux forum is for general Linux questions and discussion.
If it is Linux Related and doesn't seem to fit in any other forum then this is the place.

Notices

Reply
 
Search this Thread
Old 12-03-2013, 05:45 AM   #1
ags1
LQ Newbie
 
Registered: Apr 2012
Posts: 19

Rep: Reputation: Disabled
Looking for Linux testers!


When I started using Ubuntu I was disappointed to discover that Linux had no equivalent of the Windows Experience Index. In any case, I wanted a simple performance index that was portable across operating systems. So I created a Java benchmark the rate my systems. I have been testing the app with input from many users, but as yet I am just about the only tester actually using Linux!

So I am hoping that some linuxquestions users might be interested in benchmarking their systems. The app requires (1) a graphical OpenGL environment that supports OpenGL 2.0, (2) Java.

If you're curious, here is the website with the download and links to current user results:

http://www.headline-benchmark.com/

Many thanks!

PS: Result submission uses java.awt.Desktop to submit your result at your request to the website. This may not work on all Linux flavors, and I have only tested this works on Ubuntu 12.04. Apparently it should also work on any system with the Gnome libraries.
 
Old 12-03-2013, 06:11 AM   #2
Drakeo
Senior Member
 
Registered: Jan 2008
Location: Urbana IL
Distribution: Slackware, Slacko,
Posts: 2,454
Blog Entries: 3

Rep: Reputation: 182Reputation: 182
Quote:
When I started using Ubuntu I was disappointed to discover that Linux had no equivalent of the Windows Experience Index.
I am glad your using linux. At the risk of sounding odd. Think linux not windows. Every native linux steam game and all the native stuff that I use in slackware.
they are heavy duty graphic just blow away anything M$ has. As for using a java program for benchmark Java is not really machine friendly.

I am a AMD user because I do a lot of compiling while gaming and the i7 just never stood up to it for me.
 
Old 12-03-2013, 12:26 PM   #3
ags1
LQ Newbie
 
Registered: Apr 2012
Posts: 19

Original Poster
Rep: Reputation: Disabled
Actually the performance difference between Java and other programming languages is much smaller than you might think. Also the absolute speed of Java versus other languages is not relevant to a performance test measuring the _relative_ performance of different machines. As for the performance complications mentioned in the article you linked, these can be minimized or made irrelevant by how the synthetic benchmark is set up. For example, you can code the benchmark to make garbage collection irrelevant, and it is equally possible to 'warm up' the tests so the JIT compilation is not occuring during test execution.
 
Old 12-03-2013, 01:10 PM   #4
Drakeo
Senior Member
 
Registered: Jan 2008
Location: Urbana IL
Distribution: Slackware, Slacko,
Posts: 2,454
Blog Entries: 3

Rep: Reputation: 182Reputation: 182
java relies heavily on your hardware. that is all I am saying. it is in the wiki. and the amount of work the hardware does from code to machine language is a big deal when it comes to different hardware. we are talking hardware. speed. I really don't care for m$.
 
Old 12-03-2013, 02:45 PM   #5
ags1
LQ Newbie
 
Registered: Apr 2012
Posts: 19

Original Poster
Rep: Reputation: Disabled
Quote:
Originally Posted by Drakeo View Post
java relies heavily on your hardware.
That's a good thing when you are benchmarking hardware, not a bad thing :-)
 
Old 12-03-2013, 07:16 PM   #6
273
Senior Member
 
Registered: Dec 2011
Location: UK
Distribution: Debian Sid AMD64&i386, Raspbian Jessie, various VMs
Posts: 3,208

Rep: Reputation: 756Reputation: 756Reputation: 756Reputation: 756Reputation: 756Reputation: 756Reputation: 756
I don't understand what this tool is for?
If I run it under Windows 8, Windows XP, Ubuntu 64 bit, Ubuntu 32 bit, Slackware 64 bit, Slackware 32 bit and PC-BSD will they all return the same result?
If not, then what is it supposed to be measuring, its own performance?
If so, then how does it tell me how well "Application A" will perform on my system with the OS of my choice?
 
Old 12-03-2013, 08:34 PM   #7
andrewthomas
Senior Member
 
Registered: May 2010
Location: Chicago Metro
Distribution: Arch, Gentoo, Slackware
Posts: 1,690

Rep: Reputation: 307Reputation: 307Reputation: 307Reputation: 307
Quote:
Originally Posted by 273 View Post
I don't understand what this tool is for?
If I run it under Windows 8, Windows XP, Ubuntu 64 bit, Ubuntu 32 bit, Slackware 64 bit, Slackware 32 bit and PC-BSD will they all return the same result?
I believe that he is suggesting that it will.
 
Old 12-03-2013, 08:37 PM   #8
273
Senior Member
 
Registered: Dec 2011
Location: UK
Distribution: Debian Sid AMD64&i386, Raspbian Jessie, various VMs
Posts: 3,208

Rep: Reputation: 756Reputation: 756Reputation: 756Reputation: 756Reputation: 756Reputation: 756Reputation: 756
Quote:
Originally Posted by andrewthomas View Post
I believe that he is suggesting that it will.
I'd call that nothing short of miraculous.
I'd love to know why though even if it is possible.
 
Old 12-04-2013, 02:32 AM   #9
ags1
LQ Newbie
 
Registered: Apr 2012
Posts: 19

Original Poster
Rep: Reputation: Disabled
You get different results per operating system, in some cases very different. Sadly, the only OS info Java gives me is that the OS is 'Linux' - so I can't say what distro is being used.

The website currently shows all results from all systems in one big list - but that is only because I am still working on the site navigation.

BTW, you can make any comparison you like as long as you only vary one factor. For example, you might keep the OS and benchmark the same, and compare different computers. But you could also keep the computer and benchmark the same and compare OSs (for example, a dual-boot PC). So for example, I can see I get significantly less OpenGL performance under Ubuntu 32-bit than Windows 7 64-bit on my dual boot system. I presume that is an issue with my nVidia driver.

Last edited by ags1; 12-04-2013 at 05:27 AM.
 
Old 12-04-2013, 12:06 PM   #10
DavidMcCann
Senior Member
 
Registered: Jul 2006
Location: London
Distribution: CentOS, Salix
Posts: 2,957

Rep: Reputation: 767Reputation: 767Reputation: 767Reputation: 767Reputation: 767Reputation: 767Reputation: 767
I've just been to M$ to find what the Windows Experience Index is, and it tell me that it's "a measurement that tells you how well your PC works with Windows". But if I were using Windows, wouldn't I notice how well it works?

I also note it tests "3D gaming graphics"; since my computer doesn't have a graphics card, it would score pretty low here, but since I don't need 3D gaming graphics that has nothing to do with my experience.

Basically, I can't see how some general test can tell me what my experience will be, and why I'd need it even if it could. But if you're having fun writing it, good luck to you!
 
Old 12-04-2013, 01:51 PM   #11
John VV
Guru
 
Registered: Aug 2005
Posts: 12,665

Rep: Reputation: 1683Reputation: 1683Reputation: 1683Reputation: 1683Reputation: 1683Reputation: 1683Reputation: 1683Reputation: 1683Reputation: 1683Reputation: 1683Reputation: 1683
just numbers do not mean much for an " Experience"
what are ones needs and are they met - if YES then it is a good experience

if say the operating system keeps calling home and RESETTING MY DEFAULT SETTINGS to what " THEY" think I should use

then it will be a VERY BAD " Experience"


for Hardware VS. Operating System i would use something like
http://www.phoronix-test-suite.com/

As to your program
can you provide the SOURCE code so I can build it

running a random java program "just because" someone wants me to
is ASKING FOR A PROBLEM

As in i have ZERO idea what it is doing

a audit before compiling will be needed

i do not like seeing in "jogl-all-natives-linux-i586.jar" all the prebuilt shared libs
libjogl_desktop.so
libjogl_mobile.so
libnativewindow_awt.so
libnativewindow_x11.so
libnewt.so
 
1 members found this post helpful.
Old 12-04-2013, 03:16 PM   #12
NeXuS_2006
Member
 
Registered: Dec 2003
Distribution: Mint 15, Slack 14
Posts: 61

Rep: Reputation: 18
Definitely should post source code as well, maybe someone can suggest improvements, and at the very least we know what you are doing to our systems.
 
Old 12-04-2013, 11:59 PM   #13
wstewart90
Member
 
Registered: May 2013
Distribution: Arch Linux
Posts: 78

Rep: Reputation: Disabled
Yeah, source code definitely needed. One of the biggest points of using linux is that most of the software for it is open source so we have the opportunity to know what's being done to our system.

Last edited by wstewart90; 12-05-2013 at 12:01 AM.
 
Old 12-05-2013, 07:11 AM   #14
ags1
LQ Newbie
 
Registered: Apr 2012
Posts: 19

Original Poster
Rep: Reputation: Disabled
Not too sure about open sourcing - that would make it very simple to cheat on the results. But I fully understand your security concerns - I will think of another way of testing.
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
Teslagrad Linux alpha: call for testers kabamaru Linux - Games 1 07-10-2013 01:48 PM
LXer: Hyperspace Pinball Looking for Linux Testers LXer Syndicated Linux News 0 04-20-2013 06:31 PM
LXer: Torvalds seeks Linux testers this Christmas LXer Syndicated Linux News 0 12-28-2005 05:46 PM


All times are GMT -5. The time now is 11:37 PM.

Main Menu
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
identi.ca: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration