LinuxQuestions.org
Download your favorite Linux distribution at LQ ISO.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Server
User Name
Password
Linux - Server This forum is for the discussion of Linux Software used in a server related context.

Notices



Reply
 
Search this Thread
Old 11-16-2008, 08:21 AM   #1
NL-Stitch
Member
 
Registered: Jul 2004
Posts: 75

Rep: Reputation: 16
Exclamation Which OS/DB system combo is best to process 8k+ queries per second? (Schoolproject)


Hey All,

I need some starting advice for a school project.

I am currently starting a theme on school that teaches me the works on Operating Systems.
During this theme, we have to build a fault-tolerant system that can process up to 8000 XML files/queries per second to store and process the data.(Viewing and selecting the data is not included in that 8000)

The system to use.
I have a 64bit (Intel Q6600, 4GB-RAM, SATA2 Disks in RAID) quadcore server at home which I would like use for this project, and would like to use a Linux-oriented OS for it.(But Windows is an option as well if it would get me better results)
Note: I could also request a Playstation 3 from school if the above server is not enough.

Database Type(Max queries per second?) VS System Performance(Max queries per second?)

As I read somewhere, the amount of queries per second is defined by system performance instead the database system you use? So now, I am searching for the best brute performance OS out there. My goal is to secretly impress the rest to try to get even get above that 8k of queries per second.

Last but not least
Another thing that came to my mind is that the distro should have a minimal of "standard" active threads, should run on a 64bit system (So good hardware compatibility is required) or good 32bit alternative and should make efficient use of the 4 available cores if thats needed.

So the question is: Which Database System/OS combination should I use?.

I know there could be info on google, but I want to hear more personal experiences and advices and interact with those with some real passion .


Greetings,
 
Old 11-16-2008, 08:45 PM   #2
yowi
Member
 
Registered: Dec 2002
Location: Au
Distribution: Debian
Posts: 209

Rep: Reputation: 52
I used to work for these guys:
http://www.aleri.com/cep/aleri-streaming-platform

Their software is throughput orientated, as opposed to conventional DB's that are more concerned with transactional integrity, etc.
They support Red Hat and won't charge you for a time restricted only (ie full featured) license for non-commercial usage. They'll be happy to give you extension to the license if needed.
They have an eclipse based gui development environment, if you know SQL you will have no problems getting your head around their software.

I supported this stuff being used to give real-time reports on bank positions, using similar hardware to that which you have.
If you imagine the number of transactions going through a major bank then you'll get the idea. A conventional DB/reporting system would otherwise do these reports overnight.
 
  


Reply

Tags
database, mysql, performance, quadcore, queries, sql


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
system process elainelaw Linux - Software 1 01-17-2008 05:02 AM
answering some questions for a schoolproject? Mithandus Solaris / OpenSolaris 8 11-16-2007 07:51 AM
Combo,combo box and combo entry box diff santhosh.linux Programming 4 02-27-2006 01:37 AM
Which process is making DNS queries? TruckStuff Linux - Networking 4 11-29-2005 05:05 PM
Process System cpu rajesht Linux - General 1 05-19-2005 10:16 AM


All times are GMT -5. The time now is 08:53 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
identi.ca: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration