LinuxQuestions.org
Review your favorite Linux distribution.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Hardware
User Name
Password
Linux - Hardware This forum is for Hardware issues.
Having trouble installing a piece of hardware? Want to know if that peripheral is compatible with Linux?

Notices


Reply
  Search this Thread
Old 05-16-2011, 03:13 PM   #1
jgoulett
LQ Newbie
 
Registered: May 2011
Posts: 2

Rep: Reputation: 0
The Need for Throughput - Need Ideas Please


Hello! Thank you for reading. I am building a maximum throughput Oracle Linux server. If you have suggestions for the following, I would really appreciate it!

I will be running Oracle 12g and a network, disk intensive forecasting tool

- Drives- SSD or 10,000 RPM Raid 1+0, or combo of both
- CPU - I am not current on the latest. Some 4 quad I would suppose
- Memory - 32 gig + FlashFire
- Network - Some gig card either internal or external

Any suggestions? Thank You!
 
Old 05-17-2011, 08:43 AM   #2
onebuck
Moderator
 
Registered: Jan 2005
Location: Midwest USA, Central Illinois
Distribution: SlackwareŽ
Posts: 12,867
Blog Entries: 27

Rep: Reputation: 2162Reputation: 2162Reputation: 2162Reputation: 2162Reputation: 2162Reputation: 2162Reputation: 2162Reputation: 2162Reputation: 2162Reputation: 2162Reputation: 2162
Hi,

Welcome to LQ!

Quote:
Originally Posted by jgoulett View Post
Hello! Thank you for reading. I am building a maximum throughput Oracle Linux server. If you have suggestions for the following, I would really appreciate it!

I will be running Oracle 12g and a network, disk intensive forecasting tool

- Drives- SSD or 10,000 RPM Raid 1+0, or combo of both
- CPU - I am not current on the latest. Some 4 quad I would suppose
- Memory - 32 gig + FlashFire
- Network - Some gig card either internal or external

Any suggestions? Thank You!
What's maximum? What are your load requirements?

Quote:
I will be running Oracle 12g and a network, disk intensive forecasting tool
No specifics, so no one will know the specific needs therefore unable to make recommendations. What does Oracle spec for your applications requirement(s)?

FYI: I suggest that you look at 'How to Ask Questions the Smart Way' so in the future your queries provide information that will aid us in diagnosis of the problem or query.


 
Old 05-18-2011, 03:16 PM   #3
16pide
Member
 
Registered: Jan 2010
Posts: 418

Rep: Reputation: 83
oracle licenses costing a little fortune, I expect Oracle or your Oracle reseller can advise a cost effective hardware configuration that match your exact needs.

Source: I create hardware configs for my customers for a similarly priced software (not a database though)
 
Old 05-19-2011, 05:41 PM   #4
rnturn
Senior Member
 
Registered: Jan 2003
Location: Illinois (Chicago area)
Distribution: Red Hat (8.0, RHEL5,6), CentOS, SuSE (10.x, 11.x, 12.2, 13.2), Solaris (8-10), Tru64, MacOS, Raspian
Posts: 1,137

Rep: Reputation: 65
Quote:
I will be running Oracle 12g and a network, disk intensive forecasting tool

- Drives- SSD or 10,000 RPM Raid 1+0, or combo of both
- CPU - I am not current on the latest. Some 4 quad I would suppose
- Memory - 32 gig + FlashFire
- Network - Some gig card either internal or external
Here's my $0.02... (and remember, YMMV):

More spindles always seems to be better with Oracle. Don't put data files and their indices on the same spindle. I work with two different departments at work that are using Oracle and the folks with the slower CPUs and only 2GB of RAM seem to get more throughput than the group that has the faster CPUs and 12GB RAM. The big difference was that the system with the slower CPUs had more disks accessed through multiple controllers. The group with the faster CPU seemed to think they could get their throughput via brute force and only used a single disk controller with larger disks. Moral: Don't overlook the potential for a performance hit due to long I/O queues. Spreading your data across more disks always seems to be a win. If you can still use it, Oracle used to prefer that you do raw I/O to the disks and avoid going through the OS disk/filesystem buffers. (I never saw a big advantage to that -- at least for the work loads we were dealing with -- and haven't seen anyone using raw devices for some years now. I know we left that idea behind about ten years ago. Besides, it complicated the backup process.)

Memory? With Oracle you never seem to have enough. Oracle used to produce some insane benchmarks by running them on systems with gigantic amounts of RAM and fiddling with the database to that it was essentially entirely loaded into memory.

Oracle used to have a performance tuning guide. I have a really old one but the DBAs that I work with have newer guides. Can't remember if they were one of the standard manuals you could get from Oracle or whether they were written by others. I recall referring to my copy when I'd sit down with the DBAs to see what we could do to wring more performance out of the system after some new application started banging away at the database. Not all of it covered things that I could do -- much it would be more applicable to the DBA who'd be looking at the database performance statistics and figuring out how to tune queries -- but sometimes a kernel parameter change or more hardware might be needed.

One thing to watch out for that I've noticed and seems to be a real performance killer: If Oracle is allowed to automatically extend files it tends to extend them in small increments (at least I haven't run into any DBAs that know how to prevent that) and you wind up with lots of small files being used by the database. The effect on performance is especially horrific if the file that Oracle is extending in dribs and drabs is being used as Oracle query temp space.

Hope some of the above helps.

--
Rick
 
Old 05-20-2011, 08:34 AM   #5
rnturn
Senior Member
 
Registered: Jan 2003
Location: Illinois (Chicago area)
Distribution: Red Hat (8.0, RHEL5,6), CentOS, SuSE (10.x, 11.x, 12.2, 13.2), Solaris (8-10), Tru64, MacOS, Raspian
Posts: 1,137

Rep: Reputation: 65
Quote:
What's maximum? What are your load requirements?
I had to laugh when I reread your reply. Yep, you could build a system using a single 1TB disk or a slew of SSDs and in each case you would achieve "maximum throughput". For that system configuration. Once upon a time, your system design would have a response time or transaction/sec you were shooting for when N users were using the system, etc. When you failed to hit that, you knew you needed to identify the bottlenecks and make changes to the system.

Every day I see folks submitting change requests for some pretty significant upgrades to systems that were installed only a few months ago. Oracle filesystems filling up after only a couple of months of operation? Crazy requests for RAM? Geez. When you have a 6 month old system and you're asking to double the RAM to 128GB someone's going to wonder how much effort actually went into the initial requirements gathering/analysis/etc. phase of that project.

Hopefully, the OP has been thinking of how the system is going to need to run for the first year or so. (Management isn't real fond of IT people constantly asking for upgrade money. Especially nowadays.)


--
Rick
 
Old 05-20-2011, 09:14 AM   #6
onebuck
Moderator
 
Registered: Jan 2005
Location: Midwest USA, Central Illinois
Distribution: SlackwareŽ
Posts: 12,867
Blog Entries: 27

Rep: Reputation: 2162Reputation: 2162Reputation: 2162Reputation: 2162Reputation: 2162Reputation: 2162Reputation: 2162Reputation: 2162Reputation: 2162Reputation: 2162Reputation: 2162
Hi,

Quote:
Originally Posted by rnturn View Post
I had to laugh when I reread your reply. Yep, you could build a system using a single 1TB disk or a slew of SSDs and in each case you would achieve "maximum throughput". For that system configuration. Once upon a time, your system design would have a response time or transaction/sec you were shooting for when N users were using the system, etc. When you failed to hit that, you knew you needed to identify the bottlenecks and make changes to the system.

Every day I see folks submitting change requests for some pretty significant upgrades to systems that were installed only a few months ago. Oracle filesystems filling up after only a couple of months of operation? Crazy requests for RAM? Geez. When you have a 6 month old system and you're asking to double the RAM to 128GB someone's going to wonder how much effort actually went into the initial requirements gathering/analysis/etc. phase of that project.

Hopefully, the OP has been thinking of how the system is going to need to run for the first year or so. (Management isn't real fond of IT people constantly asking for upgrade money. Especially nowadays.)


--
Rick
Personally, I would look beyond the first year for a new sys-gen. Over-sizing is just as bad as under if not done properly. Spanning things across multiple media can be beneficial when done properly is just one example. Ramdisk is another area that is sometimes overlooked but can be used to benefit throughput. I could go on and on but it's not in my job description to perform this action for the OP.

It happens all the time, people think that hitting things from general hardware specifics will meet the needs. Each site has specific requirements and each sys-gen should be setup to meet the local requirements. Both hardware & software should be sized or setup to meet the local requirements. That is where IT should interact with reputable vendors/suppliers.

Yes, from a IT perspective you had better get things right from the start. Or things will roll other than just wheels.
 
Old 05-28-2011, 08:49 AM   #7
jgoulett
LQ Newbie
 
Registered: May 2011
Posts: 2

Original Poster
Rep: Reputation: 0
Thanks!

Thank You All!
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
Ethernet throughput PhoenixofMT General 3 09-07-2007 12:48 AM
calculating throughput ilnli Programming 6 07-17-2007 01:58 AM
throughput in ns-2 bufospro Programming 0 02-23-2007 04:05 AM
LXer: Ten ideas about Ideas LXer Syndicated Linux News 0 11-05-2006 08:21 AM
Network throughput Digiman2k Linux - Networking 11 04-29-2003 08:30 AM

LinuxQuestions.org > Forums > Linux Forums > Linux - Hardware

All times are GMT -5. The time now is 03:39 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration