LinuxQuestions.org
Latest LQ Deal: Latest LQ Deals
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Hardware
User Name
Password
Linux - Hardware This forum is for Hardware issues.
Having trouble installing a piece of hardware? Want to know if that peripheral is compatible with Linux?

Notices


Reply
  Search this Thread
Old 06-02-2016, 11:21 AM   #1
usao
Member
 
Registered: Dec 2011
Location: Chandler, AZ
Posts: 286

Rep: Reputation: Disabled
What's the most powerful non-clustered supercomputer?


Seems almost all the top500 supercomputers are clusters of thousands of individual systems, which require parallelized software to run in a clustered configuration.
Wondering what is the most powerful monolithic (aka non-clustered) supercomputer out there today?
Pick your favorite benchmark, just wondering how powerful a single system can be without resorting to clustering.
 
Old 06-03-2016, 11:59 AM   #2
smallpond
Senior Member
 
Registered: Feb 2011
Location: Massachusetts, USA
Distribution: Fedora
Posts: 4,138

Rep: Reputation: 1263Reputation: 1263Reputation: 1263Reputation: 1263Reputation: 1263Reputation: 1263Reputation: 1263Reputation: 1263Reputation: 1263
Is a blade server 1 system or 14 systems?
 
Old 06-03-2016, 12:03 PM   #3
sundialsvcs
LQ Guru
 
Registered: Feb 2004
Location: SE Tennessee, USA
Distribution: Gentoo, LFS
Posts: 10,649
Blog Entries: 4

Rep: Reputation: 3934Reputation: 3934Reputation: 3934Reputation: 3934Reputation: 3934Reputation: 3934Reputation: 3934Reputation: 3934Reputation: 3934Reputation: 3934Reputation: 3934
I started to tell you, but then I noticed that people were pausing outside my office window. They were driving curiously-large black trucks and wearing sunglasses, and there seemed to be a funny bulge inside of their gray suit-coats. So, I decided against it.
 
Old 06-03-2016, 04:30 PM   #4
Doug G
Member
 
Registered: Jul 2013
Posts: 749

Rep: Reputation: Disabled
Check this out: http://www.networkworld.com/article/...th.html#slide2
 
Old 06-03-2016, 05:48 PM   #5
jpollard
Senior Member
 
Registered: Dec 2012
Location: Washington DC area
Distribution: Fedora, CentOS, Slackware
Posts: 4,912

Rep: Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513
Quote:
Originally Posted by smallpond View Post
Is a blade server 1 system or 14 systems?
I believe they are treated as a cluster of 14 nodes...
 
Old 06-03-2016, 06:09 PM   #6
jpollard
Senior Member
 
Registered: Dec 2012
Location: Washington DC area
Distribution: Fedora, CentOS, Slackware
Posts: 4,912

Rep: Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513
Quote:
Originally Posted by usao View Post
Seems almost all the top500 supercomputers are clusters of thousands of individual systems, which require parallelized software to run in a clustered configuration.
Wondering what is the most powerful monolithic (aka non-clustered) supercomputer out there today?
Pick your favorite benchmark, just wondering how powerful a single system can be without resorting to clustering.
None of them.

The problem is the architecture.

All current processors have a single bus to memory (even the multi-core processors still only have a single bus). SOMETIMES that single bus is multiplexed to memory (which is why you have to install DIMMs in pairs). The one apparent exception is the IBM Power line (Power7 appears to have 3 memory buses).

NONE of them have a good memory bus OR a good I/O bus.

To gain speed the only solution currently available is to give each processor (or multi-core) its own private memory, and its own private I/O bus. On top of that you then have to add custom interfaces... specifically a high speed inter-node communication bus (which by the way, can saturate the private I/O bus quite easily). But now you are in the realm of multi-node clustering.

The fastest single core CPU is likely the IBM Power 8... which always comes in multi-core packages used in SMP (an 4,6,8,12 core hyperthreaded units for up to 96 parallel threads). The memory controllers use three buses (two read, one write) to aggregate memory memory speed (40 ns latency). https://en.wikipedia.org/wiki/POWER8

But for supercomputer use, it STILL takes clustering to produce the throughput...

Last edited by jpollard; 06-03-2016 at 06:11 PM.
 
Old 06-03-2016, 06:14 PM   #7
jlliagre
Moderator
 
Registered: Feb 2004
Location: Outside Paris
Distribution: Solaris 11.4, Oracle Linux, Mint, Debian/WSL
Posts: 9,789

Rep: Reputation: 492Reputation: 492Reputation: 492Reputation: 492Reputation: 492
All supercomputers in the top 10 or top 100 lists are heavily clustered systems. There is however a market for non clustered supercomputers, i.e. systems where a single operating system instance is able to manage the whole hardware (CPU and RAM) and a single multithreaded process is able to use all the CPU cores and threads available. At least Oracle, Fujitsu, IBM and possibly still HPE compete here.

An Oracle SPARC M7-16 is a single monolithic computer with 8 TB or RAM, 512 x 4.13GHz cores / 4096 threads. The M7 series architecture is designed to support up to 64 sockets (i.e. 2048 cores / 16384 threads) and 32 TB of RAM, but there is not (yet?) such a machine on the catalog. There are also the Fujitsu M10-4s with up to 1024 x 3.7 GHz cores / 2048 threads and up to 32 TB of RAM and the IBM Power 8 E880 with 192 4 GhZ cores / 1536 threads and up to 32 TB of RAM. I'm not sure about what HPE biggest monolithic server is.

Last edited by jlliagre; 06-03-2016 at 06:19 PM.
 
Old 06-03-2016, 06:37 PM   #8
jpollard
Senior Member
 
Registered: Dec 2012
Location: Washington DC area
Distribution: Fedora, CentOS, Slackware
Posts: 4,912

Rep: Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513
Quote:
Originally Posted by jlliagre View Post
All supercomputers in the top 10 or top 100 lists are heavily clustered systems. There is however a market for non clustered supercomputers, i.e. systems where a single operating system instance is able to manage the whole hardware (CPU and RAM) and a single multithreaded process is able to use all the CPU cores and threads available. At least Oracle, Fujitsu, IBM and possibly still HPE compete here.

An Oracle SPARC M7-16 is a single monolithic computer with 8 TB or RAM, 512 x 4.13GHz cores / 4096 threads. The M7 series architecture is designed to support up to 64 sockets (i.e. 2048 cores / 16384 threads) and 32 TB of RAM, but there is not (yet?) such a machine on the catalog. There are also the Fujitsu M10-4s with up to 1024 x 3.7 GHz cores / 2048 threads and up to 32 TB of RAM and the IBM Power 8 E880 with 192 4 GhZ cores / 1536 threads and up to 32 TB of RAM. I'm not sure about what HPE biggest monolithic server is.
512 cores is no longer "non clustered". It is SMP... but that also requires parallel programming for maximum throughput.

But a single core Power8 beats it quite handily.
 
Old 06-03-2016, 07:03 PM   #9
jlliagre
Moderator
 
Registered: Feb 2004
Location: Outside Paris
Distribution: Solaris 11.4, Oracle Linux, Mint, Debian/WSL
Posts: 9,789

Rep: Reputation: 492Reputation: 492Reputation: 492Reputation: 492Reputation: 492
I agree these servers low level architecture is providing a distributed infrastructure that can be described as a non uniform cluster of interconnected cores where memory locality matters. There is however quite a big difference between cluster based parallel software where plenty of operating systems and processes need to communicate and cooperate together and traditional multi-threading where everything can be done in a single process using a single memory space.

My understanding is the OP is asking about the latter and not about single core performance.
 
Old 06-03-2016, 07:33 PM   #10
jpollard
Senior Member
 
Registered: Dec 2012
Location: Washington DC area
Distribution: Fedora, CentOS, Slackware
Posts: 4,912

Rep: Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513
Quote:
Originally Posted by jlliagre View Post
I agree these servers low level architecture is providing a distributed infrastructure that can be described as a non uniform cluster of interconnected cores where memory locality matters. There is however quite a big difference between cluster based parallel software where plenty of operating systems and processes need to communicate and cooperate together and traditional multi-threading where everything can be done in a single process using a single memory space.

My understanding is the OP is asking about the latter and not about single core performance.
You could be right. In which case the Power8 is still top.

Even in SMP you have to have multiple processes that need to cooperate rather than "a single process using a single memory space", which I interpreted as a single thread.
 
Old 06-03-2016, 08:52 PM   #11
jlliagre
Moderator
 
Registered: Feb 2004
Location: Outside Paris
Distribution: Solaris 11.4, Oracle Linux, Mint, Debian/WSL
Posts: 9,789

Rep: Reputation: 492Reputation: 492Reputation: 492Reputation: 492Reputation: 492
A single process using a single memory space doesn't need to be single threaded, it certainly can be heavily multi threaded. All of these servers do support large scale SMT applications. (https://en.wikipedia.org/wiki/Multit...r_architecture).

About which CPU leads, these blogs differ from your claim: One SPARC beats two Power8 and SPARC T7-1 Delivers 1-Chip World Records for SPEC CPU2006 Rate Benchmarks but I must disclose I'm biased, being in the SPARC side since a couple of decades...
 
Old 06-04-2016, 05:40 AM   #12
jpollard
Senior Member
 
Registered: Dec 2012
Location: Washington DC area
Distribution: Fedora, CentOS, Slackware
Posts: 4,912

Rep: Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513
Oracle is biased... the processor compared was one of the slower Power8 models in 2006 IBM has made the fastest for quite some time. (Power8 can run at 5GHz, and the Z series can reach 5.5).

But it doesn't matter that much anyway - the cost of any of these is sky high...

Last edited by jpollard; 06-04-2016 at 05:43 AM.
 
Old 06-04-2016, 08:30 AM   #13
syg00
LQ Veteran
 
Registered: Aug 2003
Location: Australia
Distribution: Lots ...
Posts: 21,120

Rep: Reputation: 4120Reputation: 4120Reputation: 4120Reputation: 4120Reputation: 4120Reputation: 4120Reputation: 4120Reputation: 4120Reputation: 4120Reputation: 4120Reputation: 4120
Companies have been fudging benchmarks forever. Barely worth spit.
 
  


Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
Need to create a clustered environment umar khan Linux - Software 1 10-10-2015 04:12 PM
Clustered filesystem GFS2 Thunderw Linux - Server 2 03-10-2014 03:49 AM
LXer: The World’s Most Powerful Climate Change Supercomputer Powers Up LXer Syndicated Linux News 6 10-18-2012 10:38 AM
LXer: Bull to Supply the Most Powerful Civil Supercomputer in France to the CCRT, the Center for Research and Technology Computing LXer Syndicated Linux News 0 12-11-2006 02:03 PM
Linux Clustered Servers Kaykay Linux - Hardware 8 04-10-2006 11:49 PM

LinuxQuestions.org > Forums > Linux Forums > Linux - Hardware

All times are GMT -5. The time now is 02:28 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration