LinuxQuestions.org
Latest LQ Deal: Latest LQ Deals
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Software
User Name
Password
Linux - Software This forum is for Software issues.
Having a problem installing a new program? Want to know which application is best for the job? Post your question in this forum.

Notices


Reply
  Search this Thread
Old 02-01-2020, 10:45 AM   #1
bmxakias
Member
 
Registered: Jan 2016
Posts: 233

Rep: Reputation: Disabled
Question Looking for software for a cluster of 100 computers


Hello

I am looking in general for software that i will be able to use for a cluster of 100 computers. Maybe something related to health or anything else?

Please let me know some ideas on software that will help to use that cluster to be useful for something...

Maybe something related to AI or Neural networks also?

Looking for ready to use solutions or at least easy to build...

Thank you

Last edited by bmxakias; 02-01-2020 at 01:54 PM.
 
Old 02-01-2020, 01:58 PM   #3
bmxakias
Member
 
Registered: Jan 2016
Posts: 233

Original Poster
Rep: Reputation: Disabled
Thanks for your reply

What i am asking is software that i can use for an already cluster setup and not how to setup a cluster....

I am looking for software that has the capability to use many computers at once...
 
Old 02-01-2020, 09:51 PM   #4
berndbausch
Senior Member
 
Registered: Nov 2013
Location: Tokyo
Distribution: A few
Posts: 4,284

Rep: Reputation: 1220Reputation: 1220Reputation: 1220Reputation: 1220Reputation: 1220Reputation: 1220Reputation: 1220Reputation: 1220Reputation: 1220
A few suggestions:

Big data: Hadoop.
Cloud: OpenStack.
Containers: Kubernetes. Apache Mesos.
Massively scalable storage: Ceph. OpenStack Swift.
Donation: Give it to me.

OpenStack, by the way, includes support for all of the above (except Donation). OpenStack Sahara for big data, OpenStack Magnum for managing container clusters, and OpenStack Swift as mentioned.

EDIT: I just realize that none of these are likely to be applications in your sense. So the only option is Donation, I am afraid.

Last edited by berndbausch; 02-01-2020 at 09:53 PM.
 
1 members found this post helpful.
Old 02-01-2020, 10:04 PM   #5
Turbocapitalist
Senior Member
 
Registered: Apr 2005
Distribution: Linux Mint, Devuan, OpenBSD
Posts: 4,554
Blog Entries: 3

Rep: Reputation: 2284Reputation: 2284Reputation: 2284Reputation: 2284Reputation: 2284Reputation: 2284Reputation: 2284Reputation: 2284Reputation: 2284Reputation: 2284Reputation: 2284
Quote:
Originally Posted by bmxakias View Post
What i am asking is software that i can use for an already cluster setup and not how to setup a cluster....
As I understand it, that depends on the details of the work flow and which parts have commutative properties. Which language or languages are you programming this in? Or if you are able to share more about your task, please do so as well.
 
Old 02-02-2020, 07:26 AM   #6
bmxakias
Member
 
Registered: Jan 2016
Posts: 233

Original Poster
Rep: Reputation: Disabled
The general concept is to try to find software that will be able to work on a cluster and get use all Cpu's/ or Gpu's...

For what to do i don't have something specific but it will be good to be something that will help a small community like health related, mathematics, physics, chemistry, or anything that can be useful and be coded in Python maybe...

Any kind of software that can use all Cpu's or Gpu's in parallel as a starting point now is fine !!!

Thanks
 
Old 02-02-2020, 07:30 AM   #7
Turbocapitalist
Senior Member
 
Registered: Apr 2005
Distribution: Linux Mint, Devuan, OpenBSD
Posts: 4,554
Blog Entries: 3

Rep: Reputation: 2284Reputation: 2284Reputation: 2284Reputation: 2284Reputation: 2284Reputation: 2284Reputation: 2284Reputation: 2284Reputation: 2284Reputation: 2284Reputation: 2284
Well, the task description is too vague. :\ There are many things which can run nicely parallel and many that cannot.

However, just to throw out some random ideas regarding GPUs, it can help somewhat with certain statistical calculations:

http://www.r-tutor.com/gpu-computing

https://cran.r-project.org/web/views...Computing.html
 
1 members found this post helpful.
Old 02-03-2020, 03:41 PM   #8
jefro
Moderator
 
Registered: Mar 2008
Posts: 19,628

Rep: Reputation: 3052Reputation: 3052Reputation: 3052Reputation: 3052Reputation: 3052Reputation: 3052Reputation: 3052Reputation: 3052Reputation: 3052Reputation: 3052Reputation: 3052
Sun Computer company had a way to send any common task to the cluster but I haven't seen any mention of that system since it was sold.

https://www.ibm.com/downloads/cas/Q1JAMJK5 for clues to the IBM clusters on risc/power systems.

Rocks cluster has been around for ages. The issue with all of this is the type of work is most common. You need a massive task and that task has to be able to be cut into parts.

https://en.wikipedia.org/wiki/HPCC

Last edited by jefro; 02-03-2020 at 03:42 PM.
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
[SOLVED] Installing software on 100 computers at once validator456 Linux - Newbie 3 02-05-2015 05:13 AM
Create N+1 cluster in redhat using redhat cluster software ranadeep Linux - Enterprise 2 04-03-2010 08:45 PM
Looking for software to back up all of my computers to my Linux Server? Renfro Linux - Software 2 02-13-2004 09:02 PM
me wants cluster me wants cluster me wants cluster funkymunky Linux - Networking 3 01-06-2004 07:51 AM

LinuxQuestions.org > Forums > Linux Forums > Linux - Software

All times are GMT -5. The time now is 07:27 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration