LinuxQuestions.org
Register a domain and help support LQ
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Newbie
User Name
Password
Linux - Newbie This Linux forum is for members that are new to Linux.
Just starting out and have a question? If it is not in the man pages or the how-to's this is the place!

Notices


Reply
  Search this Thread
Old 03-18-2015, 05:28 PM   #1
stefan.andritoiu
LQ Newbie
 
Registered: Mar 2015
Posts: 3

Rep: Reputation: Disabled
Gang Scheduling in Linux (or FreeBSD)


Hi, does anyone know if gang scheduling is implemented in Linux? And if so, can you recommend any books/articles/site where I can learn more about it? I am trying to implement it on FreeBSD, so if anyone has any information about that, it would be very helpful

Thank you!
 
Old 03-21-2015, 02:00 AM   #2
dijetlo
Senior Member
 
Registered: Jan 2009
Location: RHELtopia....
Distribution: Solaris 11.2/Slackware/RHEL/
Posts: 1,307
Blog Entries: 2

Rep: Reputation: Disabled
Stefan, I don't mean to be a naysayer, but is gang scheduling even implemented at the kernel level?
It was an interesting question, I'd like to thank you for pointing out the concept of "gang scheduling" in distributed computing to me and the rest of the readers but a short review of some documentation (mostly the Wikipedia page) suggests to me that the local kernel level scheduling is probably SCHED_BATCH and "gang" is something the cluster software is handling.
If I'm wrong, I apologize, but to the best of my knowledge, Linux doesn't give you that option (I only know of 5 sched modes SCHED_RR, SCHED_FIFO, SCHED_BATCH, SCHED_IDLE and SCHED_OTHER *other uses CFS or the Completely Fair Scheduler).
 
Old 03-21-2015, 05:02 PM   #3
jpollard
Senior Member
 
Registered: Dec 2012
Location: Washington DC area
Distribution: Fedora, CentOS, Slackware
Posts: 4,604

Rep: Reputation: 1241Reputation: 1241Reputation: 1241Reputation: 1241Reputation: 1241Reputation: 1241Reputation: 1241Reputation: 1241Reputation: 1241
The general definition of gang scheduling is inefficient for a single processor, even in an SMP operation. It requires all processors to delay until they all reach a sync point- causing wasted CPU time waiting for the other processors.

You CAN do it in a SMP mode very easily - but you have to have a counting semaphore that all processes are waiting for, then the locking process can release the lock and all processes resume.

It is also inefficient in SMP as the various threads will have different page fault/IO activity that causes them to get out of sync - which reindroduces wasted CPU time.

In a distributed system/cluster, gang scheduling is handled by the job scheduler - but even then, it isn't rigid. All nodes are given work to do, and the results collected - and more work could be sent out. It works, but is a bit on the inefficient side as it requires a lot of message passing - which allows the nodes to get out of sync again.
 
2 members found this post helpful.
Old 03-21-2015, 07:39 PM   #4
syg00
LQ Veteran
 
Registered: Aug 2003
Location: Australia
Distribution: Lots ...
Posts: 14,843

Rep: Reputation: 1823Reputation: 1823Reputation: 1823Reputation: 1823Reputation: 1823Reputation: 1823Reputation: 1823Reputation: 1823Reputation: 1823Reputation: 1823Reputation: 1823
Searching found this reference. As it happens I was at that conference, but didn't attend that paper. Should be online as a video.
 
2 members found this post helpful.
Old 03-29-2015, 08:41 PM   #5
stefan.andritoiu
LQ Newbie
 
Registered: Mar 2015
Posts: 3

Original Poster
Rep: Reputation: Disabled
Quote:
Originally Posted by syg00 View Post
Searching found this reference. As it happens I was at that conference, but didn't attend that paper. Should be online as a video.
If anyone is interested, I have posted the video. It's very good for a general understanding of Gang Scheduling, but not as to how it is implemented

https://www.youtube.com/watch?v=4SdzmT9gfQI
 
1 members found this post helpful.
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
gang scheduling in linux jeffwang6668 Linux - Kernel 1 05-15-2013 10:04 PM
LXer: Linux vendors gang up for enterprise LXer Syndicated Linux News 0 02-19-2007 09:16 PM
Newish member/Linux Noob - hi to a great gang! bberrign LinuxQuestions.org Member Intro 2 04-26-2006 11:33 PM
To the Linux Gang and Especially that finegan guy B McHack LinuxQuestions.org Member Intro 4 06-24-2003 12:43 AM


All times are GMT -5. The time now is 06:36 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration