LinuxQuestions.org
Visit Jeremy's Blog.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Software
User Name
Password
Linux - Software This forum is for Software issues.
Having a problem installing a new program? Want to know which application is best for the job? Post your question in this forum.

Notices

Reply
 
Search this Thread
Old 09-27-2010, 01:28 PM   #1
mrbarritt
LQ Newbie
 
Registered: Nov 2009
Location: Castle Rock, Co
Distribution: SUSE Enterprise 11
Posts: 3

Rep: Reputation: 0
Linux Job Scheduler???


I've recently moved from IRIX to Linux (SUSE) and found the default job scheduler (at or batch, via atd) to be woefully inadequate. The IRIX "at" and "batch" used cron and a queue definition (queuedefs) that worked pretty well at throttling background processes.

I am familiar with cron and use it extensively to run regularly scheduled scripts. I'm talking about a slightly different situation than that. We have an application that submits jobs (bash shell scripts that mainly run reports) on demand via the "batch" command. On IRIX, this was basically an extension of cron, with the added ability to throttle the number of jobs simultaneous running, as well as the priority, aka nice. Since the jobs were submitted by multiple users in an uncoordinated way, it gave me the ability to control how many process ran in the background. I could open it up as wide as I wanted or shut it down completely. The Linux implementation works slightly different. Instead of explicitly controlling the number of jobs, it uses system load average. That is too simplistic, as there are other resource choke points than cpu utilization.

With all that being said. I was hoping that someone had experience with some of the open source job schedulers out there. In other words I was hoping to learn from someone else's pain as to what works and what doesn't.

Does anyone have a suggestion on a job, or process, scheduler for Linux?

Last edited by mrbarritt; 09-27-2010 at 01:34 PM. Reason: grammar
 
Old 09-27-2010, 04:43 PM   #2
syg00
LQ Veteran
 
Registered: Aug 2003
Location: Australia
Distribution: Lots ...
Posts: 12,198

Rep: Reputation: 1014Reputation: 1014Reputation: 1014Reputation: 1014Reputation: 1014Reputation: 1014Reputation: 1014Reputation: 1014
Unlike Unix, on Linux loadavg is not just the runqueue. It incorporates tasks in uninterruptable sleep. Usually tasks waiting (disk) I/O, but not necessarily - children can be marked uninterruptable sleep as well - hopefully for (very) short periods. So I guess the concept is to allow a system managed control rather than the admin having to monitor it.
Not saying it's great (as I don't use it), but is likely to be more dynamic than you appear to crediting it.
 
Old 09-27-2010, 04:54 PM   #3
mrbarritt
LQ Newbie
 
Registered: Nov 2009
Location: Castle Rock, Co
Distribution: SUSE Enterprise 11
Posts: 3

Original Poster
Rep: Reputation: 0
Thanks for the info on 'loadavg', I see your point on system monitoring, but I as I stated in our environment there are other choke points than even this understanding can account for.
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
I need a job scheduler (for shell scripts) for Red Hat AS 4, suggestions? Luism Linux - Enterprise 2 04-11-2008 01:33 PM
FC1 job Scheduler problem - "at" command doesnt wrk linfreak Fedora 2 01-08-2006 03:12 AM


All times are GMT -5. The time now is 03:57 AM.

Main Menu
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
identi.ca: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration