Linux Job Scheduler???
I've recently moved from IRIX to Linux (SUSE) and found the default job scheduler (at or batch, via atd) to be woefully inadequate. The IRIX "at" and "batch" used cron and a queue definition (queuedefs) that worked pretty well at throttling background processes.
I am familiar with cron and use it extensively to run regularly scheduled scripts. I'm talking about a slightly different situation than that. We have an application that submits jobs (bash shell scripts that mainly run reports) on demand via the "batch" command. On IRIX, this was basically an extension of cron, with the added ability to throttle the number of jobs simultaneous running, as well as the priority, aka nice. Since the jobs were submitted by multiple users in an uncoordinated way, it gave me the ability to control how many process ran in the background. I could open it up as wide as I wanted or shut it down completely. The Linux implementation works slightly different. Instead of explicitly controlling the number of jobs, it uses system load average. That is too simplistic, as there are other resource choke points than cpu utilization.
With all that being said. I was hoping that someone had experience with some of the open source job schedulers out there. In other words I was hoping to learn from someone else's pain as to what works and what doesn't.
Does anyone have a suggestion on a job, or process, scheduler for Linux?
Last edited by mrbarritt; 09-27-2010 at 02:34 PM.