473,324 Members | 2,511 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 473,324 software developers and data experts.

job scheduling framework?

Has anyone seen a simple open source job-scheduling framework written
in Python? I don't really want to reinvent the wheel. All I need is
the ability to set up a series of atomic "jobs" as a "stream", then
have the system execute the jobs in the stream one-at-a-time until all
the jobs in the stream are complete or one of them reports an error.

(If it tied into a really simple grid-style computing farm, that would
be worth double points!)

-Chris

Sep 8 '05 #1
3 6010
Chris Curvey wrote:
Has anyone seen a simple open source job-scheduling framework written
in Python?


It sounds like BuildBot (http://buildbot.sf.net) might interest you.

It's not exactly meant to be a job control system, but it does have some
nice functionality. It might be interesting to extend it in the
direction you're talking about.
--
Benji York

Sep 8 '05 #2
Google turned up these links that might be of interest:

http://www.foretec.com/python/worksh...session/hoegl/
http://www.webwareforpython.org/Webw...uickStart.html
http://www.slac.stanford.edu/BFROOT/...JM/SJMMain.htm

Larry Bates
Chris Curvey wrote:
Has anyone seen a simple open source job-scheduling framework written
in Python? I don't really want to reinvent the wheel. All I need is
the ability to set up a series of atomic "jobs" as a "stream", then
have the system execute the jobs in the stream one-at-a-time until all
the jobs in the stream are complete or one of them reports an error.

(If it tied into a really simple grid-style computing farm, that would
be worth double points!)

-Chris

Sep 8 '05 #3
Larry Bates wrote:
Google turned up these links that might be of interest:

http://www.foretec.com/python/worksh...session/hoegl/
http://www.webwareforpython.org/Webw...uickStart.html
http://www.slac.stanford.edu/BFROOT/...JM/SJMMain.htm
Larry Bates
Chris Curvey wrote:
Has anyone seen a simple open source job-scheduling framework written
in Python? I don't really want to reinvent the wheel. All I need is
the ability to set up a series of atomic "jobs" as a "stream", then
have the system execute the jobs in the stream one-at-a-time until all
the jobs in the stream are complete or one of them reports an error.

(If it tied into a really simple grid-style computing farm, that would
be worth double points!)


In addition to Larry's links, this might also be of interest:

http://directory.fsf.org/science/visual/Pyslice.html

Not exactly the same, but I suspect it may be useful.

Cheers,

f

Sep 8 '05 #4

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

6
by: Tony Proctor | last post by:
Hi everyone We're experiencing some serious anomalies with the scheduling of ASP threads. I'd be interested to hear if anyone knows what algorithm is used (e.g. simple round-robin, or something...
13
by: Mike | last post by:
Normally scheduling a job is a very elementary operation but for some hidden reason I've been unable to schedule a job which runs on a 28 day cycle, even though I have at least 16 other jobs...
3
by: Muscha | last post by:
Hi, In our application we need to have a high performance scheduling framework. We want to be able to say for item 21 do an update on such and such time. We will have around 1 million items of...
3
by: mirek | last post by:
Hello, My ASP.NET application must have additional functionality which isn't typical for ordinary web use. It is: - connecting to the other server using specified protocol (an option to...
3
by: Alphonse Giambrone | last post by:
Can anyone point me toward a good example of an asp.net scheduling app? Preferrably in vb.net. TIA -- Alphonse Giambrone Email: a-giam at customdatasolutions dot us
1
by: Majed | last post by:
hi I'm planing to make scheduling app and need your advice on the best way to do that,and how to save the tasks to be executed and retrive their data at the right time. your input will be highly...
4
by: Dinsdale | last post by:
I'm looking at adding scheduling features to an application and I wanted to ask the community about any experience with scheduling components, either open source like from code project or from a...
2
Ritchie
by: Ritchie | last post by:
Please can anyone help me with d programs in C for CPU scheduling: WAP to show FCFS scheduling algorithm. WAP to show SJF scheduling algorithm. WAP to show Priority scheduling algorithm. WAP...
1
by: amundsen | last post by:
I need to build a scheduling program. It will need to schedule a chain of resources. I'm wondering if anyone is aware of an existing framework that might help me to code this application. The...
0
by: DolphinDB | last post by:
Tired of spending countless mintues downsampling your data? Look no further! In this article, you’ll learn how to efficiently downsample 6.48 billion high-frequency records to 61 million...
0
isladogs
by: isladogs | last post by:
The next Access Europe meeting will be on Wednesday 6 Mar 2024 starting at 18:00 UK time (6PM UTC) and finishing at about 19:15 (7.15PM). In this month's session, we are pleased to welcome back...
0
by: Vimpel783 | last post by:
Hello! Guys, I found this code on the Internet, but I need to modify it a little. It works well, the problem is this: Data is sent from only one cell, in this case B5, but it is necessary that data...
0
by: jfyes | last post by:
As a hardware engineer, after seeing that CEIWEI recently released a new tool for Modbus RTU Over TCP/UDP filtering and monitoring, I actively went to its official website to take a look. It turned...
0
by: ArrayDB | last post by:
The error message I've encountered is; ERROR:root:Error generating model response: exception: access violation writing 0x0000000000005140, which seems to be indicative of an access violation...
1
by: Defcon1945 | last post by:
I'm trying to learn Python using Pycharm but import shutil doesn't work
0
by: af34tf | last post by:
Hi Guys, I have a domain whose name is BytesLimited.com, and I want to sell it. Does anyone know about platforms that allow me to list my domain in auction for free. Thank you
0
by: Faith0G | last post by:
I am starting a new it consulting business and it's been a while since I setup a new website. Is wordpress still the best web based software for hosting a 5 page website? The webpages will be...
0
isladogs
by: isladogs | last post by:
The next Access Europe User Group meeting will be on Wednesday 3 Apr 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM). In this session, we are pleased to welcome former...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.