By using this site, you agree to our updated Privacy Policy and our Terms of Use. Manage your Cookies Settings.
444,199 Members | 1,077 Online
Bytes IT Community
+ Ask a Question
Need help? Post your question and get tips & solutions from a community of 444,199 IT Pros & Developers. It's quick & easy.

Does python is suitable for enterprise cluster management?

P: n/a
Is anyone familiar or aware of a successful enterprise class project
in Python to control and monitor a cluster of computers?

As a part of a bigger project my company needs to build a cluster
management system. The aim of the system is to control and synchronize
applications. Namely, a central management will get events from the
remote applications and from a user and will react with commands to
the applications.
Existing tools donít fit our requirements, so we will have to write it
ourselves.
We are currently pondering which programming language will best suite
us. The two major contenders are Python and Java.

Some requirements:
1. Cluster size is about 100 nodes. Only few applications per node.
2. Database interface.
3. Rate of messages: Few hundred messages per second at peak time.
4. External web application for control (only few users)
5. RPC between the management system to application written in c.
6. The whole system will run within a LAN, and the required
responsiveness latency should be no more than 1sec.

There are probably some more requirements which are common for cluster
management systems.

We are currently looking for success stories of a similar projects
done in Python. It will be great if someone could point me to a
success story. It will be even better if I could talk with someone
which was involved in such a project.

Thanks,
Asaf
Nov 16 '08 #1
Share this Question
Share on Google+
4 Replies


P: n/a
Asaf Hayman wrote:
Is anyone familiar or aware of a successful enterprise class project
in Python to control and monitor a cluster of computers?

As a part of a bigger project my company needs to build a cluster
management system. The aim of the system is to control and synchronize
applications. Namely, a central management will get events from the
remote applications and from a user and will react with commands to
the applications.
Existing tools donít fit our requirements, so we will have to write it
ourselves.
We are currently pondering which programming language will best suite
us. The two major contenders are Python and Java.

Some requirements:
1. Cluster size is about 100 nodes. Only few applications per node.
2. Database interface.
3. Rate of messages: Few hundred messages per second at peak time.
4. External web application for control (only few users)
5. RPC between the management system to application written in c.
6. The whole system will run within a LAN, and the required
responsiveness latency should be no more than 1sec.

There are probably some more requirements which are common for cluster
management systems.

We are currently looking for success stories of a similar projects
done in Python. It will be great if someone could point me to a
success story. It will be even better if I could talk with someone
which was involved in such a project.
http://www.zenoss.com/ ?

regards
Steve
--
Steve Holden +1 571 484 6266 +1 800 494 3119
Holden Web LLC http://www.holdenweb.com/

Nov 16 '08 #2

P: n/a
Asaf Hayman:
We are currently pondering which programming language will best suite
us. The two major contenders are Python and Java.
I think there is also Erlang for such kind of things.

Bye,
bearophile
Nov 16 '08 #3

P: n/a
In article <a2**********************************@k1g2000prb.g ooglegroups.com>,
Asaf Hayman <as********@gmail.comwrote:
>
Is anyone familiar or aware of a successful enterprise class project
in Python to control and monitor a cluster of computers?
Ever heard of Google? ;-)
--
Aahz (aa**@pythoncraft.com) <* http://www.pythoncraft.com/

"It is easier to optimize correct code than to correct optimized code."
--Bill Harlan
Nov 16 '08 #4

P: n/a
On Nov 16, 8:56*am, Asaf Hayman <asafhay...@gmail.comwrote:
Is anyone familiar or aware of a successful enterprise class project
in Python to control and monitor a cluster of computers?

As a part of a bigger project my company needs to build a cluster
management system. The aim of the system is to control and synchronize
applications. Namely, a central management will get events from the
remote applications and from a user and will react with commands to
the applications.
Existing tools donít fit our requirements, so we will have to write it
ourselves.
We are currently pondering which programming language will best suite
us. The two major contenders are Python and Java.

Some requirements:
1. Cluster size is about 100 nodes. Only few applications per node.
2. Database interface.
3. Rate of messages: Few hundred messages per second at peak time.
4. External web application for control (only few users)
5. RPC between the management system to application written in c.
6. The whole system will run within a LAN, and the required
responsiveness latency should be no more than 1sec.

There are probably some more requirements which are common for cluster
management systems.

We are currently looking for success stories of a similar projects
done in Python. It will be great if someone could point me to a
success story. It will be even better if I could talk with someone
which was involved in such a project.

Thanks,
Asaf
Not sure if http://pypi.python.org/pypi/Fabric/0.0.3 is what you need
or not; maybe that in concert with Nagios.
Nov 18 '08 #5

This discussion thread is closed

Replies have been disabled for this discussion.