473,671 Members | 2,321 Online
Bytes | Software Development & Data Engineering Community
+ Post

Home Posts Topics Members FAQ

Easy to use distributed system?

I am looking for a system in Python that will easily allow me to distribute
processes across multiple systems? So, if I have a function 'foo', I'd
like to be able to call something along the lines of

distribute(foo( x))

And have the system figure out which node is available for process, and then
have the results returned in some sort of callback fashion.

Any insight is greatly appreciated.

--
Jim
http://www.runfatboy.net - Exercise for the rest of us.
Aug 14 '06 #1
4 1377
Jim Jones wrote:
I am looking for a system in Python that will easily allow me to distribute
processes across multiple systems? So, if I have a function 'foo', I'd
like to be able to call something along the lines of

distribute(foo( x))

And have the system figure out which node is available for process, and then
have the results returned in some sort of callback fashion.

Any insight is greatly appreciated.
Sounds like Grid computing. Google for Globus toolkit and ActiveGrid.

Good luck.

Aug 14 '06 #2
Jim Jones wrote:
I am looking for a system in Python that will easily allow me to distribute
processes across multiple systems? So, if I have a function 'foo', I'd
like to be able to call something along the lines of

distribute(foo( x))

And have the system figure out which node is available for process, and then
have the results returned in some sort of callback fashion.

Any insight is greatly appreciated.
Globus toolkit
pyGlobus, python interface to Globus
(http://dsd.lbl.gov/gtg/projects/pyGlobus/)
pyLinda (http://www-users.cs.york.ac.uk/aw/pylinda/)

Cheers
maurice
Aug 14 '06 #3
Jim Jones wrote:
I am looking for a system in Python that will easily allow me to
distribute
processes across multiple systems? So, if I have a function 'foo', I'd
like to be able to call something along the lines of

distribute(foo( x))

And have the system figure out which node is available for process, and
then have the results returned in some sort of callback fashion.

Any insight is greatly appreciated.
I did a little research on this subject not too long ago. From what I've
seen, OpenMosix appears to be about the easiest one for Linux Operating
Systems. Here's the url: http://openmosix.sourceforge.net/

--
--
There are several things that I will never be:
* I will never be attracted to females.
* I will never enjoy the company of others.
Exactly how these realities bode for my enemy, is not of my concern.

Aug 14 '06 #4
I've been using Pyro and it does what I needs it to do for me.

I don't know if it's as fancy as other packages but the price is right.

Jim Jones wrote:
I am looking for a system in Python that will easily allow me to distribute
processes across multiple systems? So, if I have a function 'foo', I'd
like to be able to call something along the lines of

distribute(foo( x))

And have the system figure out which node is available for process, and then
have the results returned in some sort of callback fashion.

Any insight is greatly appreciated.

--
Jim
http://www.runfatboy.net - Exercise for the rest of us.
Aug 14 '06 #5

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

1
6706
by: channa_s | last post by:
Hi, I would be very grateful if anyone could help me with the following. I want to create a SIMPLE distributed database. It is as follows: There is a institution which has branches all over the country offering
7
3996
by: J Goldman | last post by:
I'm looking for documentation pointers to learn what I need to put together a distributed database system. I've read through "Oracle 9i Database Administrator's Guide: Distributed Database Concepts" and Oracle Database Concepts: Introduction to the Oracle Server: Distributed Databases Overview", but I don't see how to do what I want. I would like to set up a distributed database system with location transparency and a shared schema...
0
2453
by: DotNetJunkies User | last post by:
I am writing a distributed transaction code. My current scenario include a client database(Suppose client- having 4 main database) which can be installed anywhere which would connect to a public database placed at ISP datacentre(Suppose Server- having 2 database). this server database is added to client as linked server through vb.net interface. i have a transmission routine which transmitts the data from the client to Server and update client...
1
439
by: Avanish Pandey | last post by:
Hello All We have 3 differen services (in 3 different server) Service A,B,C . We want to implement distributed transaction when call methods of B and C from A. Is it possible? if yes then how? I have read the doc regarding this: http://www.developer.com/net/asp/article.php/3385631 but it will not work when methods are in different services on
39
2583
by: Steven T. Hatton | last post by:
I came across this while looking for information on C++ and CORBA: http://www.zeroc.com/ice.html. It got me to wondering why I need two different languages in order to write distributed computing apps. In the case of CORBA, that means IDL and C++. In the case of ICE, that means slice and C++. Slice actually looks a lot closer to C++ than does IDL. Nonetheless, I'm wondering if there is some fundamental limitation in C++ which precludes...
0
1627
by: SoftComplete Development | last post by:
AlphaTIX is a powerful, fast, scalable and easy to use Full Text Indexing and Retrieval library that will completely satisfy your application's indexing and retrieval needs. AlphaTIX indexing technology provides you with highest indexing performance, possibility to index very large sets of data in minimal time even with memory constraints and unbelievable fast query processing speed. The main AlphaTIX's feature that makes it first and...
8
3642
by: Rob S | last post by:
I have UDB 8.1 Personal Edition installed. I'm using Development centre to develop JAVA Stored Procedues. I am unable to debug them. I have installed IBM Distributed Debugger and have set DB2ROUTINE_DEBUG=ON. I installed Distributed Debugger after UDB. The Procs will build with debug but no debugger window appears when run in debug mode. I followed the instructions that came with Debugger regarding the installation directory etc.
1
3002
by: Rhino | last post by:
Is there any way to install the IBM Distributed Debugger V9.2 on Windows XP without first uninstalling DB2? I installed the IBM Distributed Debugger V9.2 on my Windows XP box in the hopes of debugging a Java stored procedure. Well, I never got the debugger to work despite my best efforts - see posts earlier this week - so now I'd like to uninstall the debugger. I looked into this but the README says: 3.1 Uninstalling on Windows
8
4359
by: Don Riesbeck Jr. | last post by:
I have an C# EnterpriseService component that is part of an application I am developing that is responsible for writing data to an SQL Server. (it reads from a local DB (MSDE), then writes to a 'remote' DB (SQL Server 2k)...) On some machines I get the following exception: System.InvalidOperationException: An error occurred while enlisting in a distributed transaction. at...
5
1632
by: Martin Drautzburg | last post by:
Hello all, I've seen various attempts to add distributed computing capabilities on top of an existing language. For a true distributed system I would expect it to be possible to instantiate objects of a remote class or to subclass a remote class and other stuff like this. My impression is that those things are difficult when built on top of an existing language. Since the paradigm "everything is an object" pays so well, I thought it...
0
8478
marktang
by: marktang | last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However, people are often confused as to whether an ONU can Work As a Router. In this blog post, we’ll explore What is ONU, What Is Router, ONU & Router’s main usage, and What is the difference between ONU and Router. Let’s take a closer look ! Part I. Meaning of...
0
8397
by: Hystou | last post by:
Most computers default to English, but sometimes we require a different language, especially when relocating. Forgot to request a specific language before your computer shipped? No problem! You can effortlessly switch the default language on Windows 10 without reinstalling. I'll walk you through it. First, let's disable language synchronization. With a Microsoft account, language settings sync across devices. To prevent any complications,...
1
8599
by: Hystou | last post by:
Overview: Windows 11 and 10 have less user interface control over operating system update behaviour than previous versions of Windows. In Windows 11 and 10, there is no way to turn off the Windows Update option using the Control Panel or Settings app; it automatically checks for updates and installs any it finds, whether you like it or not. For most users, this new feature is actually very convenient. If you want to control the update process,...
0
8670
tracyyun
by: tracyyun | last post by:
Dear forum friends, With the development of smart home technology, a variety of wireless communication protocols have appeared on the market, such as Zigbee, Z-Wave, Wi-Fi, Bluetooth, etc. Each protocol has its own unique characteristics and advantages, but as a user who is planning to build a smart home system, I am a bit confused by the choice of these technologies. I'm particularly interested in Zigbee because I've heard it does some...
0
7439
agi2029
by: agi2029 | last post by:
Let's talk about the concept of autonomous AI software engineers and no-code agents. These AIs are designed to manage the entire lifecycle of a software development project—planning, coding, testing, and deployment—without human intervention. Imagine an AI that can take a project description, break it down, write the code, debug it, and then launch it, all on its own.... Now, this would greatly impact the work of software developers. The idea...
1
6230
isladogs
by: isladogs | last post by:
The next Access Europe User Group meeting will be on Wednesday 1 May 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM). In this session, we are pleased to welcome a new presenter, Adolph Dupré who will be discussing some powerful techniques for using class modules. He will explain when you may want to use classes instead of User Defined Types (UDT). For example, to manage the data in unbound forms. Adolph will...
0
4225
by: TSSRALBI | last post by:
Hello I'm a network technician in training and I need your help. I am currently learning how to create and manage the different types of VPNs and I have a question about LAN-to-LAN VPNs. The last exercise I practiced was to create a LAN-to-LAN VPN between two Pfsense firewalls, by using IPSEC protocols. I succeeded, with both firewalls in the same network. But I'm wondering if it's possible to do the same thing, with 2 Pfsense firewalls...
0
4409
by: adsilva | last post by:
A Windows Forms form does not have the event Unload, like VB6. What one acts like?
2
1810
bsmnconsultancy
by: bsmnconsultancy | last post by:
In today's digital era, a well-designed website is crucial for businesses looking to succeed. Whether you're a small business owner or a large corporation in Toronto, having a strong online presence can significantly impact your brand's success. BSMN Consultancy, a leader in Website Development in Toronto offers valuable insights into creating effective websites that not only look great but also perform exceptionally well. In this comprehensive...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.