473,473 Members | 2,243 Online
Bytes | Software Development & Data Engineering Community
Create Post

Home Posts Topics Members FAQ

help with concurrency control (threads/processes & signals)

Hi,

I am working on an application which involves
interprocess communication. More to the point,
processes should be able to notify other processes
about certain situations, so the "notifyees" would be
able to act in certain ways.

As processes are distributed on several machines, in
different physical locations, my thinking was:
a) set a message manager (MM)
b) all the participants will register with MM, so MM
will have their host address and their pid on host
c) when someone needs to send a notification, it is
sent to MM, and MM it's doing the job

To start with, I created processes, psrv.py and
clnt.py, and tried to sketch the above scenario.

Here is the server, psrv.py:
#! /usr/bin/python

from socket import *
from os import *
from signal import *
from cPickle import *
#import pdb
import thread

#pdb.set_trace()

def process(ms):
global c,regtab,mssgs
print 'ms[0]=',ms[0]
if ms[0]=='0':
regtab.append(ms[1])
mssgs.append([])
elif ms[0]=='1':
for i in range(len(regtab)):
mssgs[i].append(ms[1])
kill(regtab[i],SIGUSR1)
elif ms[0]=='2':
for i in range(len(regtab)):
if regtab[i]!=ms[2]:
mssgs[i].append(ms[1])
kill(regtab[i],SIGUSR1)
elif ms[0]=='3':
print 'executing ms[0]==3'
for i in range(len(regtab)):
if regtab[i]==ms[1]:
c,p=s.accept()
for j in mssgs[i]:
c.send(dumps(j,True))
c.close()
print 'connection closed'

regtab=[]
mssgs=[]

s=socket()
s.bind(('127.0.0.1',9691))
s.listen(5)

while True:
print 'listening ...'
c,p=s.accept()
while True:
m=c.recv(1024)
if not m: break
ms=loads(m)
c.close()

thread.start_new_thread(process,(ms,))
# ************************************************** *

And here is the client side, clnt.py:
#! /usr/bin/python

from socket import *
from os import *
from signal import *
from cPickle import *
#import pdb

#pdb.set_trace()

def k3(a,b):
print 'Executing k3'
s=socket()
s.connect(('127.0.0.1',9691))
s.send(dumps(('3',getpid()),True))
while True:
print '"3" sent'
m1=s.recv(1024)
print m1
if not m1: break
m=loads(m1)
s.close()
print 'connection closed in k3'
print 'm is ',m

signal(SIGUSR1,k3)

m=''
k=raw_input()
while k!='4':
s=socket()
s.connect(('127.0.0.1',9691))
if k=='0':
s.send(dumps(('0',getpid()),True))
elif k=='1':
s.send(dumps(('1','For all'),True))
elif k=='2':
s.send(dumps(('2','For some',getpid()),True))
elif k=='3':
s.send(dumps(('3',getpid()),True))
while True:
m1=s.recv(1024)
if not m1: break
m=loads(m1)
s.close()
print 'connection closed in main'
print 'm is',m
k=raw_input()
# ************************************************** *
Comments: Clients register themselves with server by
sending a message of type '0'. If they want to
broadcast a message, clients will ask nicely the
server to do it for them through a message of type
'1'. The message is supposed to be kept in
eachclient's "mailbox", then the server should notify
each client by sending a SIGUSR1 signal, and then
waiting for each clientto ask for its own copy of the
notification. When a client is ready to do it, will
just send a message of type '3' to the server.
Messages of type '2' are just a variation of type '1'
which dosen't include the sender in the list of
receivers.

My first version was forking a new process in the
server to serve requests, but I soon realized that, as
each process receives a copy of the original data,
updating the "mailboxes" won't work (the "mailboxes"
updated are local copies). In the threads version the
"mailboxes" are shared, but so are the sockets, which
will force me to add some locks and make sure that an
open socket in the server will talk only with a
certain client.

For the moment I am toying with one server, and one
client. Still, it is not working as expected. '0' goes
through, so does'1', but not '3' ('3' as a result of
'1', or '3' requested from keyboard).

Life is a struggle. Programming in Python shouldn't
be. Ergo, I'm doing something wrong.

Any advice?

Thanks,
Sorin

Environment: Gentoo Linux, Python 2.4.1

__________________________________
Yahoo! FareChase: Search multiple travel sites in one click.
http://farechase.yahoo.com
Oct 27 '05 #1
1 1842
[Sori Schwimmer]
I am working on an application which involves
interprocess communication. More to the point,
processes should be able to notify other processes
about certain situations, so the "notifyees" would be
able to act in certain ways.

As processes are distributed on several machines, in
different physical locations, my thinking was:
a) set a message manager (MM)
b) all the participants will register with MM, so MM
will have their host address and their pid on host
c) when someone needs to send a notification, it is
sent to MM, and MM it's doing the job
[snip]
Life is a struggle. Programming in Python shouldn't
be. Ergo, I'm doing something wrong.

Any advice?


Rather than rolling your own, have you considered using the spread
module: robust, tested, efficient and no infrastructure development
required.

http://www.zope.org/Members/tim_one/spread/
http://www.python.org/other/spread/

The latter page has links to the original C spread module, which has
documentation, FAQs, etc.

--
alan kennedy
------------------------------------------------------
email alan: http://xhaus.com/contact/alan
Oct 27 '05 #2

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

31
by: Derek Fountain | last post by:
Does Python have a timer mechanism? i.e. an "after 500 milliseconds, run this bit of code" sort of thing?
2
by: Holger Joukl | last post by:
Hi, migrating from good old python 1.5.2 to python 2.3, I have a problem running a program that features some threads which execute calls to an extension module. Problem is that all of a sudden,...
9
by: Eric Sabine | last post by:
Can someone give me a practical example of why I would join threads? I am assuming that you would typically join a background thread with the UI thread and not a background to a background, but...
9
by: corey.coughlin | last post by:
Alright, so I've been following some of the arguments about enhancing parallelism in python, and I've kind of been struck by how hard things still are. It seems like what we really need is a more...
23
by: Simon Wittber | last post by:
I've just bought a new notebook, which has a dual core CPU. I write cross platform games in Python, and I'd really like to be able to use this second core (on my machine, and on user's machines)...
5
by: Ark | last post by:
Consider static T foo; .............. T get_foo(void) { return foo; } In a multi-threaded (or -tasked) environment, I need to ensure that I get_foo() grabs T atomically (e.g. is not...
0
by: Mitko Haralanov | last post by:
Hi everyone, First off, I know that this has been discussed before and I did a search but could not find anything that helped my situation. Here is the problem: I have a Python program that...
15
by: Jay | last post by:
I have a multi threaded VB.NET application (4 threads) that I use to send text messages to many, many employees via system.timer at a 5 second interval. Basically, I look in a SQL table (queue) to...
8
by: Amar | last post by:
I am a system programmer , doing my program in C/RedHat LINUX ES4.0 version. I want to do concurrent programming in C , which will utilise my system's 4 processor simutaneously. I need some one's...
0
marktang
by: marktang | last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However,...
0
Oralloy
by: Oralloy | last post by:
Hello folks, I am unable to find appropriate documentation on the type promotion of bit-fields when using the generalised comparison operator "<=>". The problem is that using the GNU compilers,...
0
jinu1996
by: jinu1996 | last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven...
0
agi2029
by: agi2029 | last post by:
Let's talk about the concept of autonomous AI software engineers and no-code agents. These AIs are designed to manage the entire lifecycle of a software development project—planning, coding, testing,...
0
by: conductexam | last post by:
I have .net C# application in which I am extracting data from word file and save it in database particularly. To store word all data as it is I am converting the whole word file firstly in HTML and...
0
by: adsilva | last post by:
A Windows Forms form does not have the event Unload, like VB6. What one acts like?
0
by: 6302768590 | last post by:
Hai team i want code for transfer the data from one system to another through IP address by using C# our system has to for every 5mins then we have to update the data what the data is updated ...
1
muto222
php
by: muto222 | last post by:
How can i add a mobile payment intergratation into php mysql website.
0
bsmnconsultancy
by: bsmnconsultancy | last post by:
In today's digital era, a well-designed website is crucial for businesses looking to succeed. Whether you're a small business owner or a large corporation in Toronto, having a strong online presence...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.