Embedded python with threads

hi,

I have a C++ app that loads a python module and calls a function from
it. The call is getting the contents of a list that's global in that
module.

However, I'd like the python script to be also running a thread that
fills that global list, but can't figure out how to do it. Essentially
the code looks like;

in the C++ app;

////
Py_Initialize();

// PyImport_ImportModule blocks until the myModule script has run
// through...
PyObject* module = PyImport_ImportModule("myModule");

PyObject* function = PyObject_GetAttrString(module, "GetList");
while(1) {
PyObject* pyList = PyObject_CallFunction(function, "");
// use the stuff in pyList
sleep(15);
}
////

and in the myModule.py;

####
import thread
import time
orderListLock = thread.allocate_lock()

pyList = []

def GetList():
global pyList
tmpList = []
orderListLock.acquire()
tmpList = pyList
orderListLock.release()
return tmpList

def keepFillingListThread():
global pyList
while 1:
orderListLock.acquire()
pyList.append(somestuff)
orderListLock.release()
time.sleep(5)

# the following statement happens when the C++ app imports the module,
# but the thread only lives as long the main python thread (which is
# over straight away on my linux PC)

thread.start_new_thread(keepFillingListThread, ())

####

Has anyone any ideas?

thanks,
nik

////
Py_Initialize();

// PyImport_ImportModule blocks until the myModule script has run
// through...
PyObject* module = PyImport_ImportModule("myModule");

PyObject* function = PyObject_GetAttrString(module, "GetList");
while(1) {
PyObject* pyList = PyObject_CallFunction(function, "");
// use the stuff in pyList
sleep(15);
}
I'm not sure I fully understand your problem, but in the loop above, you should
have:

Py_BEGIN_ALLOW_THREADS
sleep(15);
Py_END_ALLOW_THREADS

This releases the Python GIL during the sleep call, allowing your list-filling
thread to run.

# the following statement happens when the C++ app imports the module,
# but the thread only lives as long the main python thread (which is
# over straight away on my linux PC)

On Wed, 15 Sep 2004 18:05:54 +0200, nik <my************@noos.fr> wrote:

////
Py_Initialize();

// PyImport_ImportModule blocks until the myModule script has run
// through...
PyObject* module = PyImport_ImportModule("myModule");

PyObject* function = PyObject_GetAttrString(module, "GetList");
while(1) {
PyObject* pyList = PyObject_CallFunction(function, "");
// use the stuff in pyList
sleep(15);
}

I'm not sure I fully understand your problem, but in the loop above, you should
have:

Py_BEGIN_ALLOW_THREADS
sleep(15);
Py_END_ALLOW_THREADS

This releases the Python GIL during the sleep call, allowing your list-filling
thread to run.

# the following statement happens when the C++ app imports the module,
# but the thread only lives as long the main python thread (which is
# over straight away on my linux PC)

This is what I don't understand, since the Python main thread should be the
thread on which Py_Initialize was called; it should remain alive (from Python's
perspective) until Py_Finalize is called.

I think I was making an assumption that since the list filling threads
didn't run that the import module was calling the create thread command,
then exiting (killing the children threads along with it) - I'm a novice
at threads with python, so I'm probably misunderstanding the general
picture. However, maybe your suggestion of the Py_BEGIN_ALLOW_THREADS
will make the difference. I'll try again as soon as I can (not until
next week now)...

many thanks for the reply,
nik
---
Greg Chapman

I think I was making an assumption that since the list filling threads
didn't run that the import module was calling the create thread command,
then exiting (killing the children threads along with it) - I'm a novice
at threads with python, so I'm probably misunderstanding the general
picture. However, maybe your suggestion of the Py_BEGIN_ALLOW_THREADS
will make the difference. I'll try again as soon as I can (not until
next week now)...