By using this site, you agree to our updated Privacy Policy and our Terms of Use. Manage your Cookies Settings.
464,286 Members | 1,276 Online
Bytes IT Community
+ Ask a Question
Need help? Post your question and get tips & solutions from a community of 464,286 IT Pros & Developers. It's quick & easy.

using os.system(command) to send jobs to a Linux cluster

P: 1
I have a "for" loop to do something over a number of files in a directory. In particular I need to send a command line job that uses each file in thar directory as an input to node in a linux cluster. Here is how the "for" loop looks like:

path = '/mypath/'
for file in os.listdir(path):
node_name = 'name' + ('%02d' % node)
comand = 'ssh ' + node_name + 'external program path and options'
node = node + 1
os.system(command)

My problem is that os.system(command) sends the ssh job to node number 1 in a Linux cluster, and waits until that is finished to send the second ssh job to node number 2 (the "for" loop does not progress until the job sent by os.system is done. I would like it to send the job to each node and not wait until each one has finished. Any ideas?

Thanks!
Jul 24 '08 #1
Share this Question
Share on Google+
1 Reply

jlm699
100+
P: 314
You can look into the popen suite of commands for some non-blocking usage.
Link
Jul 24 '08 #2

Post your reply

Sign in to post your reply or Sign up for a free account.