By using this site, you agree to our updated Privacy Policy and our Terms of Use. Manage your Cookies Settings.
440,345 Members | 1,783 Online
Bytes IT Community
+ Ask a Question
Need help? Post your question and get tips & solutions from a community of 440,345 IT Pros & Developers. It's quick & easy.

Threading Or Multiprocessing???

P: 8
This issue is probably discussed before. However, I can still use a little insight. I am a python beginner looking to develop a small client/server suite. The clients will reside in different PCs across a LAN and their job is to recieve a file (say, a .txt file) from the Server and open it with local copies of another application (say,Gnote ... I use Linux). The clients interact with their local Gnote and report states/progress to the Server. The Server uses the states report to know how to allocate remote tasks to the clients. Lets say that each client has to extract a text from the initial txt file and store the extract as a small .mxt file (just any extension) on a shared resource (maybe a samba share or nfs share). Each extract will be different and nearly sequential in each client ... so there is no repeats. At the end of the extracting tasks, the Server will instruct one of the Clients to collate the .mxt files, recreate the initial .txt file and deliver it to a specified location (different folder ... for comparison and assessment).

That kinda summarizes the scenario.

I've read that there are different ways to approach his, Threading and Multiprocessing being the most popular. I am wondering which will best suit this scenario. The initial txt file in our example can be anything between 300MB to 10GB++ in size. Of course, that's a test size ... just so we know there will be a lot of file transfers across LAN.

So, Which way should I go?
Dec 5 '10 #1
Share this Question
Share on Google+
1 Reply

Post your reply

Sign in to post your reply or Sign up for a free account.