473,811 Members | 2,631 Online
Bytes | Software Development & Data Engineering Community
+ Post

Home Posts Topics Members FAQ

Database module & multithreading

Hi guys!!!
Just one quick question... Which database module should I use when I
want to use multi threading as my application requires lots of data
from internet ???? I also want this database module to be fast, simple
n efficient, in any case multi threading capabilities are # 1
requirement.
Thanx Guys

Anil

Mar 10 '07 #1
19 2828
jupiter wrote:
Hi guys!!!
Just one quick question... Which database module should I use when I
want to use multi threading as my application requires lots of data
from internet ???? I also want this database module to be fast, simple
n efficient, in any case multi threading capabilities are # 1
requirement.
Thanx Guys

Anil
See the threadsafety flag of Python DB-API V2 compliant database modules.
0 = no thread safe
1 = threads may share module
2 = + may share connections
3 = + may share cursors

A+

Laurent.

Mar 10 '07 #2
On Mar 10, 7:29 pm, Laurent Pointal <laurent.poin.. .@wanadoo.fr>
wrote:
jupiter wrote:
Hi guys!!!
Just one quick question... Which database module should I use when I
want to use multi threading as my application requires lots of data
from internet ???? I also want this database module to be fast, simple
n efficient, in any case multi threading capabilities are # 1
requirement.
Thanx Guys
Anil

See the threadsafety flag of Python DB-API V2 compliant database modules.
0 = no thread safe
1 = threads may share module
2 = + may share connections
3 = + may share cursors

A+

Laurent.
Thanx for this pointer buddy! I have done my homework. Some Database
modules are not actively maintained some modules does not work with
Python 2.5. At this moment I am using Sqlite3 which is pretty fast but
it dosent allow me to use multi threading so which database module is
better in terms of multithreading

@

Mar 10 '07 #3
"jupiter" <an***********@ gmail.comwrites :
Hi guys!!!
Just one quick question... Which database module should I use when I
want to use multi threading as my application requires lots of data
from internet ???? I also want this database module to be fast, simple
n efficient, in any case multi threading capabilities are # 1
requirement.
For which database server?

--
Jorge Godoy <jg****@gmail.c om>
Mar 10 '07 #4
>
Thanx for this pointer buddy! I have done my homework. Some Database
modules are not actively maintained some modules does not work with
Python 2.5. At this moment I am using Sqlite3 which is pretty fast but
it dosent allow me to use multi threading so which database module is
better in terms of multithreading
Actually, I think sqlite3 just requires that each thread have its own
connection and cursor.
Mar 10 '07 #5
On Mar 10, 8:16 pm, Michael Bentley <rmc...@gmail.c omwrote:
Thanx for this pointer buddy! I have done my homework. Some Database
modules are not actively maintained some modules does not work with
Python 2.5. At this moment I am using Sqlite3 which is pretty fast but
it dosent allow me to use multi threading so which database module is
better in terms of multithreading

Actually, I think sqlite3 just requires that each thread have its own
connection and cursor.
I tried this approach with

for each new thread
self.c1=sqlite3 .connect('urls' )
self.c=self.c1. cursor()
check condition
insert if true else ignore

but no success
Mar 10 '07 #6
On Mar 10, 8:16 pm, Michael Bentley <rmc...@gmail.c omwrote:
Thanx for this pointer buddy! I have done my homework. Some Database
modules are not actively maintained some modules does not work with
Python 2.5. At this moment I am using Sqlite3 which is pretty fast but
it dosent allow me to use multi threading so which database module is
better in terms of multithreading

Actually, I think sqlite3 just requires that each thread have its own
connection and cursor.
Exception in thread Thread-2:
Traceback (most recent call last):
File "D:\Python25\li b\threading.py" , line 460, in __bootstrap
self.run()
File "url_part1. py", line 161, in run
dbacc(self.o, self.dbase).dat aenter()
File "url_part1. py", line 64, in dataenter
self.c.execute( 'insert into '+self.odbase+' values
(?,?,?,?,?,?,?, ?,?,?,?,?,
?)',self.odata)
InterfaceError: Error binding parameter 3 - probably unsupported type.

this is the error I am getting........ ........

Mar 10 '07 #7
jupiter <an***********@ gmail.comwrote:
...
Python 2.5. At this moment I am using Sqlite3 which is pretty fast but
it dosent allow me to use multi threading so which database module is
better in terms of multithreading
Perhaps psycopg2 (with PostgreSQL as the engine), according to
<http://cheeseshop.pyth on.org/pypi/psycopg2/2.0.2it is specifically
"designed for heavily multi-threaded applications that create and
destroy lots of cursors and make a conspicuous number of concurrent
INSERTs or UPDATEs".
Alex
Mar 10 '07 #8
On Mar 10, 8:42 pm, a...@mac.com (Alex Martelli) wrote:
jupiter <anil.jupit...@ gmail.comwrote:

...
Python 2.5. At this moment I am using Sqlite3 which is pretty fast but
it dosent allow me to use multi threading so which database module is
better in terms of multithreading

Perhaps psycopg2 (with PostgreSQL as the engine), according to
<http://cheeseshop.pyth on.org/pypi/psycopg2/2.0.2it is specifically
"designed for heavily multi-threaded applications that create and
destroy lots of cursors and make a conspicuous number of concurrent
INSERTs or UPDATEs".

Alex
conn = psycopg2.connec t("dbname=tes t user=test")

Traceback (most recent call last):
File "<pyshell#8 >", line 1, in <module>
conn = psycopg2.connec t("dbname=tes t user=test")
OperationalErro r: could not connect to server: Connection refused
(0x0000274D/10061)
Is the server running on host "???" and accepting
TCP/IP connections on port 5432?

this is the error I am getting with psycopg2 I want to access a local
file

Mar 10 '07 #9
"jupiter" <an***********@ gmail.comwrites :
conn = psycopg2.connec t("dbname=tes t user=test")

Traceback (most recent call last):
File "<pyshell#8 >", line 1, in <module>
conn = psycopg2.connec t("dbname=tes t user=test")
OperationalErro r: could not connect to server: Connection refused
(0x0000274D/10061)
Is the server running on host "???" and accepting
TCP/IP connections on port 5432?

this is the error I am getting with psycopg2 I want to access a local
file
PostgreSQL is a server, it access the files. You talk to the RDBMS server.
Is it running? Is it accepting connections from your host?

--
Jorge Godoy <jg****@gmail.c om>
Mar 10 '07 #10

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

8
8067
by: Michael | last post by:
Don't shoot me down guys, I know the Standard says nothing of threads and all.... As i understand it the STL does not support multithreading, however I want to use the STL in a multithreaded environment. Is it sufficient to declare a bool variable 'Locked' which process set when they are using a particular object or do I need to consult some more low level platform-kernel documentation?? Regards
47
3760
by: mihai | last post by:
What does the standard say about those two? Is any assurance that the use of STL is thread safe? Have a nice day, Mihai.
6
2514
by: a | last post by:
Hello, I am doing some multithreading in an MDI app, and I can't seem to get the cursor to stay as an Hourglass. I call: Cursor.Current = cursors.wait at the beginning of my routing, and set it back to cursors.default when the thread ends (using a callback)
7
4493
darlene
by: darlene | last post by:
Hi, I need some help in creating an application in Visual C++ which should make use of MFC and multithreading. The application is supposed to consist in a number of threads representing factories. Each factory, implemented as a thread, can create only one type of the objects below: wheels, windows, doors, chassis or engines. From the GUI an user should be able to add a new factory or delete an existing one by specifying its type (eg. engine...
1
2362
by: Brit | last post by:
I have an ASP file that retrieves names from an Access database for 4 different categories of membership, which the visitor to the page selects (corporate, institutional, regular, or student). The DNS name is "cati", the names are specified in the "Last_names" field, and the categories are in the "categories" field. l want the results sorted in alphabetic order by last name. However, the results appear to be in a totally random,...
0
888
by: joop renes | last post by:
hi, i hope this is the right list for the following question of a c++ hacker,python newbie. i have a library in c++ to which i want to add a python GUI and other python stuff.The library has multithreading components, while python uses a reference counted memory model. Usually mixing reference counting with multithreading is frowned upon, at least in the c++ world. what am i to expect in the python world, if i bring multithreading c++...
0
918
by: Gabriel Genellina | last post by:
En Sun, 04 May 2008 11:56:14 -0300, joop renes <jj.renes@hccnet.nlescribió: Python objects are reference counted, *and* you can have many threads running. This is not a problem in itself; Python has a Global Interpreter Lock (GIL) that ensures that addref/releases are properly handled. Only one thread at a time can execute Python code; but your C++ library can use as many threads as you want - as long as they don't call Python code again...
0
9605
by: Hystou | last post by:
Most computers default to English, but sometimes we require a different language, especially when relocating. Forgot to request a specific language before your computer shipped? No problem! You can effortlessly switch the default language on Windows 10 without reinstalling. I'll walk you through it. First, let's disable language synchronization. With a Microsoft account, language settings sync across devices. To prevent any complications,...
0
10392
jinu1996
by: jinu1996 | last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven tapestry of website design and digital marketing. It's not merely about having a website; it's about crafting an immersive digital experience that captivates audiences and drives business growth. The Art of Business Website Design Your website is...
1
10403
by: Hystou | last post by:
Overview: Windows 11 and 10 have less user interface control over operating system update behaviour than previous versions of Windows. In Windows 11 and 10, there is no way to turn off the Windows Update option using the Control Panel or Settings app; it automatically checks for updates and installs any it finds, whether you like it or not. For most users, this new feature is actually very convenient. If you want to control the update process,...
0
10136
tracyyun
by: tracyyun | last post by:
Dear forum friends, With the development of smart home technology, a variety of wireless communication protocols have appeared on the market, such as Zigbee, Z-Wave, Wi-Fi, Bluetooth, etc. Each protocol has its own unique characteristics and advantages, but as a user who is planning to build a smart home system, I am a bit confused by the choice of these technologies. I'm particularly interested in Zigbee because I've heard it does some...
1
7671
isladogs
by: isladogs | last post by:
The next Access Europe User Group meeting will be on Wednesday 1 May 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM). In this session, we are pleased to welcome a new presenter, Adolph Dupré who will be discussing some powerful techniques for using class modules. He will explain when you may want to use classes instead of User Defined Types (UDT). For example, to manage the data in unbound forms. Adolph will...
0
6893
by: conductexam | last post by:
I have .net C# application in which I am extracting data from word file and save it in database particularly. To store word all data as it is I am converting the whole word file firstly in HTML and then checking html paragraph one by one. At the time of converting from word file to html my equations which are in the word document file was convert into image. Globals.ThisAddIn.Application.ActiveDocument.Select();...
0
5693
by: adsilva | last post by:
A Windows Forms form does not have the event Unload, like VB6. What one acts like?
1
4341
by: 6302768590 | last post by:
Hai team i want code for transfer the data from one system to another through IP address by using C# our system has to for every 5mins then we have to update the data what the data is updated we have to send another system
2
3868
muto222
by: muto222 | last post by:
How can i add a mobile payment intergratation into php mysql website.

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.