473,395 Members | 1,535 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 473,395 software developers and data experts.

pure Python DB

Hello,
for a cross-platform project, I am looking for a Python DB. It should be
lightweight, but provide transactions an of course reliable.
Is there such a thing out there?
I have read about Gadfly, is this still maintained?
Thanks,
-Patrick
Jul 18 '05 #1
8 2038
Patrick Useldinger wrote:
Hello,
for a cross-platform project, I am looking for a Python DB. It should be
lightweight, but provide transactions an of course reliable.
Is there such a thing out there?
I have read about Gadfly, is this still maintained?
Thanks,
-Patrick


Gadfly is lightweight but doesn't support transactions. It is in low
maintenance mode, development is currently not active but the project is
hosted at SourceForge (http://sourceforge.net/projects/gadfly) and any
bug reports and (especially) patches would be more than welcome.

Regards,
Andy
--
--------------------------------------------------------------------------------
From the desk of Andrew J Todd esq - http://www.halfcooked.com/

Jul 18 '05 #2
Patrick-

You might try out the Pointrel Data Repository System I wrote -- it's
all in Python.
http://sourceforge.net/projects/pointrel/

You need to learn to frame the data storage problem in its terms (triads
or somewhat Entity-Relation-al, similar in some ways to RDF). It does
provide single-user transactions using a lock file, but this lock file
approach has not been tested on lots of platforms. Compared to other
systems, you might find it less efficient in disk use (it now supports
64 bit offsets) and more difficult to delete thigns (the short answer
is, you can't delete anything -- without writing application level
support on top of it). On the plus side, you only need to add one
Python file to your project.

However, it does not yet have the level of testing yet one might want
for something mission critical. Naturally, how well suported it is is a
matter of chicken and egg -- if it is not well supported people won't
try it or improve it (until it magically makes it over some level of
general interest). For an example of its current bleeding edge state, I
just discovered what I think may be a potential bug where abandoned
transactions could create problems if you are using caching (the cache
could hold onto no longer valid handles for added new strings) -- I've
patched that for the next release (and you can always just turn off
caching), but that's the sort of bleeding edge thing you might encounter
if you try it. You can see the recent announcement of the latest version
in comp.lang.python.announce.
http://groups.google.com/groups?hl=e...a0ca969&rnum=3
Or this recent post:
http://groups.google.com/groups?hl=e...ups.com&rnum=5

I can say that I'd be interested in making the Pointrel Data Repository
a stable and well supported popular platform, although I won't commit to
any specific time frame or level of effort for it. I think it would be
more ready to go when or if I make the transition to using it to store
all my email (gulp -- that's commitment! :-) But that hasn't happened
yet. I'm thinking of using it in a web proxy first as that's a little
more forgiving application area for me (but the issues of making a good
proxy are stalling that some).

A year or two or so back I looked at the Gadfly source with a notion of
using some of it to put a SQL front end onto Pointrel. Maybe that would
make it more apalatable for general use? But I'm not generally
interested in using SQL, so I'm not sure how far down that road I want
to go.

In any case, all the best. And the databases written in C might be worth
your exploration -- some of the appear to be quite good and fairly cross
platform in their own terms.

--Paul Fernhout

Patrick Useldinger wrote:
Hello,
for a cross-platform project, I am looking for a Python DB. It should be
lightweight, but provide transactions an of course reliable.
Is there such a thing out there?
I have read about Gadfly, is this still maintained?
Thanks,
-Patrick


-----= Posted via Newsfeeds.Com, Uncensored Usenet News =-----
http://www.newsfeeds.com - The #1 Newsgroup Service in the World!
-----== Over 100,000 Newsgroups - 19 Different Servers! =-----
Jul 18 '05 #3
Andy Todd <an****@halfcooked.com> wrote in message news:<ma**********************************@python. org>...
Patrick Useldinger wrote:>
Gadfly is lightweight but doesn't support transactions. It is in low
maintenance mode, development is currently not active but the project is
hosted at SourceForge (http://sourceforge.net/projects/gadfly) and any
bug reports and (especially) patches would be more than welcome.


Um.. doesn't support transactions? It depends what you mean,
I guess. It supports transaction commit and rollback and recovery
but not transaction concurrency... (yet)

-- Aaron Watters

===
She's wondering what he'll make for breakfast...
He's wondering how long he has to cuddle before he can go home...
Jul 18 '05 #4
Aaron Watters wrote:
Andy Todd <an****@halfcooked.com> wrote in message news:<ma**********************************@python. org>...
Patrick Useldinger wrote:>
Gadfly is lightweight but doesn't support transactions. It is in low
maintenance mode, development is currently not active but the project is
hosted at SourceForge (http://sourceforge.net/projects/gadfly) and any
bug reports and (especially) patches would be more than welcome.


Um.. doesn't support transactions? It depends what you mean,
I guess. It supports transaction commit and rollback and recovery
but not transaction concurrency... (yet)


Neither does SQLite. Only one transaction can be active at any time.
Another transaction will block at BEGIN.

If you need that I'd suggest you switch to a client-server database like
PostgreSQL.

-- Gerhard

Jul 18 '05 #5
Gerhard Häring <gh@ghaering.de> wrote in message news:<ma**********************************@python. org>...
Aaron Watters wrote:
Andy Todd <an****@halfcooked.com> wrote in message news:<ma**********************************@python. org>...
Patrick Useldinger wrote:>
Gadfly is lightweight but doesn't support transactions. It is in low
maintenance mode, development is currently not active but the project is
hosted at SourceForge (http://sourceforge.net/projects/gadfly) and any
bug reports and (especially) patches would be more than welcome.


Um.. doesn't support transactions? It depends what you mean,
I guess. It supports transaction commit and rollback and recovery
but not transaction concurrency... (yet)


Neither does SQLite. Only one transaction can be active at any time.
Another transaction will block at BEGIN.

If you need that I'd suggest you switch to a client-server database like
PostgreSQL.


No need to go client/server. Embedded Firebird supports concurrent
transactions with configurable isolation levels, foreign keys, views,
stored procedures, and other features one would expect from a
full-fledged RDBMS. Plus it's fast--kinterbasdb with embedded
Firebird 1.5-rc4 is about twice as fast as pysqlite 0.4.3 in various
trivial speed tests I've tried.

Embedded Firebird is not the primary focus of the Firebird core
developers, though, so releases aren't always up to date, and so far,
binaries have only been released for Windows. Here's the most recent:
http://prdownloads.sourceforge.net/f...2.zip?download

To use it from Python, see:
http://cvs.sourceforge.net/cgi-bin/v...ded_using_with

I'm not aware of any reason why embedded Firebird couldn't run on *nix
(the server variant does), but AFAIK no one has done so. Also, I
haven't used the embedded variant for anything non-trivial, so I can't
comment on its stability.
Jul 18 '05 #6
David Rushby wrote:
Gerhard Häring wrote:
If you need [concurrent transactions] I'd suggest you switch to a
client-server database like PostgreSQL.
No need to go client/server. Embedded Firebird supports concurrent
transactions with configurable isolation levels, foreign keys, views,
stored procedures, and other features one would expect from a
full-fledged RDBMS. [...]


The included README says:

"""
But you should be aware that you cannot access single
database from a number of the embedded servers
simultaneously, because they have SuperServer architecture
and hence exclusively lock attached databases.
"""

So it doesn't help in a multi-process environment, either (like in CGI
scripts). But then again, CGI sucks :-P

Embedded Firebird sounds like a good solution for small *multithreaded*
application servers, though.
Plus it's fast--kinterbasdb with embedded Firebird 1.5-rc4 is about
twice as fast as pysqlite 0.4.3 in various trivial speed tests I've
tried.


That's interesting. I wonder how much of that is because of the
relatively inefficient Python wrapper over SQLite. Time to go on with my
prototype for PySQLite 0.5 :-)

-- Gerhard

Jul 18 '05 #7
On Wed, 27 Aug 2003 08:40:34 +0200, Gerhard Häring <gh@ghaering.de> wrote:
Um.. doesn't support transactions? It depends what you mean,
I guess. It supports transaction commit and rollback and recovery
but not transaction concurrency... (yet)


In my case, only one process is supposed to acces the DB, but I need to be
able to rollback in case it goes wrong, or to commit only all went right.
Jul 18 '05 #8
On Wed, 27 Aug 2003 07:34:01 -0700, David Rushby wrote:
[...]
No need to go client/server. Embedded Firebird supports concurrent
transactions with configurable isolation levels, foreign keys, views,
stored procedures, and other features one would expect from a
full-fledged RDBMS. Plus it's fast--kinterbasdb with embedded
Firebird 1.5-rc4 is about twice as fast as pysqlite 0.4.3 in various
trivial speed tests I've tried.


I thought Firebird was a web browser?!
couldn't help myself :-)

-Mark
Jul 18 '05 #9

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

4
by: Ravi | last post by:
Hi, I did some googling, and found that there doesn't seem to be a pure python MySQL communication module. There is one for perl however, Net::MySQL. I was wondering if there was a specific...
11
by: Brett C. | last post by:
For my thesis (once the bloody thing stops throwing bugs at me) I am going to need to collect stats on the frequency that atomic types in local variables are applied to various opcodes and methods....
1
by: David Mertz, Ph.D. | last post by:
I decided to write a pure Python hashcash implementation. I have seen David McNab's Python implementation. Unfortunately, as near as I can tell (which is supported on the hashcash mailing list...
15
by: Christos TZOTZIOY Georgiou | last post by:
Has anyone built PIL (1.1.4 or 1.1.5) for Python 2.4? If yes, please let me know, since I can't test a couple of my apps using PIL with 2.4 . You can even reply by email (yes, I dare use true...
3
by: andrew.fabbro | last post by:
I'm looking for an implementation of AES (the Advanced Encryption Standard) in pure Python. I'm aware of pycrypto, but that uses C code. I'm hoping to find something that only uses Python...I'm...
5
by: Fuzzyman | last post by:
Python 2.4 is built with Microsoft Visiual C++ 7. This means that it uses msvcr7.dll, which *isn't* a standard part of the windows operating system. This means that if you build a windows installer...
13
by: Steven Bethard | last post by:
Jean-Paul Calderone <exarkun@divmod.comwrote: Interesting. Could you give a few illustrations of this? (I didn't run into the same problem at all, so I'm curious.) Steve
12
by: betabrain.honshu | last post by:
Hi Folks, for those of you who are familiar with the micropledge.com project, here is a good opportunity to spend or earn something: http://micropledge.com/projects/pysalsa20 I know that the...
28
by: n00m | last post by:
Both codes below read the same huge(~35MB) text file. In the file 1000000 lines, the length of each line < 99 chars. Stable result: Python runs ~0.65s C : ~0.70s Any thoughts?
8
by: Roy Smith | last post by:
Does there exist a pure Python version of a MySQL module? I've got a data logging application that needs to run on a whole bunch of OSs, ranging from Windows to a dozen different unix flavors on...
0
by: ryjfgjl | last post by:
If we have dozens or hundreds of excel to import into the database, if we use the excel import function provided by database editors such as navicat, it will be extremely tedious and time-consuming...
0
by: ryjfgjl | last post by:
In our work, we often receive Excel tables with data in the same format. If we want to analyze these data, it can be difficult to analyze them because the data is spread across multiple Excel files...
0
by: emmanuelkatto | last post by:
Hi All, I am Emmanuel katto from Uganda. I want to ask what challenges you've faced while migrating a website to cloud. Please let me know. Thanks! Emmanuel
0
BarryA
by: BarryA | last post by:
What are the essential steps and strategies outlined in the Data Structures and Algorithms (DSA) roadmap for aspiring data scientists? How can individuals effectively utilize this roadmap to progress...
1
by: nemocccc | last post by:
hello, everyone, I want to develop a software for my android phone for daily needs, any suggestions?
1
by: Sonnysonu | last post by:
This is the data of csv file 1 2 3 1 2 3 1 2 3 1 2 3 2 3 2 3 3 the lengths should be different i have to store the data by column-wise with in the specific length. suppose the i have to...
0
by: Hystou | last post by:
Most computers default to English, but sometimes we require a different language, especially when relocating. Forgot to request a specific language before your computer shipped? No problem! You can...
0
by: Hystou | last post by:
Overview: Windows 11 and 10 have less user interface control over operating system update behaviour than previous versions of Windows. In Windows 11 and 10, there is no way to turn off the Windows...
0
tracyyun
by: tracyyun | last post by:
Dear forum friends, With the development of smart home technology, a variety of wireless communication protocols have appeared on the market, such as Zigbee, Z-Wave, Wi-Fi, Bluetooth, etc. Each...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.