471,075 Members | 926 Online
Bytes | Software Development & Data Engineering Community
Post +

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 471,075 software developers and data experts.

Pickle or Mysql

Can I use Pickle to store about 500,000 key value pairs.. or should I
use mySql. Which one is best for performance, as the key value pair
increases.

Thanks

Apr 1 '06 #1
6 2486
am******@gmail.com writes:
Can I use Pickle to store about 500,000 key value pairs.. or should I
use mySql. Which one is best for performance, as the key value pair
increases.


That's an awfully large pickle. Maybe you want shelve. If there
are frequent updates, multiple clients, etc., then yes, use a database
like mysql.
Apr 1 '06 #2
So, Is Shelve a perfect solution (besides Mysql), to store large
key/value pairs, and which are updated frequently by multiple clients.

Thanks

Paul Rubin wrote:
am******@gmail.com writes:
Can I use Pickle to store about 500,000 key value pairs.. or should I
use mySql. Which one is best for performance, as the key value pair
increases.


That's an awfully large pickle. Maybe you want shelve. If there
are frequent updates, multiple clients, etc., then yes, use a database
like mysql.


Apr 1 '06 #3
am******@gmail.com writes:
So, Is Shelve a perfect solution (besides Mysql), to store large
key/value pairs, and which are updated frequently by multiple clients.


No, shelve is for use within a single process. With multiple clients
and frequent updates, you need a real database and some knowledge
about how to use one.
Apr 1 '06 #4
am******@gmail.com:
Can I use Pickle to store about 500,000 key value pairs..
Performance would be horrible. Use a BTree in ZODB instead:
http://www.zope.org/Wikis/ZODB/guide...00000000000000
or should I use mySql.


You should use a relational database, such as PostgreSQL, when you want to
model your data as relations (tables) instead of objects, or when you want
to use SQL, or when another application needs to access the data that only
speaks SQL, or ...

--
René Pijlman
Apr 1 '06 #5
> Can I use Pickle to store about 500,000 key value pairs.. or should I
use mySql. Which one is best for performance, as the key value pair
increases.


Pickle: absolutely out of the question.
Mysql: might work, albeit slowly.

Use berkeley DB (bsddb3), or zodb. I have no experience with the
latter, but bdb's scale far beyond that magnitude if necessary.

-Mike

Apr 2 '06 #6
Can i install berkeley db on BSD, I am having a virtual private server,
so I have privilates to install on it and do we have management tools
like phpmyadmin from berkely db as well, as I am not so good at
database management.

Thanks
Amaltas

Apr 9 '06 #7

This discussion thread is closed

Replies have been disabled for this discussion.

Similar topics

3 posts views Thread by Michael Hohn | last post: by
reply views Thread by Mike P. | last post: by
6 posts views Thread by Jim Lewis | last post: by
10 posts views Thread by crystalattice | last post: by
5 posts views Thread by Chris | last post: by
2 posts views Thread by Michele Simionato | last post: by

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.