471,354 Members | 2,215 Online
Bytes | Software Development & Data Engineering Community
Post +

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 471,354 software developers and data experts.

Data partitioning?

hi,

I am becoming more and more convinced that in order to achieve the
required performance and scalability I need to split my data amoungst
many backend machines.

Ideally I would start with about 10 machine and have 1/10th of the data
on each. As the data set grows I would then buy additional machines to
spread the data over.

I think this is called data partitioning in oracle?
What does postgresql have to offer in this area?

Does software already exist to query multiple identical schemas each
with different data stored in them, and then correlate the results?

If not what suggestions does anyone have for writing my own?

Thanks,
Mat

--

---------------------------(end of broadcast)---------------------------
TIP 5: Have you checked our extensive FAQ?

http://www.postgresql.org/docs/faqs/FAQ.html

Nov 12 '05 #1
1 1365
On Tue, Oct 07, 2003 at 10:34:18AM +0100, ps*******@freeuk.com wrote:
I am becoming more and more convinced that in order to achieve the
required performance and scalability I need to split my data amoungst
many backend machines.
How much data do you have, and what are you trying to run on? That
sounds like a _lot_. In any case, you can't do this in PostgreSQL
right now. A single back end controls all the data.
I think this is called data partitioning in oracle?
Usually people mean spreading tables across different disks by some
criteria when they talk about that. Completely different machines is
pretty usual.
If not what suggestions does anyone have for writing my own?


Be very careful. Multi-database concurrency problems are easy to
cause and hard to solve.

A

----
Andrew Sullivan 204-4141 Yonge Street
Afilias Canada Toronto, Ontario Canada
<an****@libertyrms.info> M2P 2A8
+1 416 646 3304 x110
---------------------------(end of broadcast)---------------------------
TIP 8: explain analyze is your friend

Nov 12 '05 #2

This discussion thread is closed

Replies have been disabled for this discussion.

Similar topics

13 posts views Thread by curwen | last post: by
18 posts views Thread by Jeff Boes | last post: by
7 posts views Thread by Jane | last post: by
reply views Thread by Robert Klemme | last post: by
10 posts views Thread by shsandeep | last post: by
8 posts views Thread by mitek | last post: by

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.