473,396 Members | 1,872 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 473,396 software developers and data experts.

What architecture for a Large Database with PostgreSQL

1
I intend to set up a large database with PostgreSQL: about 1.3 TB, very basic queries (but 1500 per second at peak charge), and most probably only a single one index. The overall application, which is rather simple, should react in less than 3 seconds, 80% of the time. Meaning that if the database gives a mean response time of more than 0.5 second, I am fully dead...

I plan to set up a distributed cluster N+1. Each node of the cluster stores one independant part of the whole database on a SAN. A hash mecanism tells me which database to look for. The passive node

First, what cluster product (commercial or free) do you recommand on RedHat from your experience? In case of failover of the system, what down time should I expect until the passive node takes charge of the faulty node?

Second, what would be the reasonnable node size? If the cluster has 5 nodes, each node peaks up to 260 GB and 300 q/s. For each node, I expect to use biprocessors, upgradable to 4 CPUS in case of.
Does this seem reasonnable from your experience? or should I scale it down a bit? to 8 nodes +2?

Everyone around tells me I should go for Oracle. What do you think?
Feb 5 '06 #1
1 4936
Niheel
2,460 Expert Mod 2GB
The demands on the database seem to be high.

Would it not be easier to build on a commercial solution known to work in these types of situations such as Oracle. If you choose to go the open source route and this is your first venture into complex architecture; it would be good to have a consultant on hand that has done these things before with PostgreSQL. I am sure there are plenty of them supporting PostgreSQL.

Just thoughts on saving time and money.
Feb 5 '06 #2

Sign in to post your reply or Sign up for a free account.

Similar topics

5
by: martijn | last post by:
H!, I'm testing things with Python with databases. But I have one big question. What is the 'fastest' database for the internet in combination with Python ? - with +/- 15 GB data. - fast...
125
by: Sarah Tanembaum | last post by:
Beside its an opensource and supported by community, what's the fundamental differences between PostgreSQL and those high-price commercial database (and some are bloated such as Oracle) from...
1
by: sibusiso xolo | last post by:
Greetings, I am trying to create a database to store imges as large objects. I am using postgres7.3.4 on a SuSE8.2 machine. I read the PostgreSQL documentation on lage objects. There are...
11
by: CSN | last post by:
Is it possible to iterate over an array in plpgsql? Something like: function insert_stuff (rel_ids int) .... foreach rel_ids as id insert into table (rel_id, val) values (id, 5);
8
by: Együd Csaba | last post by:
Hi All, how can I improve the query performance in the following situation: I have a big (4.5+ million rows) table. One query takes approx. 9 sec to finish resulting ~10000 rows. But if I run...
3
by: Bob.Henkel | last post by:
I write this to tell you why we won't use postgresql even though we wish we could at a large company. Don't get me wrong I love postgresql in many ways and for many reasons , but fact is fact. If...
96
by: BadPony | last post by:
Anyone using Peoplesoft on a Federated UDB (shared nothing)Environment on Open System Platforms? Preferably AIX, but any war stories would be good. TEA EB-C
24
by: Hardy | last post by:
I'm pretty new in this field. when reading some 70x material, I met with this term but cannot catch its accurate meaning. who can help me? thanks in advance:)~
2
by: Ken Ross | last post by:
I'm in the early stages of working up the design for a large .Net web application and want to make sure that we have the best possible physical architecture to support the logical architecture and...
0
by: ryjfgjl | last post by:
In our work, we often receive Excel tables with data in the same format. If we want to analyze these data, it can be difficult to analyze them because the data is spread across multiple Excel files...
0
BarryA
by: BarryA | last post by:
What are the essential steps and strategies outlined in the Data Structures and Algorithms (DSA) roadmap for aspiring data scientists? How can individuals effectively utilize this roadmap to progress...
1
by: Sonnysonu | last post by:
This is the data of csv file 1 2 3 1 2 3 1 2 3 1 2 3 2 3 2 3 3 the lengths should be different i have to store the data by column-wise with in the specific length. suppose the i have to...
0
by: Hystou | last post by:
There are some requirements for setting up RAID: 1. The motherboard and BIOS support RAID configuration. 2. The motherboard has 2 or more available SATA protocol SSD/HDD slots (including MSATA, M.2...
0
marktang
by: marktang | last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However,...
0
by: Hystou | last post by:
Most computers default to English, but sometimes we require a different language, especially when relocating. Forgot to request a specific language before your computer shipped? No problem! You can...
0
Oralloy
by: Oralloy | last post by:
Hello folks, I am unable to find appropriate documentation on the type promotion of bit-fields when using the generalised comparison operator "<=>". The problem is that using the GNU compilers,...
0
jinu1996
by: jinu1996 | last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven...
0
tracyyun
by: tracyyun | last post by:
Dear forum friends, With the development of smart home technology, a variety of wireless communication protocols have appeared on the market, such as Zigbee, Z-Wave, Wi-Fi, Bluetooth, etc. Each...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.