473,378 Members | 1,355 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 473,378 software developers and data experts.

Clustering for performance and fail over

Hello all,
I am interested in know if anyone has set up clustering for performance and fail over using PostgreSQL. We are currently using Oracle for a distribution application and would like to use PostgreSQL with multiple application and database servers.

Regards Stan.


---------------------------------
Post your free ad now! Yahoo! Canada Personals

Nov 12 '05 #1
2 2363
Hi, Stan,

We're in the early stages of testing a new Postgres (7.3) cluster. For
background, our database is about 14gb on disk, and we see about a
transaction a second (out of about 120 queries/sec.) Our application
is a large dynamic Apache-based web system, written in Perl. Our main
database machine is a quad P4 Xeon (1.8ghz) with 4gb of RAM, running
Linux 2.4.mumble; poorly formed queries and bad disk layout (we're
working on it) mean that during times of peak traffic we'd see load
sometimes up over 15.

For fail-over, we've been running the contrib/dbmirror single-master
replication for about six months (in production) with no ill effects.
We do reporting and db backup off of the slave machine, and it works
great. However, we project steady, linear growth in usage, and thus
needed to find extra performance -- and it's not easy to get a higher
performing shared-memory multiprocessor, to say nothing of cost.

As our system is pure Perl, we decided to replace the standard Perl
database access layer with a custom, multiplexing, handle cache. It's
been running for about a week now and distributing the load flawlessly.
A bonus is that proxying the queries has allowed us to being to
collect more interesting timing and usage statistics, and we're finally
starting to hunt down and mercilessly improve our nastiest queries.

There are some refinements to the dbmirror that we're currently working
on, but for now, everything is working flawlessly.

'jfb

C++: an octopus made by nailing extra legs onto a dog.
---------------------------(end of broadcast)---------------------------
TIP 5: Have you checked our extensive FAQ?

http://www.postgresql.org/docs/faqs/FAQ.html

Nov 12 '05 #2
On Wed, Oct 22, 2003 at 10:30:24AM -0400, Stan Leung wrote:
I am interested in know if anyone has set up clustering for performance and fail over using PostgreSQL. We are currently using Oracle for a distribution application and would like to use PostgreSQL with multiple application and database servers.


Yes, we've done failover stuff using a shared storage, heartbeat, etc.
several times. For performance I prefer to divide the data to different
failover clustered database systems because concurrent writing creates
some huge technical overhead in many cases.

Michael
--
Michael Meskes
Email: Michael at Fam-Meskes dot De
ICQ: 179140304, AIM/Yahoo: michaelmeskes, Jabber: me****@jabber.org
Go SF 49ers! Go Rhein Fire! Use Debian GNU/Linux! Use PostgreSQL!

---------------------------(end of broadcast)---------------------------
TIP 5: Have you checked our extensive FAQ?

http://www.postgresql.org/docs/faqs/FAQ.html

Nov 12 '05 #3

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

1
by: Nico de Groot | last post by:
I have a 2 node Microsoft 2000 cluster with a shared storage device. I want to create automatic failover for MS SQL 2000 server. I can do that wit the following options: 1. Active/Pasive (one...
133
by: Gaurav | last post by:
http://www.sys-con.com/story/print.cfm?storyid=45250 Any comments? Thanks Gaurav
2
by: CSN | last post by:
Just wondering - is there something similar to this (clustering) for PostgreSQL? If so, how does it compare? http://www.mysql.com/press/release_2003_30.html ...
4
by: torrance_bloke | last post by:
Hi, Does anyone know if DB2 has the capability to cluster in an active/active mode over geographical distances. I am aware of the replication tools and HADR capabilities but this is more...
2
by: Mehmet Baserdem | last post by:
Hello all, My bulk data is sitting on a big table. I cluster its rows using views and SQL-UDFs. So far it was ok, but its performance will become an issue soon. Therefore I am looking for...
5
by: toton | last post by:
Hi, I want a few of my class to overload from a base class, where the base class contains common functionality. This is to avoid repetition of code, and may be reducing amount of code in binary,...
3
by: dejavue82 | last post by:
Hi, Does anybody know of a software package that allows for several servers, running asp.net 2.0 to be clustered, regardless of where they are located (ie. without a hardware load balancer)....
5
by: Lakesider | last post by:
Hi NG, I have a question about data: I have travel-times from A to B like this from | to | sec. A B 17 A B 18 A B 30 A B 32
3
by: Manish | last post by:
I think this question has been asked number of times. However, I am looking for some specific information. Perhaps some of you can help close the gap. Or perhaps you can point me towards right...
1
by: CloudSolutions | last post by:
Introduction: For many beginners and individual users, requiring a credit card and email registration may pose a barrier when starting to use cloud servers. However, some cloud server providers now...
0
isladogs
by: isladogs | last post by:
The next Access Europe User Group meeting will be on Wednesday 3 Apr 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM). In this session, we are pleased to welcome former...
0
by: taylorcarr | last post by:
A Canon printer is a smart device known for being advanced, efficient, and reliable. It is designed for home, office, and hybrid workspace use and can also be used for a variety of purposes. However,...
0
by: Charles Arthur | last post by:
How do i turn on java script on a villaon, callus and itel keypad mobile phone
0
by: aa123db | last post by:
Variable and constants Use var or let for variables and const fror constants. Var foo ='bar'; Let foo ='bar';const baz ='bar'; Functions function $name$ ($parameters$) { } ...
0
by: ryjfgjl | last post by:
If we have dozens or hundreds of excel to import into the database, if we use the excel import function provided by database editors such as navicat, it will be extremely tedious and time-consuming...
0
by: emmanuelkatto | last post by:
Hi All, I am Emmanuel katto from Uganda. I want to ask what challenges you've faced while migrating a website to cloud. Please let me know. Thanks! Emmanuel
1
by: nemocccc | last post by:
hello, everyone, I want to develop a software for my android phone for daily needs, any suggestions?
1
by: Sonnysonu | last post by:
This is the data of csv file 1 2 3 1 2 3 1 2 3 1 2 3 2 3 2 3 3 the lengths should be different i have to store the data by column-wise with in the specific length. suppose the i have to...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.