473,288 Members | 1,710 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 473,288 software developers and data experts.

Irreversible performance drop after increasing shared mem

I'm running PG 7.4.1 on FreeBSD 5.2.1_RC1 and experienced a general
40% drop in performance after increasing Shared mem buffers to 2000
(from the 1000 default setting) and the Sort Mem to 1024 from 16.
After changing the .conf file back to the original values, performance
didn't change back. Only after dropping the database and reloading
from dump, did performance return. Is this unusual behavior in
anyone's opinion? (Note that I didn't forget to do a pg_ctl reload to
have postmaster re-read the .conf file.)
Nov 22 '05 #1
2 1231
On Tue, Feb 24, 2004 at 10:40:30AM -0800, jake johnson wrote:
I'm running PG 7.4.1 on FreeBSD 5.2.1_RC1 and experienced a general
40% drop in performance after increasing Shared mem buffers to 2000
(from the 1000 default setting) and the Sort Mem to 1024 from 16.
After changing the .conf file back to the original values, performance
didn't change back. Only after dropping the database and reloading
from dump, did performance return. Is this unusual behavior in
anyone's opinion? (Note that I didn't forget to do a pg_ctl reload to
have postmaster re-read the .conf file.)
Firstly, Sort Mem to 16 is obviously silly. You want this system to be
able to perform sorts without swapping to disk, no? The defaults are so
conservative I don't think you'd ever want to be reducing them.

After you changed the conf file, did you restart the postmaster? Not
just reload, since that won't affect existing sessions I beleive.

And it's not due to anything else you did, like forgetting to VACUUM or
ANALYZE after a large load or update.

Hope this helps,
--
Martijn van Oosterhout <kl*****@svana.org> http://svana.org/kleptog/ If the Catholic church can survive the printing press, science fiction
will certainly weather the advent of bookwarez.
http://craphound.com/ebooksneitherenorbooks.txt - Cory Doctorow


-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.0.6 (GNU/Linux)
Comment: For info see http://www.gnupg.org

iD8DBQFAQRO+Y5Twig3Ge+YRAj+ZAKCGNB1lN/JvdrEeLT4rij2incdShwCgge4X
M2/Zpg7AXACYjdnEasdsc4I=
=Ev6a
-----END PGP SIGNATURE-----

Nov 23 '05 #2
Martijn van Oosterhout <kl*****@svana.org> writes:
After you changed the conf file, did you restart the postmaster? Not
just reload, since that won't affect existing sessions I beleive.


SIGHUP will cause existing sessions to adopt a new value of sort_mem
from the config file (unless it's been locally overridden, eg with SET).

However, shared_buffers can only be set at postmaster start, so changing
it in the config file will affect nothing unless you stop and restart
the postmaster.

regards, tom lane

---------------------------(end of broadcast)---------------------------
TIP 1: subscribe and unsubscribe commands go to ma*******@postgresql.org

Nov 23 '05 #3

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

17
by: lkrubner | last post by:
I've got a PHP application that's 2 megs in size. Of that, my guess is 200k-400k is comments. Do they impose a performance hit? I've been postponing any kind of optimization, but at some point I'll...
7
by: Christos TZOTZIOY Georgiou | last post by:
Last night I was compiling the latest python snapshot at my home Linux system (a K6-III @420 --the extra 20 Hz is overclocking :); then I tried building a shared version of the interpreter. I did...
0
by: Clay Luther | last post by:
I am doing to large dataset performance tests with 7.3.4b2 today and I noticed an interesting phenomenon. My shared memory buffers are set at 128MB. Peak postmaster usage appears to be around 90MB....
16
by: David W. Fenton | last post by:
http://www.granite.ab.ca/access/performancefaq.htm I hope Tony doesn't mind my opening a discussion of some issues on his performance FAQ page here in the newsgroup. This is not meant as...
20
by: jeevankodali | last post by:
Hi I have an .Net application which processes thousands of Xml nodes each day and for each node I am using around 30-40 Regex matches to see if they satisfy some conditions are not. These Regex...
2
by: Jonesgj | last post by:
Hi, I have a test box which I would like to monitor CPU usage and run queue during the day. I don't want to buy any 3rd party tool, if I can do it easily, as I only need to monitor the box's...
5
by: Suhas Vengilat | last post by:
Hi All, In one of the project discussions, one team member raised a question whether the usage of asp.net validation controls (like RequiredFieldValidator, CustomValidator, RegularExpression...
9
by: HC | last post by:
Hello, all, I started out thinking my problems were elsewhere but as I have worked through this I have isolated my problem, currently, as a difference between MSDE and SQL Express 2005 (I'll just...
1
by: Larry Bates | last post by:
I have a need to implement a drop folder upload mechanism for secure uploading of files to a server. At first glance this appears that it would be an easy application to write. Then I begin to...
0
by: DolphinDB | last post by:
The formulas of 101 quantitative trading alphas used by WorldQuant were presented in the paper 101 Formulaic Alphas. However, some formulas are complex, leading to challenges in calculation. Take...
0
by: DolphinDB | last post by:
Tired of spending countless mintues downsampling your data? Look no further! In this article, you’ll learn how to efficiently downsample 6.48 billion high-frequency records to 61 million...
0
by: Aftab Ahmad | last post by:
Hello Experts! I have written a code in MS Access for a cmd called "WhatsApp Message" to open WhatsApp using that very code but the problem is that it gives a popup message everytime I clicked on...
0
by: Aftab Ahmad | last post by:
So, I have written a code for a cmd called "Send WhatsApp Message" to open and send WhatsApp messaage. The code is given below. Dim IE As Object Set IE =...
0
by: ryjfgjl | last post by:
ExcelToDatabase: batch import excel into database automatically...
0
isladogs
by: isladogs | last post by:
The next Access Europe meeting will be on Wednesday 6 Mar 2024 starting at 18:00 UK time (6PM UTC) and finishing at about 19:15 (7.15PM). In this month's session, we are pleased to welcome back...
0
by: marcoviolo | last post by:
Dear all, I would like to implement on my worksheet an vlookup dynamic , that consider a change of pivot excel via win32com, from an external excel (without open it) and save the new file into a...
0
by: Vimpel783 | last post by:
Hello! Guys, I found this code on the Internet, but I need to modify it a little. It works well, the problem is this: Data is sent from only one cell, in this case B5, but it is necessary that data...
1
by: PapaRatzi | last post by:
Hello, I am teaching myself MS Access forms design and Visual Basic. I've created a table to capture a list of Top 30 singles and forms to capture new entries. The final step is a form (unbound)...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.