473,326 Members | 2,655 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 473,326 software developers and data experts.

mysql eating big chunks of memory

Hi all

I'm running version 4.0.16 on solaris 8 as the backend for a web site
serving around 12 million pages impressions a month. The performance
of the server is monitored using orcollator.

I'm finding that the memory usage on the server remains pretty
constant for weeks at a time at around 300 Meg but then every once in
a while the size of the mysqld process jumps anywhere between another
50 and 250 Meg. It then stays at this new size until mysql is
restared (or jumps again). The memory increase appears to remain as
resident according to the output of top.

The site has a content management system which connects directly to
the production data base as well which while it is used daily has some
functionality which is only used as frequently as this problem occurs
making me suspect it is the culprit.

What I could really do with some advice on is

- What are the most likely causes of the memory loss.

- whether there are tools that allow you to see a breakdown of how the
current memory is being used by mysql, or even better monitor it over
time, in order to establish the source of the problem.

- And if there aren't any such tools how best to approach this.

many thanks

bobby
Jul 20 '05 #1
3 1984
Isn't it that the extra mem is used for caching?
And that the cache is dropt after the restart?

if it's only 250MB extra, just invest in extra mem and problem solved.

I mean, spending time to fix it while it, costs maybe some hours of work.
Buying extra mem, maybe cheaper.

And since you say, it's a constant maximum..
It seems easy to predict :)

That's all, for my 2 cents,
Wouter
"Bobby Torkington" <bo*************@yahoo.co.uk> wrote in message
news:fe**************************@posting.google.c om...
: Hi all
:
: I'm running version 4.0.16 on solaris 8 as the backend for a web site
: serving around 12 million pages impressions a month. The performance
: of the server is monitored using orcollator.
:
: I'm finding that the memory usage on the server remains pretty
: constant for weeks at a time at around 300 Meg but then every once in
: a while the size of the mysqld process jumps anywhere between another
: 50 and 250 Meg. It then stays at this new size until mysql is
: restared (or jumps again). The memory increase appears to remain as
: resident according to the output of top.
:
: The site has a content management system which connects directly to
: the production data base as well which while it is used daily has some
: functionality which is only used as frequently as this problem occurs
: making me suspect it is the culprit.
:
: What I could really do with some advice on is
:
: - What are the most likely causes of the memory loss.
:
: - whether there are tools that allow you to see a breakdown of how the
: current memory is being used by mysql, or even better monitor it over
: time, in order to establish the source of the problem.
:
: - And if there aren't any such tools how best to approach this.
:
: many thanks
:
: bobby
Jul 20 '05 #2
> Isn't it that the extra mem is used for caching?

Thats what i'm trying to find out. Is there someway I can tell or is
that the only likely explanation?
I mean, spending time to fix it while it, costs maybe some hours of work.
Buying extra mem, maybe cheaper.
Getting sign off here for new kit isn't that straightforward and this
isn't enough of a problem yet to justify taking the sites offline
while the memory is installed.
And since you say, it's a constant maximum..
It seems easy to predict :)


Not really - I've no idea what size the jumps are going to be or when
they are going to happen, all i know is they dont clear 'till I do a
restart.

The main reason for wanting to get to the bottom of this is that I
like to try and undertand whats going on on the servers I'm
responsible for :)

thanks
Jul 20 '05 #3
: > I mean, spending time to fix it while it, costs maybe some hours of
work.
: > Buying extra mem, maybe cheaper.
:
: Getting sign off here for new kit isn't that straightforward and this
: isn't enough of a problem yet to justify taking the sites offline
: while the memory is installed.

Ok, I just though; easy way; hot plug-in memory ;)
But if you don't know the max size, it's hard to fix :)

Sorry, I don't know a program to check what takes the memory, I only use
WinMySQLAdmin
and the Windows Task Manager.
And can't come up with more then witch on logging of every thing (unless it
takes to much server capacity).

And then delete all logs that are in time far way from the memory increase
event.
Then sort out what happens at these times.

But well, you already fouth about that to ;) didn't you.
Sorry, can't help.

good luck
Jul 20 '05 #4

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

1
by: Kerry Shetline | last post by:
I've successfully installed MySQL and the Perl DBI module, but when I try to install DBD::mysql, it keeps failing like this: -------------------- (from the CPAN shell) --------------------- .......
6
by: MackS | last post by:
Hello everyone I am faced with the following problem. For the first time I've asked myself "might this actually be easier to code in C rather than in python?", and I am not looking at device...
0
by: Richard Marsden | last post by:
I'm having a lot of trouble writing large chunks of binary data (tests are in the range of 16-512K, but we need support for large longblobs) to MySQL using ODBC. Database is local on a W2K system,...
1
by: Good Man | last post by:
Hi there I've noticed some very weird things happening with my current MySQL setup on my XP Laptop, a development machine. For a while, I have been trying to get the MySQL cache to work....
0
by: smgorham | last post by:
Greetings. I have scoured through usenet to find out how to help my server.Here are my specs Dual P4 2.8G 2GB Ram Redhat Ent. Linux 3 ES mysql verson 3.23.58 Here is what I have in my...
2
by: speralta | last post by:
My tired old eyes may be failing me, but the following insert statements look correct to me, but I can't seem to get a clean insert from a fairly large text file database into mysql. I was...
5
by: Per B. Sederberg | last post by:
Hi Everybody: I'm having a difficult time figuring out a a memory use problem. I have a python program that makes use of numpy and also calls a small C module I wrote because part of the...
5
by: Sean | last post by:
Hi, I have a variable declared as the following: char * buf; I then get a size of a file and allocate memory and point the buf to it. Here is where I am having a problem. I want to know how I...
4
by: matthud | last post by:
//GET INSERTED CHUNK ID $getid = mysql_query("SELECT id FROM chunks WHERE chunk = '$chunk'"); $idrow = mysql_fetch_array($getid, MYSQL_ASSOC); $chunkid = $idrow.","; $eachtag = explode(",",...
0
by: DolphinDB | last post by:
Tired of spending countless mintues downsampling your data? Look no further! In this article, you’ll learn how to efficiently downsample 6.48 billion high-frequency records to 61 million...
0
by: ryjfgjl | last post by:
ExcelToDatabase: batch import excel into database automatically...
0
isladogs
by: isladogs | last post by:
The next Access Europe meeting will be on Wednesday 6 Mar 2024 starting at 18:00 UK time (6PM UTC) and finishing at about 19:15 (7.15PM). In this month's session, we are pleased to welcome back...
1
isladogs
by: isladogs | last post by:
The next Access Europe meeting will be on Wednesday 6 Mar 2024 starting at 18:00 UK time (6PM UTC) and finishing at about 19:15 (7.15PM). In this month's session, we are pleased to welcome back...
0
by: Vimpel783 | last post by:
Hello! Guys, I found this code on the Internet, but I need to modify it a little. It works well, the problem is this: Data is sent from only one cell, in this case B5, but it is necessary that data...
1
by: PapaRatzi | last post by:
Hello, I am teaching myself MS Access forms design and Visual Basic. I've created a table to capture a list of Top 30 singles and forms to capture new entries. The final step is a form (unbound)...
1
by: Shællîpôpï 09 | last post by:
If u are using a keypad phone, how do u turn on JavaScript, to access features like WhatsApp, Facebook, Instagram....
0
by: Faith0G | last post by:
I am starting a new it consulting business and it's been a while since I setup a new website. Is wordpress still the best web based software for hosting a 5 page website? The webpages will be...
0
isladogs
by: isladogs | last post by:
The next Access Europe User Group meeting will be on Wednesday 3 Apr 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM). In this session, we are pleased to welcome former...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.