471,338 Members | 1,031 Online
Bytes | Software Development & Data Engineering Community
Post +

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 471,338 software developers and data experts.

Understanding memory leak reports

Hi,
I'm in a big trouble since I don't know how to find some memory leaks
I just discovered in a program of mine.
By putting:

import gc
gc.set_debug(gc.DEBUG_LEAK)

...at the end of a script which imports a module I wrote it seems I
have some memory leaks scattered around.
The message printed on screen is the following:

gc: collectable <function 00C70E70>
gc: collectable <type 00B41018>
gc: collectable <dict 00C6DE40>
gc: collectable <tuple 00C09900>
gc: collectable <tuple 00BCD510>
gc: collectable <function 00C70EB0>
gc: collectable <function 00C70E30>

Since the main module is very big (more than 2800 lines of code) I do
not understand which objects are not garbage collected.
Is there a way to have a more detailed message to know which objects
are not garbage collected?
For example "function foo", "method MyClass.bar", "dict my_dict"...
"function 00C70E70" and "tuple 00C09900" are too much generic messages
which don't give me an idea about where the leak could be.
Dec 21 '07 #1
5 3913
On Dec 21, 12:44 pm, "Giampaolo Rodola'" <gne...@gmail.comwrote:
Hi,
I'm in a big trouble since I don't know how to find some memory leaks
I just discovered in a program of mine.
By putting:

import gc
gc.set_debug(gc.DEBUG_LEAK)

..at the end of a script which imports a module I wrote it seems I
have some memory leaks scattered around.
The message printed on screen is the following:

gc: collectable <function 00C70E70>
gc: collectable <type 00B41018>
gc: collectable <dict 00C6DE40>
gc: collectable <tuple 00C09900>
gc: collectable <tuple 00BCD510>
gc: collectable <function 00C70EB0>
gc: collectable <function 00C70E30>

Since the main module is very big (more than 2800 lines of code) I do
not understand which objects are not garbage collected.
Is there a way to have a more detailed message to know which objects
are not garbage collected?
For example "function foo", "method MyClass.bar", "dict my_dict"...
"function 00C70E70" and "tuple 00C09900" are too much generic messages
which don't give me an idea about where the leak could be.
I've never done this before, but here's what I found while Googling:

Recipe that supposedly gives more info:
http://aspn.activestate.com/ASPN/Coo...n/Recipe/65333

Another thread on the same topic that looks quite detailed:
http://www.thescripts.com/forum/thread22097.html

An article or two on memory leaks in Python:
http://utcc.utoronto.ca/~cks/space/b...honMemoryLeaks
http://www.nightmare.com/medusa/memory-leaks.html

I hope they help.

Mike
Dec 21 '07 #2
On 21 Dic, 20:10, kyoso...@gmail.com wrote:
On Dec 21, 12:44 pm, "Giampaolo Rodola'" <gne...@gmail.comwrote:


Hi,
I'm in a big trouble since I don't know how to find some memory leaks
I just discovered in a program of mine.
By putting:
import gc
gc.set_debug(gc.DEBUG_LEAK)
..at the end of a script which imports a module I wrote it seems I
have some memory leaks scattered around.
The message printed on screen is the following:
gc: collectable <function 00C70E70>
gc: collectable <type 00B41018>
gc: collectable <dict 00C6DE40>
gc: collectable <tuple 00C09900>
gc: collectable <tuple 00BCD510>
gc: collectable <function 00C70EB0>
gc: collectable <function 00C70E30>
Since the main module is very big (more than 2800 lines of code) I do
not understand which objects are not garbage collected.
Is there a way to have a more detailed message to know which objects
are not garbage collected?
For example "function foo", "method MyClass.bar", "dict my_dict"...
"function 00C70E70" and "tuple 00C09900" are too much generic messages
which don't give me an idea about where the leak could be.

I've never done this before, but here's what I found while Googling:

Recipe that supposedly gives more info:http://aspn.activestate.com/ASPN/Coo...n/Recipe/65333

Another thread on the same topic that looks quite detailed:http://www.thescripts.com/forum/thread22097.html

An article or two on memory leaks in Python:http://utcc.utoronto.ca/~cks/space/b...ory-leaks.html

I hope they help.

Mike- Nascondi testo tra virgolette -

- Mostra testo tra virgolette -
Thanks for your search but I haven't actually found a solution yet.
I've tried to search into the cookbook. I found other recipes playing
with the gc module but it seems that none of them are useful for
finding out the names of the objects causing the memory leak.
I've tried to play with gc.get_objects() in the hope to find the real
names manually but it returns a very large number of objects.
If only I could find a way to make gc.get_objects() returning leaking
objects only it would be a step forward...
Does someone have an idea about how doing such a thing?
Dec 21 '07 #3
Giampaolo Rodola' <gn****@gmail.comwrote:
>I'm in a big trouble since I don't know how to find some memory leaks
....
>The message printed on screen is the following:

gc: collectable <function 00C70E70>
gc: collectable <type 00B41018>
gc: collectable <dict 00C6DE40>
gc: collectable <tuple 00C09900>
gc: collectable <tuple 00BCD510>
gc: collectable <function 00C70EB0>
gc: collectable <function 00C70E30>

Since the main module is very big (more than 2800 lines of code) I do
not understand which objects are not garbage collected.
They are being garbage collected. That's what the "collectable" part
of the message means. It's just a warning that those objects needed
to be garbage collected because they were refering to each other in
some sort of cycle. While the memory used was being wasted before the
garbage collector ran, it probably doesn't have any negative effect on
your program.

Ross Ridge

--
l/ // Ross Ridge -- The Great HTMU
[oo][oo] rr****@csclub.uwaterloo.ca
-()-/()/ http://www.csclub.uwaterloo.ca/~rridge/
db //
Dec 22 '07 #4
On 22 Dic, 01:27, Ross Ridge <rri...@caffeine.csclub.uwaterloo.ca>
wrote:
Giampaolo Rodola' <gne...@gmail.comwrote:
I'm in a big trouble since I don't know how to find some memory leaks
...
The message printed on screen is the following:
gc: collectable <function 00C70E70>
gc: collectable <type 00B41018>
gc: collectable <dict 00C6DE40>
gc: collectable <tuple 00C09900>
gc: collectable <tuple 00BCD510>
gc: collectable <function 00C70EB0>
gc: collectable <function 00C70E30>
Since the main module is very big (more than 2800 lines of code) I do
not understand which objects are not garbage collected.

They are being garbage collected. *That's what the "collectable" part
of the message means. *It's just a warning that those objects needed
to be garbage collected because they were refering to each other in
some sort of cycle. *While the memory used was being wasted before the
garbage collector ran, it probably doesn't have any negative effect on
your program.

* * * * * * * * * * * * * * * * * * * * * * * * Ross Ridge
Uhm... that's a good news altough it doesn't seem to me that I used
any sort of cicle.
Thank you.
Dec 22 '07 #5
On Dec 21, 1:44 pm, "Giampaolo Rodola'" <gne...@gmail.comwrote:
Since the main module is very big (more than 2800 lines of code)
maybe that is the actual problem to begin with,

you should refactor it so it it more modular and trackable, otherwise
this is just one of the many issues that will crop up,

just an opinion.

i.

Dec 22 '07 #6

This discussion thread is closed

Replies have been disabled for this discussion.

Similar topics

5 posts views Thread by blugus | last post: by
7 posts views Thread by Xing | last post: by
7 posts views Thread by Salvador | last post: by
3 posts views Thread by Jim Land | last post: by
1 post views Thread by Archana | last post: by
22 posts views Thread by Peter | last post: by
3 posts views Thread by not_a_commie | last post: by
reply views Thread by rosydwin | last post: by

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.