471,328 Members | 1,890 Online
Bytes | Software Development & Data Engineering Community
Post +

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 471,328 software developers and data experts.

Memory Logging

Hey all,

I'm running some data analysis scripts that, due to the input file
size, tend to be quite memory intensive. I've been reading up on
Python's memory allocation (I'm using 2.4 and am locked into it, so I
don't have the new fixes in 2.5) but because of the nature of its
looping I don't think its losing much memory because of some of the
deallocation issues - it will reuse the ints and lists that Python is
retaining references to.

Because of this I suspect there are other memory leaks, and I'm trying
to find out where; some method through which I could monitor memory
usage as the script runs would be extremely helpful, even if it just
prints the amount of memory python is using every time I call a
particular command.

I've tried using the profile module; the output didn't seem
particularly helpful in terms of memory usage.

In case OS-specific commands are required, all the machines it will
run on are using Windows XP.

Thanks,
-- Aneesh Goel

Jul 24 '07 #1
0 865

This discussion thread is closed

Replies have been disabled for this discussion.

Similar topics

4 posts views Thread by xixi | last post: by
1 post views Thread by BuddyWork | last post: by
5 posts views Thread by Jim | last post: by
6 posts views Thread by Tina | last post: by
2 posts views Thread by asterixgallier | last post: by
3 posts views Thread by Sam Samson | last post: by
reply views Thread by rosydwin | last post: by

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.