473,789 Members | 1,942 Online
Bytes | Software Development & Data Engineering Community
+ Post

Home Posts Topics Members FAQ

profiling memory usage

Hi,

I am looking for a method to profile memory usage in my python program.
The program provides web service and therefore is intended to run for a
long time. However, the memory usage tends to increase all the time,
until in a day or two the system cannot handle it any more and starts
to do constant swapping. Is there a way to look at which objects or
variables are taking the huge amount of memory space?

Thanks,

Eddie

Oct 5 '06 #1
3 1504
On 5 Oct 2006 16:21:50 -0700, Eddie <ca*******@gmai l.comwrote:
Hi,

I am looking for a method to profile memory usage in my python program.
The program provides web service and therefore is intended to run for a
long time. However, the memory usage tends to increase all the time,
until in a day or two the system cannot handle it any more and starts
to do constant swapping. Is there a way to look at which objects or
variables are taking the huge amount of memory space?
Have a look at:
http://www.velocityreviews.com/forum...-profiler.html

--
Remember that time Thotsakan punched Neil Bush in the dick?
Oct 6 '06 #2
The latest Python release 2.5 includes improvements to the memory
manager and *may* work better for you, it all depends on the root cause
of the problem. For more details, see the 5th bullet on this page
<http://docs.python.org/whatsnew/ports.html>.

/Jean Brouwers
Eddie wrote:
Hi,

I am looking for a method to profile memory usage in my python program.
The program provides web service and therefore is intended to run for a
long time. However, the memory usage tends to increase all the time,
until in a day or two the system cannot handle it any more and starts
to do constant swapping. Is there a way to look at which objects or
variables are taking the huge amount of memory space?

Thanks,

Eddie
Oct 6 '06 #3

Hi,

I am looking for a method to profile memory usage in my python program.
The program provides web service and therefore is intended to run for a
long time. However, the memory usage tends to increase all the time,
until in a day or two the system cannot handle it any more and starts
to do constant swapping. Is there a way to look at which objects or
variables are taking the huge amount of memory space?

Thanks,
Oct 6 '06 #4

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

1
2499
by: Rune Froysa | last post by:
I have a fairly large program that uses a number of third-party modules. After a few hours the program eats several 100M of memory. Does Python provide any tools that can help in determining where the memory is used? Ideally, I would like to see a tool that can list all objects by memory-usage, but any tool that can return the number of bytes used by an arbitrary object would be of great help. Even something that could find all...
0
397
by: Bernd E via DotNetMonster.com | last post by:
Hello group, this mail is intended to provide a .NET tracing & profiling tool. This tool is free of charge and without any constraints regarding functionality or time of usage. For download see: http://speedtrace.ipcas.com/download/ What can we improve about this tool? We appreciate your feedback. ----------------- Bernd Ehresmann ipcas GmbH Product Manager
2
1256
by: Frank Rizzo | last post by:
I am trying to profile the memory usage of an application. In Task Manager, I can add Virtual Memory Usage (VM Usage). I am confused by this metric. Usually it is close to the Mem Usage value. However, on my laptop I turned off Virtual memory (e.g. I have no paging file), since I have more than enough RAM. So one would think that VM Size column in the Task Manager would be all zeroes. It is not. Does VM Size mean something else? ...
1
929
by: Jon | last post by:
I have a service written in VB.Net 2. This service runs every 30 seconds and connects to an external web service to get some data, then parses and saves that data to our database. For some reason, after a while the machine it's running on begins to crawl. CPU usage shows as 0-2% for the service when it's running, and about 7% for the machine overall. Memory consumption starts out at about 34 megs, and never goes higher than 40 megs. I...
9
4218
by: jeungster | last post by:
Hello, I'm trying to track down a memory issue with a C++ application that I'm working on: In a nutshell, the resident memory usage of my program continues to grow as the program runs. It starts off at a nice 4% of memory, then slowly grows up to 50% and beyond. This translates to around 2 gigs of physical memory, and that's really way more memory than this program should be taking up.
7
4488
by: =?Utf-8?B?RGF2aWQgSm9uZXM=?= vpac org> | last post by:
I'm posting this here and on the VS Forum (C#) and on XP Embedded ng I have an XPe system that runs a .NET (C#) app that works with external hw via USB ports. The app consists of a number of C# DLLs plus wrappers around the hw dll APIs (ie platform invoke. On a 1 Gig system the system maxes out at 100% CPU usage. On a 1.9 Duo system it runs at about 33% (total) CPU usage. The code written by someone else needs some profiling etc.
1
1431
by: JamesHoward | last post by:
Are there any good thread profilers available that can profile a thread as it is running instead of after execution is completed? I would like to find a python class which looks at a currently running thread and if its memory exceeds a certain amount than kill it. Ideally I would like the program to track memory used not just by that thread, but by any threads or processes that it may spawn. If there isn't anything like that, then...
2
2719
by: Jaroslaw Szczepankiewicz | last post by:
Hi is it possible to profile memory usage of single function, ideally it would be to see stack tree with memory info of each function (current usage of memory before and after executing function), do you know any tool that allows that function? Thanks in advance.
1
2047
by: Jean-Paul Calderone | last post by:
On Tue, 22 Apr 2008 14:54:37 -0700 (PDT), yzghan@gmail.com wrote: The test doesn't demonstrate any leaks. It does demonstrate that memory usage can remain at or near peak memory usage even after the objects for which that memory was allocated are no longer live in the process. This is only a leak if peak memory goes up again each time you create any new objects. Try repeated allocations of a large dictionary and observe how memory...
0
9656
marktang
by: marktang | last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However, people are often confused as to whether an ONU can Work As a Router. In this blog post, we’ll explore What is ONU, What Is Router, ONU & Router’s main usage, and What is the difference between ONU and Router. Let’s take a closer look ! Part I. Meaning of...
0
10374
Oralloy
by: Oralloy | last post by:
Hello folks, I am unable to find appropriate documentation on the type promotion of bit-fields when using the generalised comparison operator "<=>". The problem is that using the GNU compilers, it seems that the internal comparison operator "<=>" tries to promote arguments from unsigned to signed. This is as boiled down as I can make it. Here is my compilation command: g++-12 -std=c++20 -Wnarrowing bit_field.cpp Here is the code in...
0
9969
tracyyun
by: tracyyun | last post by:
Dear forum friends, With the development of smart home technology, a variety of wireless communication protocols have appeared on the market, such as Zigbee, Z-Wave, Wi-Fi, Bluetooth, etc. Each protocol has its own unique characteristics and advantages, but as a user who is planning to build a smart home system, I am a bit confused by the choice of these technologies. I'm particularly interested in Zigbee because I've heard it does some...
0
8998
agi2029
by: agi2029 | last post by:
Let's talk about the concept of autonomous AI software engineers and no-code agents. These AIs are designed to manage the entire lifecycle of a software development project—planning, coding, testing, and deployment—without human intervention. Imagine an AI that can take a project description, break it down, write the code, debug it, and then launch it, all on its own.... Now, this would greatly impact the work of software developers. The idea...
0
6750
by: conductexam | last post by:
I have .net C# application in which I am extracting data from word file and save it in database particularly. To store word all data as it is I am converting the whole word file firstly in HTML and then checking html paragraph one by one. At the time of converting from word file to html my equations which are in the word document file was convert into image. Globals.ThisAddIn.Application.ActiveDocument.Select();...
0
5405
by: TSSRALBI | last post by:
Hello I'm a network technician in training and I need your help. I am currently learning how to create and manage the different types of VPNs and I have a question about LAN-to-LAN VPNs. The last exercise I practiced was to create a LAN-to-LAN VPN between two Pfsense firewalls, by using IPSEC protocols. I succeeded, with both firewalls in the same network. But I'm wondering if it's possible to do the same thing, with 2 Pfsense firewalls...
0
5540
by: adsilva | last post by:
A Windows Forms form does not have the event Unload, like VB6. What one acts like?
1
4078
by: 6302768590 | last post by:
Hai team i want code for transfer the data from one system to another through IP address by using C# our system has to for every 5mins then we have to update the data what the data is updated we have to send another system
2
3677
muto222
by: muto222 | last post by:
How can i add a mobile payment intergratation into php mysql website.

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.