473,883 Members | 2,177 Online
Bytes | Software Development & Data Engineering Community
+ Post

Home Posts Topics Members FAQ

Small but significant memory leak in Pyana XSLT processor

Hi all

I'm working with a long running, threaded server which serves HTTP
requests with content which are passed through a XSLT processor. The
XSLT processor I'm using is the Pyana processor.

I have one compiled stylesheet which I uses to process all responses.
This way I only need to read and compile the stylesheet once.

When serving a rather small page 404-page I get the server to process
300-400 requests per second over a LAN connection. This is from the
apache benchmark program, I don't know how reliable these numbers are
but they give me some guidance.

My problem:

When serving my content without the XSLT processor the process size
remains the same size. (about 18MB in the windows task manager). But
when I use the XSLT processor the process will slowly gain size. About
1MB for each 10k requests, and this memory are not freed.

I feel certain that the leak are located in the XSLT processor since the
problem occurs when that is plugged into the system.

There is not much wrapping code so I don't think the problem are of that
manner.

So I wonder if anyone have had the same experience with this XSLT
toolkit before and if you were able to fix it.

The software I'm using on the computer I've done the tests on:

Python 2.4 (ActivePython)
Pyana 0.9.2
Win XP Pro SP2

I've tried with both precompiled and self compiled versions of the Pyana
package.

ola

--
--------------------------------------
Ola Natvig <ol********@inf osense.no>
infoSense AS / development
Jul 18 '05 #1
1 1602
Ola Natvig wrote:
My problem:

When serving my content without the XSLT processor the process size
remains the same size. (about 18MB in the windows task manager). But
when I use the XSLT processor the process will slowly gain size. About
1MB for each 10k requests, and this memory are not freed.

I feel certain that the leak are located in the XSLT processor since the
problem occurs when that is plugged into the system.

There is not much wrapping code so I don't think the problem are of that
manner.

So I wonder if anyone have had the same experience with this XSLT
toolkit before and if you were able to fix it.


I'm the author of the Pyana package and, to the best of my knowledge,
Pyana does not have any memory leaks. It seems like there are three
possibilities: your code is leaking somehow (seems unlikely based on
the above), Pyana is leaking (very possible) or Xalan is leaking (very
possible).

If Pyana is leaking then it is likely that the problem can be fairly
easily isolated and fixed (by me). Would it be possible for you to
isolate the leaking code and send it to me? If that is not possible,
then let me know and I can recommend steps to help find the problem
youself.

Cheers,
Brian
Jul 18 '05 #2

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

5
4828
by: Qin Zhou | last post by:
This is possible memory leak can be reproduced by the following code. I am hoping someone can help me out with simple solutions! Thanks in advanced! using System; using System.IO; using System.Xml; using System.Xml.Schema; using System.Xml.XPath; using System.Xml.Xsl;
0
1668
by: Brian Piscopo | last post by:
Memory leak and .NET -- like oil and water :- I've written a distributed system for parallel processing of large tasks. Each machine has an agent on it that sends processor usage information back to the controlling apps so that tasks can be distributed based on current system load. Obviously I need to do this on a timer, so that I always have current CPU utilization info ... The problem is that I can't seem to stop my agent's memory usage...
5
2648
by: iceColdFire | last post by:
Hi, I am writing some hybrid application s using C/C++ modules together....Here I have created and used a lot of malloc(...) and new(...) operators. I am interested in checking on the optimisation part of the programs...like memory consumed,memory leak , processor utilisation and like...most of the info I got from task manager...however still I cand find way to check on memory leaks...
15
2807
by: Chetan Raj | last post by:
Hi All, We have a web-application in asp.net that interacts with legacy code written in COM. The memory usage in aspnet_wp.exe increases every sec and never reduces. Using the .NET performance counters, we found that unmanaged memory was 90% of the total private bytes of aspnet_wp.exe. We suspected that the COM code has memory leaks. So we made it as a COM+ Service running as dllhost.exe. Surprisingly, there was no memory increase in...
1
1643
by: John Moore | last post by:
I have a set of code that is called on every page load that loads an xslt file. The xslt file has an embedded <script> tag. Loading the page mutliple times causes aspnet_wp.exe to use all available memory and then reset. As this happens several times over the course of an 8 hour stress run, I'm looking for a solution. The xslt file has the following: <xsl:if test="$strPageCaller=''"> <SCRIPT LANGUAGE="JavaScript">BPB()</SCRIPT>...
16
2397
by: JCauble | last post by:
We have a large Asp.net application that is currently crashing our production servers. What we are seeing is the aspnet_wp eat up a bunch of memory and then stop unexpectedly. Does not recycle. Example: After about 5 hours with a concurrent user base of about 150 users the application raises the aspnet_wp memory usage by almost 500MB. If our server guys modify the web.config this data is released and the workerprocess goes back to a...
1
2322
by: Charlotte | last post by:
Hello, We are doing a stability test on our application to prepare for Microsoft SQL Server 2000 certification, and we found a memory leak, but we cannot find its source and fix it. We use an ASP page written in JScript that connects to Analysis Services 2000 using ADOMD and retrieves data from it (this is a very simplified version of our real application that we created just to test the memory leak), see the code below.
3
2014
by: thomas.porschberg | last post by:
Hi, I want to read records from a database and export it in an arbitrary format. My idea was to feed a class with a String array fetched from the database and let this class fire SAX events as processor input. The basic class hierarchy is:
0
9948
marktang
by: marktang | last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However, people are often confused as to whether an ONU can Work As a Router. In this blog post, we’ll explore What is ONU, What Is Router, ONU & Router’s main usage, and What is the difference between ONU and Router. Let’s take a closer look ! Part I. Meaning of...
0
9798
by: Hystou | last post by:
Most computers default to English, but sometimes we require a different language, especially when relocating. Forgot to request a specific language before your computer shipped? No problem! You can effortlessly switch the default language on Windows 10 without reinstalling. I'll walk you through it. First, let's disable language synchronization. With a Microsoft account, language settings sync across devices. To prevent any complications,...
0
10422
tracyyun
by: tracyyun | last post by:
Dear forum friends, With the development of smart home technology, a variety of wireless communication protocols have appeared on the market, such as Zigbee, Z-Wave, Wi-Fi, Bluetooth, etc. Each protocol has its own unique characteristics and advantages, but as a user who is planning to build a smart home system, I am a bit confused by the choice of these technologies. I'm particularly interested in Zigbee because I've heard it does some...
1
7980
isladogs
by: isladogs | last post by:
The next Access Europe User Group meeting will be on Wednesday 1 May 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM). In this session, we are pleased to welcome a new presenter, Adolph Dupré who will be discussing some powerful techniques for using class modules. He will explain when you may want to use classes instead of User Defined Types (UDT). For example, to manage the data in unbound forms. Adolph will...
0
7137
by: conductexam | last post by:
I have .net C# application in which I am extracting data from word file and save it in database particularly. To store word all data as it is I am converting the whole word file firstly in HTML and then checking html paragraph one by one. At the time of converting from word file to html my equations which are in the word document file was convert into image. Globals.ThisAddIn.Application.ActiveDocument.Select();...
0
5807
by: TSSRALBI | last post by:
Hello I'm a network technician in training and I need your help. I am currently learning how to create and manage the different types of VPNs and I have a question about LAN-to-LAN VPNs. The last exercise I practiced was to create a LAN-to-LAN VPN between two Pfsense firewalls, by using IPSEC protocols. I succeeded, with both firewalls in the same network. But I'm wondering if it's possible to do the same thing, with 2 Pfsense firewalls...
1
4623
by: 6302768590 | last post by:
Hai team i want code for transfer the data from one system to another through IP address by using C# our system has to for every 5mins then we have to update the data what the data is updated we have to send another system
2
4230
muto222
by: muto222 | last post by:
How can i add a mobile payment intergratation into php mysql website.
3
3242
bsmnconsultancy
by: bsmnconsultancy | last post by:
In today's digital era, a well-designed website is crucial for businesses looking to succeed. Whether you're a small business owner or a large corporation in Toronto, having a strong online presence can significantly impact your brand's success. BSMN Consultancy, a leader in Website Development in Toronto offers valuable insights into creating effective websites that not only look great but also perform exceptionally well. In this comprehensive...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.