reading an xml file problem

[adhag]

Hi

I have an app that uses xpath to read an xml document. The problem is a
70meg file uses 1.5 gig of memory. What I really need is to read only chunks
of the file at a given time and cannot afford the overhead of reading in 1.5
gig of memory. A simplified example would be an xml file of 100 rows that I
wanted to return random chunks of records without reading in all 100 rows
each time. I would have a row number and a set number of rows to return.

Any help to solve this would be great.

Robin

[Martin Honnen]

adhag wrote:

I have an app that uses xpath to read an xml document. The problem is a
70meg file uses 1.5 gig of memory. What I really need is to read only chunks
of the file at a given time and cannot afford the overhead of reading in 1.5
gig of memory. A simplified example would be an xml file of 100 rows that I
wanted to return random chunks of records without reading in all 100 rows
each time. I would have a row number and a set number of rows to return.

Consider using XmlTextReader to parse the XML. That way the resources
processed do not depend on the file size as XPath reads the complete XML
into a tree model while XmlTextReader allows you to pull in the XML node
by node.

There is also this article
<http://msdn.microsoft.com/XML/BuildingXML/XMLColumns/default.aspx?pull=/library/en-us/dnexxml/html/xml05192004.asp>
which tries to combine XPath with an XmlReader.

--

Martin Honnen --- MVP XML
http://JavaScript.FAQTs.com/