XML DOM, but in chunks

[Sean Davis]

I have some very large XML files that are basically recordsets. I
would like to access each record, one-at-a-time, and I particularly
like the ElementTree library for accessing the data. Is there a way
to have ElementTree read only one record of the data at a time?
Alternatively, are there other ways that would allow one to parse out
a record at a time and maintain some nice ways of accessing the
elements within the record?

Thanks,
Sean

[Marc 'BlackJack' Rintsch]

On Wed, 31 Oct 2007 20:24:43 +0000, Sean Davis wrote:

I have some very large XML files that are basically recordsets. I
would like to access each record, one-at-a-time, and I particularly
like the ElementTree library for accessing the data. Is there a way
to have ElementTree read only one record of the data at a time?

Have you tried `iterparse()`?

Ciao,
Marc 'BlackJack' Rintsch

[Tommy Nordgren]

On 31 okt 2007, at 21.24, Sean Davis wrote:

I have some very large XML files that are basically recordsets. I
would like to access each record, one-at-a-time, and I particularly
like the ElementTree library for accessing the data. Is there a way
to have ElementTree read only one record of the data at a time?
Alternatively, are there other ways that would allow one to parse out
a record at a time and maintain some nice ways of accessing the
elements within the record?

Thanks,
Sean

--
http://mail.python.org/mailman/listinfo/python-list

You need a Python (or other language) implementation of the SAX API
----------------------------------
Skinheads are so tired of immigration, that they are going to move to
a country that don't accept immigrants!
Tommy Nordgren
to************@comhem.se

[Tommy Nordgren]

On 31 okt 2007, at 22.36, Tommy Nordgren wrote:

>
On 31 okt 2007, at 21.24, Sean Davis wrote:

>I have some very large XML files that are basically recordsets. I
would like to access each record, one-at-a-time, and I particularly
like the ElementTree library for accessing the data. Is there a way
to have ElementTree read only one record of the data at a time?
Alternatively, are there other ways that would allow one to parse out
a record at a time and maintain some nice ways of accessing the
elements within the record?

Thanks,
Sean

--
http://mail.python.org/mailman/listinfo/python-list

You need a Python (or other language) implementation of the SAX API

The module you need is xml.sax
----------------------------------
Skinheads are so tired of immigration, that they are going to move to
a country that don't accept immigrants!
Tommy Nordgren
to************@comhem.se

[George Sakkis]

On Oct 31, 4:43 pm, Marc 'BlackJack' Rintsch <[e-mail]:

On Wed, 31 Oct 2007 20:24:43 +0000, Sean Davis wrote:

I have some very large XML files that are basically recordsets. I
would like to access each record, one-at-a-time, and I particularly
like the ElementTree library for accessing the data. Is there a way
to have ElementTree read only one record of the data at a time?

Have you tried `iterparse()`?

Ciao,
Marc 'BlackJack' Rintsch

Detailed docs at http://effbot.org/zone/element-iterparse.htm

George

[Stefan Behnel]

Tommy Nordgren wrote:

>On 31 okt 2007, at 21.24, Sean Davis wrote:

>>I have some very large XML files that are basically recordsets. I
would like to access each record, one-at-a-time, and I particularly
like the ElementTree library for accessing the data. Is there a way
to have ElementTree read only one record of the data at a time?
Alternatively, are there other ways that would allow one to parse out
a record at a time and maintain some nice ways of accessing the
elements within the record?

Thanks,
Sean

You need a Python (or other language) implementation of the SAX API

The module you need is xml.sax

That's unlikely - few people "need" SAX. If they think they do, they just
don't know the alternatives. I think iterparse() is what he was looking for.

Stefan