I have a program which produces well-formed XML documents,
but takes several hours if not days to do so. It would
be useful to be able to take the incomplete output and
manipulate it as XML.
Clearly, however, the incomplete output will not be well-
formed, so before being able to manipulate it I need to
make it wellformed.
This is essentially fairly simple. I know it's well-formed
up to now - all I need to do is close unclosed tags. So,
I 've made a short function that will do this:
#!/usr/bin/python
import sys
import xml.sax
tagStack = []
closingTags = ""
class DodgyHandler(xml.sax.ContentHandler):
def startElement(self, tag, attributes):
tagStack.append(tag)
def endElement(self, tag):
tagStack.pop()
class DodgyErrorHandler(xml.sax.ErrorHandler):
def fatalError(self,exception):
global closingTags
tagStack.reverse()
for tag in tagStack:
closingTags += "</%s>" % tag
return closingTags
def finishXML(text):
p = xml.sax.make_parser()
p.setContentHandler(DodgyHandler())
p.setErrorHandler(DodgyErrorHandler())
for line in text:
p.feed(line)
p.close()
text.append(closingTags)
However - while this works for 90% of the cases I need,
it fails in the case where my incomplete output stops in the
middle of a tag (not to mention some other more arcane
places I don't really care about).
The problem is that when the sax handler raises an exception,
I can't see how to find out why. What I want to do is for
DodgyErrorHandler to do something different depending on
where we are in the course of parsing. Is there anyway
to get that information back from xml.sax (or indeed from
any other sax handler?)
Toby
--
Dr. Toby White
Dept. of Earth Sciences, Downing Street, Cambridge CB2 3EQ. UK
Email: <to***@cam.ac.uk> 3 1557
In article <t8*************@parabrisas.esc.cam.ac.uk>, Toby White wrote:
[snip]
I do similar stuff in the new (upcoming) version of Atox
(atox.sf.net), which works with potentially ill-formed, partial XML
(in the form of PYX events) internally, and can take partial,
ill-formed XML as input.
The problem is that when the sax handler raises an exception, I can't see how to find out why. What I want to do is for DodgyErrorHandler to do something different depending on where we are in the course of parsing. Is there anyway to get that information back from xml.sax (or indeed from any other sax handler?)
What I ended up doing was using an SGML parser (sgmlop) instead. It's
highly forgiving (even of illegal entities and the like) but gives me
the information I need. Might be worth a look in your app too?
Toby
--
Magnus Lie Hetland http://hetland.org
> The problem is that when the sax handler raises an exception,
I can't see how to find out why. What I want to do is for
DodgyErrorHandler to do something different depending on
where we are in the course of parsing. Is there anyway
to get that information back from xml.sax (or indeed from
any other sax handler?)
You can get raw location information, yes. See: http://www.xml.com/pub/a/2004/11/24/py-xml.html
But I don't think this is enough for you. You also need recovery,
which you're implementing in crude form.
I tend to agree with Magnus that using an SGML parser might be your
best bet. You might even be able to turn that SGML into XML using a
tool such as James Clark's SX: http://www.jclark.com/sp/sx.htm
--
Uche http://copia.ogbuji.net uc*********@gmail.com writes: The problem is that when the sax handler raises an exception, I can't see how to find out why. What I want to do is for DodgyErrorHandler to do something different depending on where we are in the course of parsing. Is there anyway to get that information back from xml.sax (or indeed from any other sax handler?)
You can get raw location information, yes. See:
http://www.xml.com/pub/a/2004/11/24/py-xml.html
But I don't think this is enough for you. You also need recovery, which you're implementing in crude form.
(If you're referring to the Locator objects), yes I'm aware
that's possible. But what I want is not my location in the
document, but for the parser to say "this is an error because
I am in the middle of a tag & the document ended", or "I
was in the middle of a text section and the document ended", or
"I was in the middle of an attribute value and the document
ended", etc, so that I can then construct a simple end to the
document, inserting quote marks, finishing the tag, and closing
all unclosed tags as appropriate.
I have just realised that I might be able to grab the message
that the exception gives me, look at the expat source code
and work out what parsing events cause which error messages.
Which is a bit round the houses, but I think ought to work.
I tend to agree with Magnus that using an SGML parser might be your best bet. You might even be able to turn that SGML into XML using a tool such as James Clark's SX:
http://www.jclark.com/sp/sx.htm
If I can't get my scheme above to work, I'll have a go. But I was
hoping to do this without requiring additional packages. And in
any case, it doesn't need to be perfectly robust. As long as it
handles 99% of cases, I'll be happy.
--
Dr. Toby White
Dept. of Earth Sciences, Downing Street, Cambridge CB2 3EQ. UK
Email: <to***@cam.ac.uk> This thread has been closed and replies have been disabled. Please start a new discussion. Similar topics |
by: compu_global_hyper_mega_net_2 |
last post by:
Greetings,
usenet's obviously dying. Where's everyone hanging out? One of the
yahoo groups or something?
anyway. Hopefully someone picks this up:
I'm trying to compile php-5.0.0RC2 with...
|
by: Mike Gifford |
last post by:
Hello Folks,
I'm trying to get tidy set up on a pretty standard fedora core 1 server.
Looks pretty simple from here:
http://ca3.php.net/manual/en/ref.tidy.php
Should just have to go:
pear -v...
|
by: Börni |
last post by:
Hello,
I am using tidy to clean up an xml file, but my problem is that it
replaces newlines with normal whitespaces.
Still worse is that if i retrieve text from the xml file it contains all...
|
by: Mike |
last post by:
Greetings,
I just used Tidy HTML for the first time.
The address below contains the files need to check on Tidy's
corrections.
I would appreciate any feedback on the Tidy report and the...
|
by: Stefan Weiss |
last post by:
Hi.
(this is somewhat similar to yesterday's thread about empty links)
I noticed that Tidy issues warnings whenever it encounters empty
tags, and strips those tags if cleanup was requested....
| |
by: Christoph Schneegans |
last post by:
Hi!
I'd like to present an easy, yet powerful approach to use the HTML
Tidy program from <http://tidy.sourceforge.net/> in ASP.NET. It is
similiar to...
|
by: VK |
last post by:
Hi,
After the response on my request from W3C I'm still unclear about Tidy
vs. Validator discrepansies. That started with <IFRAME> issue, but
there is more as I know. Anyway, this very basic...
|
by: BG Mahesh |
last post by:
hi
I have installed Tidy on Fedore Core 4.0 using RPM. I have a very
simple script that uses tidy,
------------tidy.php------------------
<html>a html document</html>
<?
$html =...
|
by: Martin Odhelius |
last post by:
Hello,
Does anybody here have any example code for Tidy.Net
(http://sourceforge.net/projects/tidynet/) ?
I can't find one single example. I try to convert a html-string to well
formed xhtml,...
|
by: kempshall |
last post by:
Can somebody please tell me how to install the Tidy module for PHP 5
on a Mac? I tried what the php.net website said, which is running the
command "pecl install tidy" but the installation failed...
|
by: Hystou |
last post by:
Most computers default to English, but sometimes we require a different language, especially when relocating. Forgot to request a specific language before your computer shipped? No problem! You can...
| |
by: Oralloy |
last post by:
Hello folks,
I am unable to find appropriate documentation on the type promotion of bit-fields when using the generalised comparison operator "<=>".
The problem is that using the GNU compilers,...
|
by: jinu1996 |
last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven...
|
by: tracyyun |
last post by:
Dear forum friends,
With the development of smart home technology, a variety of wireless communication protocols have appeared on the market, such as Zigbee, Z-Wave, Wi-Fi, Bluetooth, etc. Each...
|
by: TSSRALBI |
last post by:
Hello
I'm a network technician in training and I need your help.
I am currently learning how to create and manage the different types of VPNs and I have a question about LAN-to-LAN VPNs.
The...
|
by: adsilva |
last post by:
A Windows Forms form does not have the event Unload, like VB6. What one acts like?
|
by: 6302768590 |
last post by:
Hai team
i want code for transfer the data from one system to another through IP address by using C# our system has to for every 5mins then we have to update the data what the data is updated ...
| |
by: muto222 |
last post by:
How can i add a mobile payment intergratation into php mysql website.
|
by: bsmnconsultancy |
last post by:
In today's digital era, a well-designed website is crucial for businesses looking to succeed. Whether you're a small business owner or a large corporation in Toronto, having a strong online presence...
| |