473,804 Members | 3,271 Online
Bytes | Software Development & Data Engineering Community
+ Post

Home Posts Topics Members FAQ

XSLT on really large files?

Hi everyone,

I have some pretty mongo XML source files (say 256MB or so) that I need
to run an XSL transform on. The transform works fine when the file has
only one or two records in it, but when I tried using xalan on the
whole file it ran for an hour with no perceptible results (besides a
really sluggish CPU). Has anyone else had any luck with a pre-built
XSL translator for monster files, or am I going to need to write a
program to do the translation? :(

Thanks in advance!

Jul 20 '05 #1
1 1533
You might give Saxon a try (http://sourceforge.net/projects/saxon). I've
used it on XML files approaching 100MB. When running it in Java, be sure to
bump up the memory setting, as in:

java -Xmx512m

Also make sure your machine has at least 512MB, or preferably a gig or two,
of RAM. With about 40-50 XSLT rules and a 65MB input file I've run
transforms in approx 420MB under Windows XP. But if you don't have enough
real RAM your machine will constantly swap and the time will increase
greatly...

<cy*********@gm ail.com> wrote in message
news:11******** *************@f 14g2000cwb.goog legroups.com...
Hi everyone,

I have some pretty mongo XML source files (say 256MB or so) that I need
to run an XSL transform on. The transform works fine when the file has
only one or two records in it, but when I tried using xalan on the
whole file it ran for an hour with no perceptible results (besides a
really sluggish CPU). Has anyone else had any luck with a pre-built
XSL translator for monster files, or am I going to need to write a
program to do the translation? :(

Thanks in advance!

Jul 20 '05 #2

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

3
3651
by: Rajesh Patel | last post by:
I am currently using JDOM to access a rather large xml document(2mb). JDOM is taking up too much memory, I am looking for somethng that is more light weight. I know that SAX will work, but I would rather uses something like xslt since I'm tranforming the xml document into HTML. Don't ask me why they want to transform such a large document into HTML, especially considering the resultant HTML is going to be over 20meg. That is what the...
5
7394
by: Mike Judkins | last post by:
I'm looking for examples of websites (preferably large and well known companies, not personal sites or developer-to-developer sites) that use XML and XSLT as a technology platform from which to store and render web content. Reason being that we are considering migrating our website content to XML and using XSLT to transform the content into html. Currently lack of browser support for XSLT has held us back. For example a significant...
0
1102
by: Vincent Lefevre | last post by:
Under Linux, I currently use xsltproc (libxslt), but it is awfully slow and takes a lot of memory (e.g. more than 100 MB) when using many XML files with a large DTD (e.g. DocBook): With my DTD (based on DocBook + MathML), each time a XML file is read, xsltproc spends 1 second parsing its DTD, and I end up losing a factor 100 due to that. I now use fake DTDs (by providing a special catalog), which just define the entities I need, so that...
1
1647
by: jrwarwick | last post by:
Hello, I believe I have uncovered a bug in the .Net XSLT engine to do with 'for' loops in XSLT. Here are the steps to reproduce it: -Create A new webform project. -Add the xml file 'errorexample.xml' - it is shown at the bottom -Add the xslt file 'errorexample.xslt' - it is shown at the bottom -Add a label into the WebForm1.aspx designer and stretch it so it is large, give it the ID of Output1. -Import the following namespaces in...
3
3096
by: Ian Roddis | last post by:
Hello, I want to embed SQL type queries within an XML data record. The XML looks something like this: <DISPLAYPAGE> <FIELD NAME="SERVER" TYPE="DROPDOWN"> <OPTION>1<OPTION> <OPTION>2<OPTION> <OPTION>3<OPTION> </FIELD>
3
2012
by: thomas.porschberg | last post by:
Hi, I want to read records from a database and export it in an arbitrary format. My idea was to feed a class with a String array fetched from the database and let this class fire SAX events as processor input. The basic class hierarchy is:
12
11605
by: Chris | last post by:
Hi, Just wondering if anyone out there knows if it is possible to convert a CSV to xml using XSLT? I've seen a lot of examples of xml to CSV, but is it possible to go back the other way? I don't want to have to use some external program or script to parse the csv first if possible
2
3227
by: killy971 | last post by:
I have been testing different libraries to process XSL transformations on large XML files. The fact is that I read a document from Intel, stating their library (XSLT accelerator) was more twice faster than Apache Xalan, and was designed to perform well on large XML files. - http://isdlibrary.intel-dispatch.com/isd/10/wp_XSLT.PDF - http://www.intel.com/cd/software/products/asmo-na/eng/366637.htm Please note that their benchmark was only...
12
2384
by: Stu | last post by:
Being a newbie with XSLT transformation code please excuse my neivte. In addition, I am not sure what I want to do can be done with xslt so I apologize up front for asking anything stupid I have a shell script that needs to get values from an XML file. What I want to do is transform the XML into something more KSH friendly so it can be easy to parsed in my KSH script. I would like to go through an entire XML document and for every...
0
9708
marktang
by: marktang | last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However, people are often confused as to whether an ONU can Work As a Router. In this blog post, we’ll explore What is ONU, What Is Router, ONU & Router’s main usage, and What is the difference between ONU and Router. Let’s take a closer look ! Part I. Meaning of...
0
9587
by: Hystou | last post by:
Most computers default to English, but sometimes we require a different language, especially when relocating. Forgot to request a specific language before your computer shipped? No problem! You can effortlessly switch the default language on Windows 10 without reinstalling. I'll walk you through it. First, let's disable language synchronization. With a Microsoft account, language settings sync across devices. To prevent any complications,...
1
10324
by: Hystou | last post by:
Overview: Windows 11 and 10 have less user interface control over operating system update behaviour than previous versions of Windows. In Windows 11 and 10, there is no way to turn off the Windows Update option using the Control Panel or Settings app; it automatically checks for updates and installs any it finds, whether you like it or not. For most users, this new feature is actually very convenient. If you want to control the update process,...
1
7623
isladogs
by: isladogs | last post by:
The next Access Europe User Group meeting will be on Wednesday 1 May 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM). In this session, we are pleased to welcome a new presenter, Adolph Dupré who will be discussing some powerful techniques for using class modules. He will explain when you may want to use classes instead of User Defined Types (UDT). For example, to manage the data in unbound forms. Adolph will...
0
6857
by: conductexam | last post by:
I have .net C# application in which I am extracting data from word file and save it in database particularly. To store word all data as it is I am converting the whole word file firstly in HTML and then checking html paragraph one by one. At the time of converting from word file to html my equations which are in the word document file was convert into image. Globals.ThisAddIn.Application.ActiveDocument.Select();...
0
5527
by: TSSRALBI | last post by:
Hello I'm a network technician in training and I need your help. I am currently learning how to create and manage the different types of VPNs and I have a question about LAN-to-LAN VPNs. The last exercise I practiced was to create a LAN-to-LAN VPN between two Pfsense firewalls, by using IPSEC protocols. I succeeded, with both firewalls in the same network. But I'm wondering if it's possible to do the same thing, with 2 Pfsense firewalls...
0
5662
by: adsilva | last post by:
A Windows Forms form does not have the event Unload, like VB6. What one acts like?
2
3827
muto222
by: muto222 | last post by:
How can i add a mobile payment intergratation into php mysql website.
3
2998
bsmnconsultancy
by: bsmnconsultancy | last post by:
In today's digital era, a well-designed website is crucial for businesses looking to succeed. Whether you're a small business owner or a large corporation in Toronto, having a strong online presence can significantly impact your brand's success. BSMN Consultancy, a leader in Website Development in Toronto offers valuable insights into creating effective websites that not only look great but also perform exceptionally well. In this comprehensive...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.