473,320 Members | 1,838 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 473,320 software developers and data experts.

XSLT on really large files?

Hi everyone,

I have some pretty mongo XML source files (say 256MB or so) that I need
to run an XSL transform on. The transform works fine when the file has
only one or two records in it, but when I tried using xalan on the
whole file it ran for an hour with no perceptible results (besides a
really sluggish CPU). Has anyone else had any luck with a pre-built
XSL translator for monster files, or am I going to need to write a
program to do the translation? :(

Thanks in advance!

Jul 20 '05 #1
1 1505
You might give Saxon a try (http://sourceforge.net/projects/saxon). I've
used it on XML files approaching 100MB. When running it in Java, be sure to
bump up the memory setting, as in:

java -Xmx512m

Also make sure your machine has at least 512MB, or preferably a gig or two,
of RAM. With about 40-50 XSLT rules and a 65MB input file I've run
transforms in approx 420MB under Windows XP. But if you don't have enough
real RAM your machine will constantly swap and the time will increase
greatly...

<cy*********@gmail.com> wrote in message
news:11*********************@f14g2000cwb.googlegro ups.com...
Hi everyone,

I have some pretty mongo XML source files (say 256MB or so) that I need
to run an XSL transform on. The transform works fine when the file has
only one or two records in it, but when I tried using xalan on the
whole file it ran for an hour with no perceptible results (besides a
really sluggish CPU). Has anyone else had any luck with a pre-built
XSL translator for monster files, or am I going to need to write a
program to do the translation? :(

Thanks in advance!

Jul 20 '05 #2

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

3
by: Rajesh Patel | last post by:
I am currently using JDOM to access a rather large xml document(2mb). JDOM is taking up too much memory, I am looking for somethng that is more light weight. I know that SAX will work, but I...
5
by: Mike Judkins | last post by:
I'm looking for examples of websites (preferably large and well known companies, not personal sites or developer-to-developer sites) that use XML and XSLT as a technology platform from which to...
0
by: Vincent Lefevre | last post by:
Under Linux, I currently use xsltproc (libxslt), but it is awfully slow and takes a lot of memory (e.g. more than 100 MB) when using many XML files with a large DTD (e.g. DocBook): With my DTD...
1
by: jrwarwick | last post by:
Hello, I believe I have uncovered a bug in the .Net XSLT engine to do with 'for' loops in XSLT. Here are the steps to reproduce it: -Create A new webform project. -Add the xml file...
3
by: Ian Roddis | last post by:
Hello, I want to embed SQL type queries within an XML data record. The XML looks something like this: <DISPLAYPAGE> <FIELD NAME="SERVER" TYPE="DROPDOWN"> <OPTION>1<OPTION> <OPTION>2<OPTION>...
3
by: thomas.porschberg | last post by:
Hi, I want to read records from a database and export it in an arbitrary format. My idea was to feed a class with a String array fetched from the database and let this class fire SAX events as...
12
by: Chris | last post by:
Hi, Just wondering if anyone out there knows if it is possible to convert a CSV to xml using XSLT? I've seen a lot of examples of xml to CSV, but is it possible to go back the other way? I...
2
by: killy971 | last post by:
I have been testing different libraries to process XSL transformations on large XML files. The fact is that I read a document from Intel, stating their library (XSLT accelerator) was more twice...
12
by: Stu | last post by:
Being a newbie with XSLT transformation code please excuse my neivte. In addition, I am not sure what I want to do can be done with xslt so I apologize up front for asking anything stupid I...
0
by: DolphinDB | last post by:
Tired of spending countless mintues downsampling your data? Look no further! In this article, you’ll learn how to efficiently downsample 6.48 billion high-frequency records to 61 million...
0
by: ryjfgjl | last post by:
ExcelToDatabase: batch import excel into database automatically...
0
isladogs
by: isladogs | last post by:
The next Access Europe meeting will be on Wednesday 6 Mar 2024 starting at 18:00 UK time (6PM UTC) and finishing at about 19:15 (7.15PM). In this month's session, we are pleased to welcome back...
1
isladogs
by: isladogs | last post by:
The next Access Europe meeting will be on Wednesday 6 Mar 2024 starting at 18:00 UK time (6PM UTC) and finishing at about 19:15 (7.15PM). In this month's session, we are pleased to welcome back...
0
by: jfyes | last post by:
As a hardware engineer, after seeing that CEIWEI recently released a new tool for Modbus RTU Over TCP/UDP filtering and monitoring, I actively went to its official website to take a look. It turned...
0
by: ArrayDB | last post by:
The error message I've encountered is; ERROR:root:Error generating model response: exception: access violation writing 0x0000000000005140, which seems to be indicative of an access violation...
0
by: Defcon1945 | last post by:
I'm trying to learn Python using Pycharm but import shutil doesn't work
0
by: Shællîpôpï 09 | last post by:
If u are using a keypad phone, how do u turn on JavaScript, to access features like WhatsApp, Facebook, Instagram....
0
by: af34tf | last post by:
Hi Guys, I have a domain whose name is BytesLimited.com, and I want to sell it. Does anyone know about platforms that allow me to list my domain in auction for free. Thank you

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.