[xquery-talk] Saxon: Java heap space problem
Sall, Kenneth B.
KENNETH.B.SALL at saic.com
Fri Jun 8 20:01:49 PDT 2007
Thank you again, Michael. That did the trick! No trouble with a 200 MB
file now.
Building tree for [filename] using class net.sf.sa
xon.tinytree.TinyBuilder
Tree built in 55735 milliseconds
Tree size: 10718474 nodes, 41335224 characters, 3246452 attributes
Execution time: 58609 milliseconds
---
I should add I was also able to use DataDirect's latest version of
Stylus Studio to load and process this huge file since my original
message.
Ken Sall
SAIC > ASC > RDEC > Columbia
410-953-7016 (office)
410-300-2997 (mobile)
________________________________
From: Michael Kay [mailto:mike at saxonica.com]
Sent: Friday, June 08, 2007 6:05 PM
To: Sall, Kenneth B.; talk at x-query.com
Subject: RE: [xquery-talk] Saxon: Java heap space problem
This is a Java option, not a Saxon option. For the Sun JVM see
http://java.sun.com/j2se/1.5.0/docs/tooldocs/windows/java.html
Eg:
java -Xmx1024m net.sf.saxon.Query ....
Michael Kay
http://www.saxonica.com/
________________________________
From: Sall, Kenneth B. [mailto:KENNETH.B.SALL at saic.com]
Sent: 08 June 2007 22:47
To: Michael Kay; talk at x-query.com
Subject: RE: [xquery-talk] Saxon: Java heap space problem
Michael,
Thanks but I don't see this option on
http://www.saxonica.com/documentation/using-xquery/commandline.html nor
when I do "java -help".
Is it available for Saxon 8.9J (free version)?
Ken Sall
SAIC > ASC > RDEC > Columbia
410-953-7016 (office)
410-300-2997 (mobile)
________________________________
From: Michael Kay [mailto:mike at saxonica.com]
Sent: Friday, June 08, 2007 5:28 PM
To: Sall, Kenneth B.; talk at x-query.com
Subject: RE: [xquery-talk] Saxon: Java heap space problem
How much heap space did you allocate?
My usual rule of thumb is 5x the raw document size, so this
should run if you allocate 1Gb (use the -Xmx option). That's an
apporximation of course, it's sometimes more, sometimes less.
Michael Kay
http://www.saxonica.com/
________________________________
From: talk-bounces at x-query.com
[mailto:talk-bounces at x-query.com] On Behalf Of Sall, Kenneth B.
Sent: 08 June 2007 20:52
To: talk at x-query.com
Subject: [xquery-talk] Saxon: Java heap space problem
Hi,
When attempting to process a 200 MB file with Saxon 8.9J
(Java version 1.6.0_01), I run out of heap space.
Building tree for file:/D:/PFA/PFA_200509302000_F.xml
using class net.sf.sa
xon.tinytree.TinyBuilder
Exception in thread "main" java.lang.OutOfMemoryError:
Java heap space
at
net.sf.saxon.tinytree.TinyTree.ensureNodeCapacity(TinyTree.java:203)
at
net.sf.saxon.tinytree.TinyTree.addNode(TinyTree.java:292)
Since I'm already using the default "tiny tree" model,
and having closed down other applications, short of adding more physical
memory, is there anything else I can do? If it matters, this large file
is only 2 "lines": the XML declaration and the rest of the file.
Is there anyway of getting a ballpark handle on the max
size of file I can process with Saxon (and Java) if my physical memory
is say "N" MB?
Total Physical Mem = 2.048 GB
Available Physical Mem = 1.22 GB
Total Virtual Mem = 2.00 GB
Available Virtual Mem = 1.96 MB
Page File Space = 3.85 GB
Thanks!
Kenneth B. Sall
XML Data and Systems Analyst
Advanced Systems and Concepts
Science Applications International Corp. (SAIC)
7125 Columbia Gateway Dr., Suite 250
Columbia, MD 21046
410-953-7016 (office)
410-300-2997 (mobile)
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://x-query.com/pipermail/talk/attachments/20070608/079e6cc1/attachment.htm
More information about the talk
mailing list