[xquery-talk] Saxon: Java heap space problem

Michael Kay mike at saxonica.com
Fri Jun 8 23:28:26 PDT 2007


How much heap space did you allocate?
 
My usual rule of thumb is 5x the raw document size, so this should run if
you allocate 1Gb (use the -Xmx option). That's an apporximation of course,
it's sometimes more, sometimes less.
 
Michael Kay
http://www.saxonica.com/ 


  _____  

From: talk-bounces at x-query.com [mailto:talk-bounces at x-query.com] On Behalf
Of Sall, Kenneth B.
Sent: 08 June 2007 20:52
To: talk at x-query.com
Subject: [xquery-talk] Saxon: Java heap space problem



Hi,

 

When attempting to process a 200 MB file with Saxon 8.9J (Java version
1.6.0_01), I run out of heap space. 

 

Building tree for file:/D:/PFA/PFA_200509302000_F.xml using class net.sf.sa

xon.tinytree.TinyBuilder

Exception in thread "main" java.lang.OutOfMemoryError: Java heap space

        at
net.sf.saxon.tinytree.TinyTree.ensureNodeCapacity(TinyTree.java:203)

        at net.sf.saxon.tinytree.TinyTree.addNode(TinyTree.java:292)

 

Since I'm already using the default "tiny tree" model, and having closed
down other applications, short of adding more physical memory, is there
anything else I can do? If it matters, this large file is only 2 "lines":
the XML declaration and the rest of the file.

 

Is there anyway of getting a ballpark handle on the max size of file I can
process with Saxon (and Java) if my physical memory is say "N" MB?

 

Total Physical Mem = 2.048 GB

Available Physical Mem = 1.22 GB

Total Virtual Mem = 2.00 GB

Available Virtual Mem = 1.96 MB

Page File Space = 3.85 GB

 

Thanks!

 

Kenneth B. Sall

XML Data and Systems Analyst
Advanced Systems and Concepts
Science Applications International Corp. (SAIC)
7125 Columbia Gateway Dr., Suite 250
Columbia, MD  21046
410-953-7016 (office)

410-300-2997 (mobile)

 

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://x-query.com/pipermail/talk/attachments/20070608/00afd58a/attachment-0001.htm


More information about the talk mailing list