[CITE-Forum] EXT :Re: Testing large XML-files using the TEAMEngine

[Morris, Chuck E (IS)]

Yes, TEAM Engine does load the XML into memory using DOM.  That is the way the Saxon XSLT processor TEAM Engine is based on works.

The only solution would be to break your large XML files into smaller ones before validating them with TEAM Engine.

Chuck

From: cite-forum-bounces+chuck.morris=ngc.com at lists.opengeospatial.org [mailto:cite-forum-bounces+chuck.morris=ngc.com at lists.opengeospatial.org] On Behalf Of Janis Blank
Sent: Monday, April 23, 2012 2:22 AM
To: Sebastian Goerke
Cc: cite-forum at lists.opengeospatial.org
Subject: EXT :Re: [CITE-Forum] Testing large XML-files using the TEAMEngine

Hi Sebastian,

I'm validating GML files. The type of CTL involved seemingly doesn't matter. Whatever commands I use, they all produce this error.
Maybe parsing these sizes with a DOM parser is just to much.

Regards,
Janis

Am 20.04.2012 14:30, schrieb Sebastian Goerke:

-----BEGIN PGP SIGNED MESSAGE-----

Hash: SHA1



Hi Janis,



what kind of XML files are you validating with the TEAMEngine? Which

test scripts did you use? Those information would be helpful for

solving your problem.



Regards



Sebastian

- --

l a t / l o n  GmbH

Aennchenstrasse 19               53177 Bonn, Germany

phone ++49 +228 18496-0          fax ++49 +228 18496-29

http://www.lat-lon.de            http://www.deegree.org









Am 20.04.2012 13:53, schrieb Janis Blank:

Hi,



i was recently asked to validate XML files with sizes up to 300 MB

using the TEAMEngine, which lead to an OutOfMemoryError on the

Heap. Since a lot of DOM-parsing seems to be involved here, this

wasn't a big surprise. Adding more memory with the -Xmx parameter

for Java seems to be a bottomless pit. Does anybody have an idea how

to handle this problem? Is it even possible without comprehensively

rewriting everything?



Regards Janis



-- /Mit freundlichen Grüßen



MSc. in CS Janis Blank/ <http://www.cpa-systems.de><http://www.cpa-systems.de> *CPA Systems

GmbH* Auf dem Seidenberg 3a D-53721 Siegburg



Tel.: /+49 (0) 2241-25 94 - 0 (Zentrale)/ Fax.: /+49 (0) 2241-25 94

- 29/



/blank at supportgis.de/ <mailto:blank at supportgis.de><mailto:blank at supportgis.de>



/www.cpa-systems.de/ <http://www.cpa-systems.de><http://www.cpa-systems.de>

*Handelsregister:* HRB 9706, Amtsgericht Siegburg



*Geschäftsführer:* Dr.-Ing. habil. Christoph Averdung Dr.-Ing.

Matthias Ellsiepen









_______________________________________________ CITE-Forum mailing

list CITE-Forum at lists.opengeospatial.org<mailto:CITE-Forum at lists.opengeospatial.org>

https://lists.opengeospatial.org/mailman/listinfo/cite-forum



-----BEGIN PGP SIGNATURE-----

Version: GnuPG v1.4.11 (GNU/Linux)

Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/



iEYEARECAAYFAk+RVvUACgkQq1hDh4aJykJ39wCdH/JhstPFK1azkhM3ku5tfz4i

pOMAn0QzgBGNqisLVWOGCayqInIijNii

=GbJY

-----END PGP SIGNATURE-----

_______________________________________________

CITE-Forum mailing list

CITE-Forum at lists.opengeospatial.org<mailto:CITE-Forum at lists.opengeospatial.org>

https://lists.opengeospatial.org/mailman/listinfo/cite-forum



--

Mit freundlichen Grüßen

MSc. in CS Janis Blank


[cid:part1.07030708.06080305 at supportgis.de]<http://www.cpa-systems.de>

CPA Systems GmbH
Auf dem Seidenberg 3a
D-53721 Siegburg

Tel.:  +49 (0) 2241-25 94 - 0 (Zentrale)
Fax.: +49 (0) 2241-25 94 - 29

blank at supportgis.de <mailto:blank at supportgis.de>

www.cpa-systems.de <http://www.cpa-systems.de>

Handelsregister:
HRB 9706, Amtsgericht Siegburg

Geschäftsführer:
Dr.-Ing. habil. Christoph Averdung
Dr.-Ing. Matthias Ellsiepen



-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.opengeospatial.org/pipermail/cite-forum/attachments/20120424/563369a0/attachment.htm>