[CITE-Forum] WMS 1.3.0 Cite tests-Summary report is not correct

Thu Apr 2 14:29:44 EDT 2009

The counts may be a little misleading, but I think it would be even more
confusing to see three red X's and have the engine count only one
failure.  And parent tests aren't necessarily just grouping constructs.
There can be logic associated with them besides just calling subtests.

- Chuck

________________________________

From: cite-forum-bounces+chuck.morris=ngc.com at lists.opengeospatial.org
[mailto:cite-forum-bounces+chuck.morris=ngc.com at lists.opengeospatial.org
] On Behalf Of Normand Savard
Sent: Thursday, April 02, 2009 8:11 AM
To: cite-forum at lists.opengeospatial.org
Subject: [CITE-Forum] WMS 1.3.0 Cite tests-Summary report is not correct

After running the tests I noticed that the numbers appearing in the
summary report are not correct.  The fail count is accounting not only
for the single tests but also for the group to which it belongs too.
For instance, "time-interval-and-instant
<http://cite.geoenterpriselab.com/ows6/listings/%7E2Fopt%7E2Fapache-tomc
at-5.5.26%7E2Fwebapps%7E2Fows6%7E2FWEB-INF%7E2Fscripts%7E2Fwms-1.3.0%7E2
Fctl%7E2Fdimensions.html#dims:time-interval-and-instant> ", "Test
dims:time
<http://cite.geoenterpriselab.com/ows6/listings/%7E2Fopt%7E2Fapache-tomc
at-5.5.26%7E2Fwebapps%7E2Fows6%7E2FWEB-INF%7E2Fscripts%7E2Fwms-1.3.0%7E2
Fctl%7E2Fdimensions.html#dims:time>  (View Details
<http://cite.geoenterpriselab.com/ows6/viewTestLog.jsp?test=s0002/d1339e
359_1/d34e179_1> )" and "Test dims:main
<http://cite.geoenterpriselab.com/ows6/listings/%7E2Fopt%7E2Fapache-tomc
at-5.5.26%7E2Fwebapps%7E2Fows6%7E2FWEB-INF%7E2Fscripts%7E2Fwms-1.3.0%7E2
Fctl%7E2Fdimensions.html#dims:main>  (View Details
<http://cite.geoenterpriselab.com/ows6/viewTestLog.jsp?test=s0002/d1339e
359_1> )" counts for three failures.

Norm

    Test dims:main
<http://cite.geoenterpriselab.com/ows6/listings/%7E2Fopt%7E2Fapache-tomc
at-5.5.26%7E2Fwebapps%7E2Fows6%7E2FWEB-INF%7E2Fscripts%7E2Fwms-1.3.0%7E2
Fctl%7E2Fdimensions.html#dims:main>  (View Details
<http://cite.geoenterpriselab.com/ows6/viewTestLog.jsp?test=s0002/d1339e
359_1> ): Failed (Inherited Failure)

  Test dims:terrain
<http://cite.geoenterpriselab.com/ows6/listings/%7E2Fopt%7E2Fapache-tomc
at-5.5.26%7E2Fwebapps%7E2Fows6%7E2FWEB-INF%7E2Fscripts%7E2Fwms-1.3.0%7E2
Fctl%7E2Fdimensions.html#dims:terrain>  (View Details
<http://cite.geoenterpriselab.com/ows6/viewTestLog.jsp?test=s0002/d1339e
359_1/d34e169_1> ): Passed
 Test dims:geometry
<http://cite.geoenterpriselab.com/ows6/listings/%7E2Fopt%7E2Fapache-tomc
at-5.5.26%7E2Fwebapps%7E2Fows6%7E2FWEB-INF%7E2Fscripts%7E2Fwms-1.3.0%7E2
Fctl%7E2Fdimensions.html#dims:geometry>  (View Details
<http://cite.geoenterpriselab.com/ows6/viewTestLog.jsp?test=s0002/d1339e
359_1/d34e174_1> ): Passed
  Test dims:time
<http://cite.geoenterpriselab.com/ows6/listings/%7E2Fopt%7E2Fapache-tomc
at-5.5.26%7E2Fwebapps%7E2Fows6%7E2FWEB-INF%7E2Fscripts%7E2Fwms-1.3.0%7E2
Fctl%7E2Fdimensions.html#dims:time>  (View Details
<http://cite.geoenterpriselab.com/ows6/viewTestLog.jsp?test=s0002/d1339e
359_1/d34e179_1> ): Failed (Inherited Failure)

 Test dims:time-each-instant
<http://cite.geoenterpriselab.com/ows6/listings/%7E2Fopt%7E2Fapache-tomc
at-5.5.26%7E2Fwebapps%7E2Fows6%7E2FWEB-INF%7E2Fscripts%7E2Fwms-1.3.0%7E2
Fctl%7E2Fdimensions.html#dims:time-each-instant>  (View Details
<http://cite.geoenterpriselab.com/ows6/viewTestLog.jsp?test=s0002/d1339e
359_1/d34e179_1/d34e2271_1> ): Passed
 Test dims:time-each-instant
<http://cite.geoenterpriselab.com/ows6/listings/%7E2Fopt%7E2Fapache-tomc
at-5.5.26%7E2Fwebapps%7E2Fows6%7E2FWEB-INF%7E2Fscripts%7E2Fwms-1.3.0%7E2
Fctl%7E2Fdimensions.html#dims:time-each-instant>  (View Details
<http://cite.geoenterpriselab.com/ows6/viewTestLog.jsp?test=s0002/d1339e
359_1/d34e179_1/d34e2277_1> ): Passed
 Test dims:time-each-instant
<http://cite.geoenterpriselab.com/ows6/listings/%7E2Fopt%7E2Fapache-tomc
at-5.5.26%7E2Fwebapps%7E2Fows6%7E2FWEB-INF%7E2Fscripts%7E2Fwms-1.3.0%7E2
Fctl%7E2Fdimensions.html#dims:time-each-instant>  (View Details
<http://cite.geoenterpriselab.com/ows6/viewTestLog.jsp?test=s0002/d1339e
359_1/d34e179_1/d34e2283_1> ): Passed
 Test dims:time-each-instant
<http://cite.geoenterpriselab.com/ows6/listings/%7E2Fopt%7E2Fapache-tomc
at-5.5.26%7E2Fwebapps%7E2Fows6%7E2FWEB-INF%7E2Fscripts%7E2Fwms-1.3.0%7E2
Fctl%7E2Fdimensions.html#dims:time-each-instant>  (View Details
<http://cite.geoenterpriselab.com/ows6/viewTestLog.jsp?test=s0002/d1339e
359_1/d34e179_1/d34e2289_1> ): Passed
 Test dims:time-each-instant
<http://cite.geoenterpriselab.com/ows6/listings/%7E2Fopt%7E2Fapache-tomc
at-5.5.26%7E2Fwebapps%7E2Fows6%7E2FWEB-INF%7E2Fscripts%7E2Fwms-1.3.0%7E2
Fctl%7E2Fdimensions.html#dims:time-each-instant>  (View Details
<http://cite.geoenterpriselab.com/ows6/viewTestLog.jsp?test=s0002/d1339e
359_1/d34e179_1/d34e2295_1> ): Passed
 Test dims:time-each-instant
<http://cite.geoenterpriselab.com/ows6/listings/%7E2Fopt%7E2Fapache-tomc
at-5.5.26%7E2Fwebapps%7E2Fows6%7E2FWEB-INF%7E2Fscripts%7E2Fwms-1.3.0%7E2
Fctl%7E2Fdimensions.html#dims:time-each-instant>  (View Details
<http://cite.geoenterpriselab.com/ows6/viewTestLog.jsp?test=s0002/d1339e
359_1/d34e179_1/d34e2302_1> ): Passed
 Test dims:time-each-instant
<http://cite.geoenterpriselab.com/ows6/listings/%7E2Fopt%7E2Fapache-tomc
at-5.5.26%7E2Fwebapps%7E2Fows6%7E2FWEB-INF%7E2Fscripts%7E2Fwms-1.3.0%7E2
Fctl%7E2Fdimensions.html#dims:time-each-instant>  (View Details
<http://cite.geoenterpriselab.com/ows6/viewTestLog.jsp?test=s0002/d1339e
359_1/d34e179_1/d34e2308_1> ): Passed
 Test dims:time-each-instant
<http://cite.geoenterpriselab.com/ows6/listings/%7E2Fopt%7E2Fapache-tomc
at-5.5.26%7E2Fwebapps%7E2Fows6%7E2FWEB-INF%7E2Fscripts%7E2Fwms-1.3.0%7E2
Fctl%7E2Fdimensions.html#dims:time-each-instant>  (View Details
<http://cite.geoenterpriselab.com/ows6/viewTestLog.jsp?test=s0002/d1339e
359_1/d34e179_1/d34e2314_1> ): Passed
 Test dims:time-each-instant
<http://cite.geoenterpriselab.com/ows6/listings/%7E2Fopt%7E2Fapache-tomc
at-5.5.26%7E2Fwebapps%7E2Fows6%7E2FWEB-INF%7E2Fscripts%7E2Fwms-1.3.0%7E2
Fctl%7E2Fdimensions.html#dims:time-each-instant>  (View Details
<http://cite.geoenterpriselab.com/ows6/viewTestLog.jsp?test=s0002/d1339e
359_1/d34e179_1/d34e2320_1> ): Passed
 Test dims:time-each-instant
<http://cite.geoenterpriselab.com/ows6/listings/%7E2Fopt%7E2Fapache-tomc
at-5.5.26%7E2Fwebapps%7E2Fows6%7E2FWEB-INF%7E2Fscripts%7E2Fwms-1.3.0%7E2
Fctl%7E2Fdimensions.html#dims:time-each-instant>  (View Details
<http://cite.geoenterpriselab.com/ows6/viewTestLog.jsp?test=s0002/d1339e
359_1/d34e179_1/d34e2326_1> ): Passed
 Test dims:time-each-instant
<http://cite.geoenterpriselab.com/ows6/listings/%7E2Fopt%7E2Fapache-tomc
at-5.5.26%7E2Fwebapps%7E2Fows6%7E2FWEB-INF%7E2Fscripts%7E2Fwms-1.3.0%7E2
Fctl%7E2Fdimensions.html#dims:time-each-instant>  (View Details
<http://cite.geoenterpriselab.com/ows6/viewTestLog.jsp?test=s0002/d1339e
359_1/d34e179_1/d34e2332_1> ): Passed
 Test dims:time-each-instant
<http://cite.geoenterpriselab.com/ows6/listings/%7E2Fopt%7E2Fapache-tomc
at-5.5.26%7E2Fwebapps%7E2Fows6%7E2FWEB-INF%7E2Fscripts%7E2Fwms-1.3.0%7E2
Fctl%7E2Fdimensions.html#dims:time-each-instant>  (View Details
<http://cite.geoenterpriselab.com/ows6/viewTestLog.jsp?test=s0002/d1339e
359_1/d34e179_1/d34e2339_1> ): Passed
 Test dims:time-each-instant
<http://cite.geoenterpriselab.com/ows6/listings/%7E2Fopt%7E2Fapache-tomc
at-5.5.26%7E2Fwebapps%7E2Fows6%7E2FWEB-INF%7E2Fscripts%7E2Fwms-1.3.0%7E2
Fctl%7E2Fdimensions.html#dims:time-each-instant>  (View Details
<http://cite.geoenterpriselab.com/ows6/viewTestLog.jsp?test=s0002/d1339e
359_1/d34e179_1/d34e2345_1> ): Passed
 Test dims:time-interval
<http://cite.geoenterpriselab.com/ows6/listings/%7E2Fopt%7E2Fapache-tomc
at-5.5.26%7E2Fwebapps%7E2Fows6%7E2FWEB-INF%7E2Fscripts%7E2Fwms-1.3.0%7E2
Fctl%7E2Fdimensions.html#dims:time-interval>  (View Details
<http://cite.geoenterpriselab.com/ows6/viewTestLog.jsp?test=s0002/d1339e
359_1/d34e179_1/d34e2351_1> ): Passed
 Test dims:time-interval-and-instant
<http://cite.geoenterpriselab.com/ows6/listings/%7E2Fopt%7E2Fapache-tomc
at-5.5.26%7E2Fwebapps%7E2Fows6%7E2FWEB-INF%7E2Fscripts%7E2Fwms-1.3.0%7E2
Fctl%7E2Fdimensions.html#dims:time-interval-and-instant>  (View Details
<http://cite.geoenterpriselab.com/ows6/viewTestLog.jsp?test=s0002/d1339e
359_1/d34e179_1/d34e2353_1> ): Failed
 Test dims:time-interval-list
<http://cite.geoenterpriselab.com/ows6/listings/%7E2Fopt%7E2Fapache-tomc
at-5.5.26%7E2Fwebapps%7E2Fows6%7E2FWEB-INF%7E2Fscripts%7E2Fwms-1.3.0%7E2
Fctl%7E2Fdimensions.html#dims:time-interval-list>  (View Details
<http://cite.geoenterpriselab.com/ows6/viewTestLog.jsp?test=s0002/d1339e
359_1/d34e179_1/d34e2355_1> ): Passed
 Test dims:time-instant-list
<http://cite.geoenterpriselab.com/ows6/listings/%7E2Fopt%7E2Fapache-tomc
at-5.5.26%7E2Fwebapps%7E2Fows6%7E2FWEB-INF%7E2Fscripts%7E2Fwms-1.3.0%7E2
Fctl%7E2Fdimensions.html#dims:time-instant-list>  (View Details
<http://cite.geoenterpriselab.com/ows6/viewTestLog.jsp?test=s0002/d1339e
359_1/d34e179_1/d34e2357_1> ): Passed
 Test dims:time-current-instant
<http://cite.geoenterpriselab.com/ows6/listings/%7E2Fopt%7E2Fapache-tomc
at-5.5.26%7E2Fwebapps%7E2Fows6%7E2FWEB-INF%7E2Fscripts%7E2Fwms-1.3.0%7E2
Fctl%7E2Fdimensions.html#dims:time-current-instant>  (View Details
<http://cite.geoenterpriselab.com/ows6/viewTestLog.jsp?test=s0002/d1339e
359_1/d34e179_1/d34e2360_1> ): Passed
 Test dims:time-current-interval
<http://cite.geoenterpriselab.com/ows6/listings/%7E2Fopt%7E2Fapache-tomc
at-5.5.26%7E2Fwebapps%7E2Fows6%7E2FWEB-INF%7E2Fscripts%7E2Fwms-1.3.0%7E2
Fctl%7E2Fdimensions.html#dims:time-current-interval>  (View Details
<http://cite.geoenterpriselab.com/ows6/viewTestLog.jsp?test=s0002/d1339e
359_1/d34e179_1/d34e2362_1> ): Passed
 Test dims:time-default
<http://cite.geoenterpriselab.com/ows6/listings/%7E2Fopt%7E2Fapache-tomc
at-5.5.26%7E2Fwebapps%7E2Fows6%7E2FWEB-INF%7E2Fscripts%7E2Fwms-1.3.0%7E2
Fctl%7E2Fdimensions.html#dims:time-default>  (View Details
<http://cite.geoenterpriselab.com/ows6/viewTestLog.jsp?test=s0002/d1339e
359_1/d34e179_1/d34e2364_1> ): Passed
 Test dims:time-and-other-layer
<http://cite.geoenterpriselab.com/ows6/listings/%7E2Fopt%7E2Fapache-tomc
at-5.5.26%7E2Fwebapps%7E2Fows6%7E2FWEB-INF%7E2Fscripts%7E2Fwms-1.3.0%7E2
Fctl%7E2Fdimensions.html#dims:time-and-other-layer>  (View Details
<http://cite.geoenterpriselab.com/ows6/viewTestLog.jsp?test=s0002/d1339e
359_1/d34e179_1/d34e2368_1> ): Passed

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.opengeospatial.org/pipermail/cite-forum/attachments/20090402/0f4aae97/attachment-0001.htm 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/png
Size: 26855 bytes
Desc: image1.8
Url : http://lists.opengeospatial.org/pipermail/cite-forum/attachments/20090402/0f4aae97/attachment-0003.png 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/png
Size: 834 bytes
Desc: ATT1921725.png
Url : http://lists.opengeospatial.org/pipermail/cite-forum/attachments/20090402/0f4aae97/attachment-0004.png 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/png
Size: 821 bytes
Desc: ATT1921726.png
Url : http://lists.opengeospatial.org/pipermail/cite-forum/attachments/20090402/0f4aae97/attachment-0005.png 