Derby 10.5.3.0 RC - summary testreport

Release 10.5.3.0 was created 2009-08-10 (svn revision 802917) and testing was started 2009-08-11.
Testing was done under jvm1.6 and jvm1.6-64 with suitesAll and derbyall plus jdbcapi tests and the compatibility test. Under jvm1.5 and jvm1.4 derbyall and suitesAll was run.

The following table is a summary of failures seen:

Counting the number of distinct failures (product related), total number of failure occurences (product related) and platforms used in 10.5.3.0 testing we find :

 

10.2.2.1

10.3.1.4

10.3.2.1

10.4.1.3

10.4.2.0

10.5.1.1

10.5.3.0

Total

9 / 12 / 64

5 / 17 / 64

6 / 7 / 60

1 / 2 / 92

4 / 10 / 88

2 / 12 / 79

0 / 0 / 83

1.4

3 / 5 / 21

5 / 7 / 21

2 / 3 / 20

0 / 0 / 26

0 / 0 / 24

0 / 0 / 22

0 / 0 / 23

1.5

2 / 2 / 22

2 / 6 / 22

4 / 4 / 20

0 / 0 / 26

0 / 0 / 24

1 / 1 / 22

0 / 0 / 23

1.6

5 / 5 / 21

2 / 4 / 21

0 / 0 / 20

0 / 0 / 28

3 / 6 / 27

0 / 0 / 23

0 / 0 / 24

1.6-64

- / - / -

- / - / -

- / - / -

1 / 2 / 12

2 / 4 / 13

1 / 11 / 12

0 / 0 / 13

Legend: Distinct errors / Sum errors / Number of platforms.

Summary: 0 distinct product failures. 1 distinct test failure (13 occurrences): DERBY-3819


EMMA Test coverage [Classes: 92.21%, Methods: 77.35%, Blocks: 73.38%, Lines: 73.45%].

Report generated: 2009-08-14

JIRA/Id

JVM/OS

Comment

Seen in XX

Derby Product issues.


jvm1.4: []
jvm1.5: []
jvm1.6: []
jvm1.6-64: []


...

The following are testsuite problems. Do not count above.

DERBY-3819

jvm1.4: []
jvm1.5: []
jvm1.6: []
jvm1.6-64: [All]

 
Unexpected query plan: 
'Expected Table Scan ResultSet for T3'.

...

The following are infrastructure problems. Do not count above.

Incomplete test environment

jvm1.4: [zone1]
jvm1.5: [zone1]
jvm1.6: [zone1]
jvm1.6-64: [zone1]

Rerun
Test agent not running on host.


Failure in test environment

jvm1.4: [lin32]
jvm1.5: [linN-1, lin32]
jvm1.6: [linN-1]
jvm1.6-64: [linN-1] 

Rerun
Error: Exception thrown by the agent : 
java.rmi.server.ExportException: 
Port already in use: 9; nested exception is:  
java.net.BindException: Permission denied
 


Timed out waiting for network server 
to start

jvm1.4: []
jvm1.5: []
jvm1.6: [lin]
jvm1.6-64: []

Rerun
suitesAll:
InactiveManagementMBeanTest
[org.apache.derbyTesting.functionTests.tests.
derbynet.NSSecurityMechanismTest]:
  -1?NoJIRA – signature[21]
On rerun:
Known intermittent replication test failure: “%Could not ping in % * %ms.: DRDA_NoIO.S:Could not connect to Derby Network Server on host%”

 


Connection authentication failure occurred.
  Reason: userid or password invalid.

jvm1.4: []
jvm1.5: []
jvm1.6: [sparc]
jvm1.6-64: []

Rerun
[org.apache.derbyTesting.functionTests.tests.
jdbcapi.XADSAuthenticationTest]:
  -2599?NoJIRA – signature[9]
  and/or -2599?NoJIRA - signature[9]


Failure in test environment (test db)

jvm1.4: []
jvm1.5: []
jvm1.6: []
jvm1.6-64: [sol]

Rerun
derbyall not run due to test infra db failure.
OK on “manual” rerun of derbyall.



Detailed test results for derbyall, suitesAll etc.
Additional tests.

See also Apache Derby community platform testing reports for 10.5.3.0 RC 1.



Ole Solberg - 2009-08-21