Jakarta EE 11 Platform TCK status September 26, 2023

TCK update for working group call

Questions for EE 11 + TCKs:

When will we have a Platform TCK milestone one release that can be validated against Jakarta EE 10 Standalone Specification implementations?

When will we have a Platform TCK milestone two release that can be validated against Jakarta EE 10 implementations?

When will we have a Platform TCK milestone three release that is based on Jakarta EE 11 Specifications?

When will we have a Platform TCK milestone four release that contains all expected EE 11 specific tests?

EE 11 TCK plan:

The goal of validating against EE 10 implementations is to ensure the TCK tests work correctly while 
it is possible to do so.  Once we start adding EE 11 tests, we will start (possibly) breaking TCK tests as well.
The challenge for any EE release is to find all of the TCK bugs as well as bugs in the EE implementations.  

For EE 9, it took around 5 months to find a class loading race condition that caused frequent TCK test failures.  
We want to isolate finding implementation failures like that until we are really ready to test the EE 11 implementations.  

Based on the amount of TCK test refactoring done so far, it is too early to know when we will have our Platform TCK 
milestone releases.

Summary of Platform TCK accomplishments on TCK Refactor branch (https://github.com/jakartaee/platform-tck/tree/tckrefactor):

1. Servlet Specification TCK tests refactored and now moving to Servlet Specification repo https://github.com/jakartaee/servlet/pull/540
2. REST/JAX-RS Platform TCK refactor https://github.com/jakartaee/platform-tck/commit/732c21e0919650cd170bb3ed3528f76577889c55
3. Expression Language/EL test changes for running with JUnit https://github.com/jakartaee/platform-tck/pull/1164
4. Websocket TCK refactor with JUnit + Arquillian https://github.com/jakartaee/platform-tck/pull/1160
5. Pages/JSP TCK refactor with JUnit + Arquillian [5] is waiting for more review + approvals https://github.com/jakartaee/platform-tck/pull/1182
6. Messaging/JMS TCK refactor with JUnit + Arquillian [6] is waiting for more review + approvals https://github.com/jakartaee/platform-tck/pull/1185
7. Persistence TCK refactor with Junit + Arquillian is started and progerssing forward.
8. Pending tooling changes to automate conversion of Platform TCK tests to use JUnit + Arquillian https://github.com/starksm64/tck-rewrite-tools + https://github.com/scottmarlow/jakartaee-tck-tools/tree/jar2shrinkwrap
8.1  Scott Stark change is merged for https://github.com/starksm64/tck-rewrite-tools and will start working on applying it to Stateless EJB tests.
8.2  Scott Marlow change is merged for https://github.com/scottmarlow/jakartaee-tck-tools/tree/jar2shrinkwrap changes.