-
Notifications
You must be signed in to change notification settings - Fork 4.8k
TRT-2350: Include additional OTE metadata in JUnit results #30431
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
TRT-2350: Include additional OTE metadata in JUnit results #30431
Conversation
|
@stbenjam: This pull request references TRT-2350 which is a valid jira issue. Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the story to target the "4.21.0" version, but no target version was set. In response to this:
Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository. |
|
/test e2e-aws-ovn |
247aa01 to
fd4fb09
Compare
|
/test e2e-aws-ovn |
|
@neisw Updated to include additional info: <testcase
name="[Jira:config-operator][sig-api-machinery] sanity test should always pass [Suite:openshift/cluster-config-operator/conformance/parallel]"
time="0"
start-time="2025-11-12T20:06:48Z"
end-time="2025-11-12T20:06:48Z"
lifecycle="blocking"
source-image="cluster-config-operator"
source-binary="cluster-config-operator-tests-ext"
source-commit="347bebcc1"
/> |
Extend JUnit test case schema with OpenShift Test Extensions (OTE) metadata attributes. Metadata fields added: - Lifecycle classification (blocking/informing) - Test execution timestamps (start-time, end-time) - Source tracking (source-image, source-binary, source-url, source-commit) The source fields allow tracking which container image, binary, repository, and commit produced each test result, enabling better traceability and debugging of test failures across different builds.
fd4fb09 to
93a44f3
Compare
|
Ok so the commit isn't specific to the the test so it won't help with knowing where the code for the test lives. You had mentioned that the code path in ginkgo was somewhat nondeterministic I believe. Are we saying that for TRT-2326 we won't be able to do better than get them to the repo and the commit of that repo we are testing against? I'm also wondering if we have a good way to translate I'm guessing not here but we would most likely do that in sippy for something like TRT-2326 <testcase
name="[sig-api-machinery] FieldValidation should detect unknown metadata fields in both the root and embedded object of a CR [Conformance]"
time="4.4"
start-time="2025-11-13T17:00:11Z"
end-time="2025-11-13T17:00:16Z"
lifecycle="blocking"
source-image="hyperkube"
source-binary="k8s-tests-ext"
source-commit="891f5bb0306166d5625b89fc8dc86bbc8c85f549"/> |
But knowing the image name is enough to find it from the release payload: |
|
/lgtm It is getting us more data than we have now. Any gaps like the test location we can continue to evaluate. |
|
[APPROVALNOTIFIER] This PR is APPROVED This pull-request has been approved by: neisw, stbenjam The full list of commands accepted by this bot can be found here. The pull request process is described here
Needs approval from an approver in each of these files:
Approvers can indicate their approval by writing |
|
/verified by presubmits |
|
@stbenjam: This PR has been marked as verified by In response to this:
Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository. |
|
Scheduling required tests: |
12a5219
into
openshift:main
This allows us to add additional important information into the JUnit BigQuery table for use in Component Readness, or AI tools for analysis (e.g. correlating test failures with intervals).