Add OVN-K tests extension

[martinkennelly]

/hold
/cc

[openshift-ci]

@martinkennelly: GitHub didn't allow me to request PR reviews from the following users: martinkennelly.

Note that only openshift members and repo collaborators can review this PR, and authors cannot review their own PRs.

In response to this:

/hold
/cc

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

[openshift-ci]

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: martinkennelly
Once this PR has been reviewed and has the lgtm label, please assign bertinatto for approval. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

• OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[martinkennelly]

/testwith openshift/ovn-kubernetes#2461

[martinkennelly]

/payload-job-with-prs periodic-ci-openshift-release-master-ci-4.9-e2e-aws openshift/ovn-kubernetes#2461

[openshift-ci]

@martinkennelly: trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

• periodic-ci-openshift-release-master-ci-4.9-e2e-aws

See details on https://pr-payload-tests.ci.openshift.org/runs/ci/7ed92a30-edf0-11ef-9c0e-969e451224c9-0

[martinkennelly]

/payload-job-with-prs periodic-ci-openshift-release-master-ci-4.19-e2e-aws openshift/ovn-kubernetes#2461

[openshift-ci]

@martinkennelly: trigger 0 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

[martinkennelly]

/payload-job-with-prs periodic-ci-openshift-release-master-nightly-4.19-e2e-aws-ovn-serial openshift/ovn-kubernetes#2461

[openshift-ci]

@martinkennelly: trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

• periodic-ci-openshift-release-master-nightly-4.19-e2e-aws-ovn-serial

See details on https://pr-payload-tests.ci.openshift.org/runs/ci/f56add10-edf0-11ef-9bb1-df918fe19020-0

[martinkennelly]

/payload-job-with-prs periodic-ci-openshift-release-master-nightly-4.19-e2e-aws-ovn-serial openshift/ovn-kubernetes#2461

[openshift-ci]

@martinkennelly: trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

• periodic-ci-openshift-release-master-nightly-4.19-e2e-aws-ovn-serial

See details on https://pr-payload-tests.ci.openshift.org/runs/ci/ea0be960-edfe-11ef-80e0-5a872e60b37d-0

[martinkennelly]

/payload-job-with-prs periodic-ci-openshift-release-master-nightly-4.19-e2e-aws-ovn-serial openshift/ovn-kubernetes#2461

[openshift-ci]

@martinkennelly: trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

• periodic-ci-openshift-release-master-nightly-4.19-e2e-aws-ovn-serial

See details on https://pr-payload-tests.ci.openshift.org/runs/ci/7f7faaa0-ef75-11ef-96a2-28660f14b785-0

[martinkennelly]

/payload-job-with-prs periodic-ci-openshift-release-master-nightly-4.19-e2e-aws-ovn-serial openshift/ovn-kubernetes#2461

[openshift-ci]

@martinkennelly: it appears that you have attempted to use some version of the payload command, but your comment was incorrectly formatted and cannot be acted upon. See the docs for usage info.

[martinkennelly]

/payload-job-with-prs periodic-ci-openshift-release-master-nightly-4.19-e2e-aws-ovn-serial openshift/ovn-kubernetes#2461

[openshift-ci]

@martinkennelly: it appears that you have attempted to use some version of the payload command, but your comment was incorrectly formatted and cannot be acted upon. See the docs for usage info.

[martinkennelly]

/payload-job-with-prs periodic-ci-openshift-release-master-nightly-4.19-e2e-aws-ovn-serial openshift/ovn-kubernetes#2461

[openshift-ci]

@martinkennelly: trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

• periodic-ci-openshift-release-master-nightly-4.19-e2e-aws-ovn-serial

See details on https://pr-payload-tests.ci.openshift.org/runs/ci/6d7781c0-f434-11ef-8801-1e469e8c62a6-0

[martinkennelly]

/payload-job-with-prs periodic-ci-openshift-release-master-nightly-4.19-e2e-aws-ovn-serial openshift/ovn-kubernetes#2461

[openshift-ci]

@martinkennelly: trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

• periodic-ci-openshift-release-master-nightly-4.19-e2e-aws-ovn-serial

See details on https://pr-payload-tests.ci.openshift.org/runs/ci/6f782c60-f437-11ef-9145-be35b08d5196-0

[martinkennelly]

/payload-job-with-prs periodic-ci-openshift-release-master-nightly-4.19-e2e-aws-ovn-serial openshift/ovn-kubernetes#2461

[martinkennelly]

/payload-job-with-prs periodic-ci-openshift-release-master-nightly-4.19-e2e-aws-ovn-parallel openshift/ovn-kubernetes#2461

[openshift-ci]

@martinkennelly: trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

• periodic-ci-openshift-release-master-nightly-4.19-e2e-aws-ovn-serial

See details on https://pr-payload-tests.ci.openshift.org/runs/ci/7127e6c0-f8ee-11ef-8451-be2e287aee25-0

[openshift-ci]

@martinkennelly: it appears that you have attempted to use some version of the payload command, but your comment was incorrectly formatted and cannot be acted upon. See the docs for usage info.

[martinkennelly]

/payload-job-with-prs periodic-ci-openshift-release-master-nightly-4.19-e2e-aws-ovn openshift/ovn-kubernetes#2461

[openshift-ci]

@martinkennelly: it appears that you have attempted to use some version of the payload command, but your comment was incorrectly formatted and cannot be acted upon. See the docs for usage info.

[openshift-ci]

@martinkennelly: it appears that you have attempted to use some version of the payload command, but your comment was incorrectly formatted and cannot be acted upon. See the docs for usage info.

[openshift-ci]

@martinkennelly: it appears that you have attempted to use some version of the payload command, but your comment was incorrectly formatted and cannot be acted upon. See the docs for usage info.

[martinkennelly]

/payload-job-with-prs periodic-ci-openshift-release-master-nightly-4.19-e2e-aws-ovn-serial openshift/ovn-kubernetes#2461

[openshift-ci]

@martinkennelly: trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

• periodic-ci-openshift-release-master-nightly-4.19-e2e-aws-ovn-serial

See details on https://pr-payload-tests.ci.openshift.org/runs/ci/8b306dc0-f9ad-11ef-9be9-1fcffa142a83-0

[martinkennelly]

/payload-job-with-prs periodic-ci-openshift-release-master-nightly-4.19-e2e-aws-ovn-serial openshift/ovn-kubernetes#2461

[openshift-ci]

@martinkennelly: trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

• periodic-ci-openshift-release-master-nightly-4.19-e2e-aws-ovn-serial

See details on https://pr-payload-tests.ci.openshift.org/runs/ci/3572e450-f9ba-11ef-94c3-eaa93478c8a3-0

[martinkennelly]

/payload-job-with-prs periodic-ci-openshift-release-master-nightly-4.19-e2e-aws-ovn-serial openshift/ovn-kubernetes#2461

[openshift-ci]

@martinkennelly: trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

• periodic-ci-openshift-release-master-nightly-4.19-e2e-aws-ovn-serial

See details on https://pr-payload-tests.ci.openshift.org/runs/ci/1fad4d60-f9db-11ef-9434-2eb60f5f3962-0

[martinkennelly]

/payload-job-with-prs periodic-ci-openshift-release-master-nightly-4.19-e2e-aws-ovn-serial openshift/ovn-kubernetes#2461

[openshift-ci]

@martinkennelly: trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

• periodic-ci-openshift-release-master-nightly-4.19-e2e-aws-ovn-serial

See details on https://pr-payload-tests.ci.openshift.org/runs/ci/eea81f10-03fd-11f0-8b75-37136988430f-0

[martinkennelly]

/payload-job-with-prs periodic-ci-openshift-release-master-nightly-4.19-e2e-aws-ovn-serial openshift/ovn-kubernetes#2461

[openshift-ci]

@martinkennelly: trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

• periodic-ci-openshift-release-master-nightly-4.19-e2e-aws-ovn-serial

See details on https://pr-payload-tests.ci.openshift.org/runs/ci/283ae640-040d-11f0-9ba3-1e78e8d5a37c-0

[martinkennelly]

/payload-job-with-prs periodic-ci-openshift-release-master-nightly-4.19-e2e-aws-ovn-serial openshift/ovn-kubernetes#2461

[openshift-ci]

@martinkennelly: it appears that you have attempted to use some version of the payload command, but your comment was incorrectly formatted and cannot be acted upon. See the docs for usage info.

[martinkennelly]

/payload-job-with-prs periodic-ci-openshift-release-master-nightly-4.19-e2e-aws-ovn-serial openshift/ovn-kubernetes#2461

[openshift-ci]

@martinkennelly: trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

• periodic-ci-openshift-release-master-nightly-4.19-e2e-aws-ovn-serial

See details on https://pr-payload-tests.ci.openshift.org/runs/ci/7e008260-06e7-11f0-8c56-7c295956de08-0

[martinkennelly]

/payload-job-with-prs periodic-ci-openshift-multiarch-master-nightly-4.19-ocp-e2e-aws-ovn-multi-x-x openshift/ovn-kubernetes#2461,#29546

[openshift-ci]

@martinkennelly: it appears that you have attempted to use some version of the payload command, but your comment was incorrectly formatted and cannot be acted upon. See the docs for usage info.

[martinkennelly]

/payload-job-with-prs periodic-ci-openshift-multiarch-master-nightly-4.19-ocp-e2e-aws-ovn-multi-x-x openshift/ovn-kubernetes#2461,#29546

[openshift-ci]

@martinkennelly: it appears that you have attempted to use some version of the payload command, but your comment was incorrectly formatted and cannot be acted upon. See the docs for usage info.

[martinkennelly]

/payload-job-with-prs periodic-ci-openshift-multiarch-master-nightly-4.19-ocp-e2e-aws-ovn-multi-x-x openshift/ovn-kubernetes#2461

[openshift-ci]

@martinkennelly: trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

• periodic-ci-openshift-multiarch-master-nightly-4.19-ocp-e2e-aws-ovn-multi-x-x

See details on https://pr-payload-tests.ci.openshift.org/runs/ci/5f6d3fe0-06e8-11f0-90ff-464085f34178-0

[martinkennelly]

Dev/QE intro docs: https://docs.google.com/document/d/1QfTH5s4h8Tzh6SgPwCAEDlYdyvbJUMr7TrgjQDeEVFs/edit?tab=t.0#heading=h.tig469hwr1a

[openshift-merge-robot]

PR needs rebase.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

[openshift-trt]

Job Failure Risk Analysis for sha: cf10483

Job Name	Failure Risk
pull-ci-openshift-origin-main-e2e-aws-ovn-serial	IncompleteTests Tests for this run (2) are below the historical average (1113): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)

[openshift-trt]

Job Failure Risk Analysis for sha: cf10483

Job Name	Failure Risk
pull-ci-openshift-origin-main-e2e-aws-ovn-serial	IncompleteTests Tests for this run (2) are below the historical average (1134): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-aws-ovn-serial-1of2	IncompleteTests Tests for this run (2) are below the historical average (1133): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-aws-ovn-serial-2of2	IncompleteTests Tests for this run (2) are below the historical average (1055): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)

[jluhrsen]

looking at last payload run, it appears things are working as expected for this PR. or at least close. I noticed a few things:

the job discovers 45 tests:

`time="2025-03-22T08:44:23Z" level=info msg="Listed 45 tests for ovnk-tests-ext in 59.581724ms"

looks like only 44 ran:

❯ curl -s https://gcsweb-ci.apps.ci.l2s4.p1.openshiftapps.com/gcs/test-platform-results/logs/openshift-ovn-kubernetes-2461-openshift-origin-29546-nightly-4.19-ocp-e2e-aws-ovn-multi-x-x/1903335656755564544/artifacts/ocp-e2e-aws-ovn-multi-x-x/openshift-e2e-test/build-log.txt  | rg 'started: .*\[ovn-kubernetes\]' | awk -F\" '{print $2}' | sort | uniq | wc -l
44

also, I noticed some "error" test cases that I'm not sure is about. Here are 4 cases that show up as error because no test exists with that name:

❯ curl -s https://gcsweb-ci.apps.ci.l2s4.p1.openshiftapps.com/gcs/test-platform-results/logs/openshift-ovn-kubernetes-2461-openshift-origin-29546-nightly-4.19-ocp-e2e-aws-ovn-multi-x-x/1903335656755564544/artifacts/ocp-e2e-aws-ovn-multi-x-x/openshift-e2e-test/build-log.txt  | rg 'error: .*\[ovn-kubernetes\]'
error: no test exists with that name: [ovn-kubernetes][Feature:NetworkSegmentation][OCPFeatureGate:NetworkSegmentation] services on a user defined primary network should be reachable through their cluster IP, node port and load balancer L3 primary UDN, cluster-networked pods, NodePort service [Suite:openshift/conformance/parallel]
error: no test exists with that name: [ovn-kubernetes][Feature:NetworkSegmentation][OCPFeatureGate:NetworkSegmentation] Sync perform east/west traffic between nodes following OVN Kube node pod restart L2 [Suite:openshift/conformance/parallel]
error: no test exists with that name: [ovn-kubernetes][Feature:NetworkSegmentation][OCPFeatureGate:NetworkSegmentation] Sync perform east/west traffic between nodes following OVN Kube node pod restart L3 [Suite:openshift/conformance/parallel]
error: no test exists with that name: [ovn-kubernetes][Feature:NetworkSegmentation][OCPFeatureGate:NetworkSegmentation] services on a user defined primary network should be reachable through their cluster IP, node port and load balancer L2 primary UDN, cluster-networked pods, NodePort service [Suite:openshift/conformance/parallel]

but if you look at the history in the log, you can see the first time it's called it has an error for not existing, but then it's run later and fails, but not because it's not found:

❯ curl -s https://gcsweb-ci.apps.ci.l2s4.p1.openshiftapps.com/gcs/test-platform-results/logs/openshift-ovn-kubernetes-2461-openshift-origin-29546-nightly-4.19-ocp-e2e-aws-ovn-multi-x-x/1903335656755564544/artifacts/ocp-e2e-aws-ovn-multi-x-x/openshift-e2e-test/build-log.txt  | rg ': .*\[ovn-kubernetes\]' | rg 'Sync perform east/west traffic between nodes following OVN Kube node pod restart L2'
started: 1/144/570 "[ovn-kubernetes][Feature:NetworkSegmentation][OCPFeatureGate:NetworkSegmentation] Sync perform east/west traffic between nodes following OVN Kube node pod restart L2 [Suite:openshift/conformance/parallel]"
failed: (15.2s) 2025-03-22T09:22:54 "[ovn-kubernetes][Feature:NetworkSegmentation][OCPFeatureGate:NetworkSegmentation] Sync perform east/west traffic between nodes following OVN Kube node pod restart L2 [Suite:openshift/conformance/parallel]"
started: 0/6/13 "[ovn-kubernetes][Feature:NetworkSegmentation][OCPFeatureGate:NetworkSegmentation] Sync perform east/west traffic between nodes following OVN Kube node pod restart L2 [Suite:openshift/conformance/parallel]"
error: no test exists with that name: [ovn-kubernetes][Feature:NetworkSegmentation][OCPFeatureGate:NetworkSegmentation] Sync perform east/west traffic between nodes following OVN Kube node pod restart L2 [Suite:openshift/conformance/parallel]
failed: (2s) 2025-03-22T09:44:08 "[ovn-kubernetes][Feature:NetworkSegmentation][OCPFeatureGate:NetworkSegmentation] Sync perform east/west traffic between nodes following OVN Kube node pod restart L2 [Suite:openshift/conformance/parallel]"

`

[openshift-ci]

@martinkennelly: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name	Commit	Details	Required	Rerun command
ci/prow/e2e-aws-csi	cf10483	link	false	/test e2e-aws-csi
ci/prow/okd-scos-e2e-aws-ovn	cf10483	link	false	/test okd-scos-e2e-aws-ovn
ci/prow/e2e-hypershift-conformance	cf10483	link	false	/test e2e-hypershift-conformance
ci/prow/e2e-metal-ipi-ovn	cf10483	link	false	/test e2e-metal-ipi-ovn
ci/prow/e2e-gcp-csi	cf10483	link	false	/test e2e-gcp-csi
ci/prow/e2e-agnostic-ovn-cmd	cf10483	link	false	/test e2e-agnostic-ovn-cmd
ci/prow/e2e-aws-ovn-cgroupsv2	cf10483	link	false	/test e2e-aws-ovn-cgroupsv2
ci/prow/e2e-aws-ovn-kube-apiserver-rollout	cf10483	link	false	/test e2e-aws-ovn-kube-apiserver-rollout
ci/prow/e2e-gcp-ovn-rt-upgrade	cf10483	link	false	/test e2e-gcp-ovn-rt-upgrade
ci/prow/e2e-aws-ovn-single-node	cf10483	link	false	/test e2e-aws-ovn-single-node
ci/prow/e2e-metal-ipi-ovn-kube-apiserver-rollout	cf10483	link	false	/test e2e-metal-ipi-ovn-kube-apiserver-rollout
ci/prow/e2e-aws-ovn-upgrade	cf10483	link	false	/test e2e-aws-ovn-upgrade
ci/prow/e2e-openstack-ovn	cf10483	link	false	/test e2e-openstack-ovn
ci/prow/e2e-aws-ovn-single-node-upgrade	cf10483	link	false	/test e2e-aws-ovn-single-node-upgrade
ci/prow/e2e-aws-ovn-single-node-serial	cf10483	link	false	/test e2e-aws-ovn-single-node-serial
ci/prow/e2e-vsphere-ovn-upi	cf10483	link	true	/test e2e-vsphere-ovn-upi
ci/prow/e2e-aws-ovn-edge-zones	cf10483	link	true	/test e2e-aws-ovn-edge-zones
ci/prow/e2e-aws-ovn-microshift-serial	cf10483	link	true	/test e2e-aws-ovn-microshift-serial
ci/prow/e2e-metal-ipi-ovn-ipv6	cf10483	link	true	/test e2e-metal-ipi-ovn-ipv6
ci/prow/e2e-gcp-ovn-upgrade	cf10483	link	true	/test e2e-gcp-ovn-upgrade
ci/prow/e2e-gcp-ovn	cf10483	link	true	/test e2e-gcp-ovn
ci/prow/e2e-aws-ovn-microshift	cf10483	link	true	/test e2e-aws-ovn-microshift
ci/prow/e2e-vsphere-ovn	cf10483	link	true	/test e2e-vsphere-ovn
ci/prow/e2e-aws-ovn-fips	cf10483	link	true	/test e2e-aws-ovn-fips
ci/prow/e2e-aws-ovn-serial-1of2	cf10483	link	true	/test e2e-aws-ovn-serial-1of2
ci/prow/e2e-aws-ovn-serial-2of2	cf10483	link	true	/test e2e-aws-ovn-serial-2of2
ci/prow/e2e-aws-ovn-serial	cf10483	link	true	/test e2e-aws-ovn-serial
ci/prow/e2e-aws-ovn-serial-publicnet	cf10483	link	true	/test e2e-aws-ovn-serial-publicnet

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

[openshift-trt]

Job Failure Risk Analysis for sha: cf10483

Job Name	Failure Risk
pull-ci-openshift-origin-main-e2e-aws-ovn-serial	IncompleteTests Tests for this run (2) are below the historical average (1039): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-aws-ovn-serial-1of2	IncompleteTests Tests for this run (2) are below the historical average (1556): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-aws-ovn-serial-2of2	IncompleteTests Tests for this run (2) are below the historical average (1418): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)