OTA-1637: ClusterOperators should not go Progressing only for a node reboot #30296

hongkailiu · 2025-09-23T15:11:08Z

This is to cover the node rebooting case from the rule [1] that is introduced recently:

Operators should not report Progressing only because DaemonSets
owned by them are adjusting to a new node from cluster scaleup or
a node rebooting from cluster upgrade.

The test fails if

co/machine-config never became Progressing=True during a
cluster upgrade, or
some CO left Progressing=False during the upgrade after
machine-config became Progressing=True. This should not
have taken place as machine-config was rebooting the nodes
which was the only thing ongoing to the cluster during that
time.

[1]. https://github.com/openshift/api/blob/61248d910ff74aef020492922d14e6dadaba598b/config/v1/types_cluster_operator.go#L163-L164

openshift-ci-robot · 2025-09-23T15:11:12Z

@hongkailiu: This pull request references OTA-1637 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the story to target the "4.21.0" version, but no target version was set.

In response to this:

This is to cover the node rebooting case from the rule [1] that is introduced recently:
Operators should not report Progressing only because DaemonSets
owned by them are adjusting to a new node from cluster scaleup or
a node rebooting from cluster upgrade.
[1]. https://github.com/openshift/api/blob/61248d910ff74aef020492922d14e6dadaba598b/config/v1/types_cluster_operator.go#L163-L164

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

openshift-ci-robot · 2025-09-23T18:30:06Z

@hongkailiu: This pull request references OTA-1637 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the story to target the "4.21.0" version, but no target version was set.

In response to this:

This is to cover the node rebooting case from the rule [1] that is introduced recently:
Operators should not report Progressing only because DaemonSets
owned by them are adjusting to a new node from cluster scaleup or
a node rebooting from cluster upgrade.
The test fails if

co/machine-config never became Progressing=True during a
cluster upgrade, or

some CO left Progressing=False during the upgrade after
machine-config became Progressing=True. This should not
have taken place as machine-config was rebooting the nodes
which was the only thing ongoing to the cluster during that
time.

[1]. https://github.com/openshift/api/blob/61248d910ff74aef020492922d14e6dadaba598b/config/v1/types_cluster_operator.go#L163-L164

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

hongkailiu · 2025-09-23T23:54:36Z

/test e2e-aws-ovn-upgrade

hongkailiu · 2025-09-23T23:59:51Z

I am a bit surprised that there are no failures.

For example, this job:

https://gcsweb-ci.apps.ci.l2s4.p1.openshiftapps.com/gcs/test-platform-results/pr-logs/pull/30296/pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade/1970556414640263168/artifacts/e2e-gcp-ovn-upgrade/openshift-e2e-test/artifacts/junit/e2e-monitor-tests__20250923-194737.xml looks pretty.

and https://gcsweb-ci.apps.ci.l2s4.p1.openshiftapps.com/gcs/test-platform-results/pr-logs/pull/30296/pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade/1970556414640263168/artifacts/e2e-gcp-ovn-upgrade/openshift-e2e-test/artifacts/junit/e2e-timelines_spyglass_20250923-194737.html does too.

🤔

openshift-trt · 2025-09-24T04:12:30Z

Job Failure Risk Analysis for sha: dbb8c76

Job Name	Failure Risk
pull-ci-openshift-origin-main-e2e-aws-csi	Medium Job run should complete before timeout This test has passed 83.33% of 6 runs on release 4.21 [Architecture:amd64 FeatureSet:default Installer:ipi JobTier:standard Network:ovn NetworkStack:ipv4 Owner:eng Platform:aws Procedure:none SecurityMode:default Topology:ha Upgrade:none] in the last week.
pull-ci-openshift-origin-main-e2e-aws-ovn-single-node-upgrade	IncompleteTests Tests for this run (2140) are below the historical average (4244): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)

Risk analysis has seen new tests most likely introduced by this PR.
Please ensure that new tests meet guidelines for naming and stability.

New tests seen in this PR at sha: dbb8c76

"[Monitor:legacy-cvo-invariants][bz-Bare Metal Hardware Provisioning] clusteroperator/baremetal should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/cloud-controller-manager should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/cluster-autoscaler should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/control-plane-machine-set should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/machine-api should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/machine-approver should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Cloud Credential Operator] clusteroperator/cloud-credential should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-DNS] clusteroperator/dns should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Etcd] clusteroperator/etcd should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Image Registry] clusteroperator/image-registry should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Insights Operator] clusteroperator/insights should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Machine Config Operator] clusteroperator/machine-config must go Progressing=True during an upgrade test" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Management Console] clusteroperator/console should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Monitoring] clusteroperator/monitoring should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Networking] clusteroperator/network should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Node Tuning Operator] clusteroperator/node-tuning should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/marketplace should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/operator-lifecycle-manager should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/operator-lifecycle-manager-catalog should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/operator-lifecycle-manager-packageserver should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]

(...showing 20 of 33 tests)

hongkailiu · 2025-09-24T15:49:49Z

/payload-job-with-prs periodic-ci-openshift-release-master-ci-4.21-upgrade-from-stable-4.20-e2e-gcp-ovn-rt-upgrade #30296

openshift-ci · 2025-09-24T15:50:01Z

@hongkailiu: trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

periodic-ci-openshift-release-master-ci-4.21-upgrade-from-stable-4.20-e2e-gcp-ovn-rt-upgrade

See details on https://pr-payload-tests.ci.openshift.org/runs/ci/1adde290-995e-11f0-9d57-8ba68c7fd024-0

openshift-ci · 2025-09-24T15:50:04Z

@hongkailiu: This PR was included in a payload test run from #30296
trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

periodic-ci-openshift-release-master-ci-4.21-upgrade-from-stable-4.20-e2e-gcp-ovn-rt-upgrade

See details on https://pr-payload-tests.ci.openshift.org/runs/ci/1adde290-995e-11f0-9d57-8ba68c7fd024-0

hongkailiu · 2025-09-24T21:25:24Z

The payload cmd above is working. The triggered job shows the code spotted some violations but also missed a few (comparing to the COs with Progressing=True in the spyclass).

caught
- dns
- image-registry
- network
- node-tuning
- storage
missed
- kube-storage-version-migrator
- csi-snapshot-controller
- ingress
- service-ca

Refining the code to see why missed.

hongkailiu · 2025-09-24T21:25:39Z

/payload-job-with-prs periodic-ci-openshift-release-master-ci-4.21-upgrade-from-stable-4.20-e2e-gcp-ovn-rt-upgrade #30296

openshift-ci · 2025-09-24T21:25:45Z

@hongkailiu: trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

periodic-ci-openshift-release-master-ci-4.21-upgrade-from-stable-4.20-e2e-gcp-ovn-rt-upgrade

See details on https://pr-payload-tests.ci.openshift.org/runs/ci/05382750-998d-11f0-963e-c3b711331506-0

openshift-ci · 2025-09-24T21:25:46Z

@hongkailiu: This PR was included in a payload test run from #30296
trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

periodic-ci-openshift-release-master-ci-4.21-upgrade-from-stable-4.20-e2e-gcp-ovn-rt-upgrade

See details on https://pr-payload-tests.ci.openshift.org/runs/ci/05382750-998d-11f0-963e-c3b711331506-0

openshift-trt · 2025-09-25T03:13:46Z

Job Failure Risk Analysis for sha: bad744e

Job Name	Failure Risk
pull-ci-openshift-origin-main-e2e-aws-ovn-edge-zones	Medium Job run should complete before timeout This test has passed 82.34% of 4739 runs on release 4.21 [Overall] in the last week.
pull-ci-openshift-origin-main-e2e-aws-ovn-single-node-upgrade	IncompleteTests Tests for this run (2159) are below the historical average (4037): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)

Risk analysis has seen new tests most likely introduced by this PR.
Please ensure that new tests meet guidelines for naming and stability.

New tests seen in this PR at sha: bad744e

"[Monitor:legacy-cvo-invariants][bz-Bare Metal Hardware Provisioning] clusteroperator/baremetal should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/cloud-controller-manager should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/cluster-autoscaler should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/control-plane-machine-set should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/machine-api should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/machine-approver should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Cloud Credential Operator] clusteroperator/cloud-credential should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-DNS] clusteroperator/dns should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Etcd] clusteroperator/etcd should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Image Registry] clusteroperator/image-registry should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Insights Operator] clusteroperator/insights should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Machine Config Operator] clusteroperator/machine-config must go Progressing=True during an upgrade test" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Management Console] clusteroperator/console should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Monitoring] clusteroperator/monitoring should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Networking] clusteroperator/network should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Node Tuning Operator] clusteroperator/node-tuning should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/marketplace should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/operator-lifecycle-manager should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/operator-lifecycle-manager-catalog should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/operator-lifecycle-manager-packageserver should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]

(...showing 20 of 33 tests)

hongkailiu · 2025-09-25T13:34:30Z

https://prow.ci.openshift.org/view/gs/test-platform-results/logs/openshift-origin-30296-openshift-origin-30296-ci-4.21-upgrade-from-stable-4.20-e2e-gcp-ovn-rt-upgrade/1970962887476252672

Same caught list before, still missing something.

Let us try again with total number of events:

/payload-job-with-prs periodic-ci-openshift-release-master-ci-4.21-upgrade-from-stable-4.20-e2e-gcp-ovn-rt-upgrade #30296

openshift-ci · 2025-09-25T13:34:55Z

@hongkailiu: trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

periodic-ci-openshift-release-master-ci-4.21-upgrade-from-stable-4.20-e2e-gcp-ovn-rt-upgrade

See details on https://pr-payload-tests.ci.openshift.org/runs/ci/5e26f440-9a14-11f0-8659-71352787cde2-0

openshift-ci · 2025-09-25T13:34:57Z

@hongkailiu: This PR was included in a payload test run from #30296
trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

periodic-ci-openshift-release-master-ci-4.21-upgrade-from-stable-4.20-e2e-gcp-ovn-rt-upgrade

See details on https://pr-payload-tests.ci.openshift.org/runs/ci/5e26f440-9a14-11f0-8659-71352787cde2-0

openshift-trt · 2025-09-25T18:14:12Z

Job Failure Risk Analysis for sha: d415550

Job Name	Failure Risk
pull-ci-openshift-origin-main-e2e-aws-ovn-microshift	IncompleteTests Tests for this run (22) are below the historical average (1298): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-aws-ovn-microshift-serial	IncompleteTests Tests for this run (22) are below the historical average (662): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)

Risk analysis has seen new tests most likely introduced by this PR.
Please ensure that new tests meet guidelines for naming and stability.

New tests seen in this PR at sha: d415550

"[Monitor:legacy-cvo-invariants][bz-Bare Metal Hardware Provisioning] clusteroperator/baremetal should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/cloud-controller-manager should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/cluster-autoscaler should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/control-plane-machine-set should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/machine-api should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/machine-approver should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Cloud Credential Operator] clusteroperator/cloud-credential should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-DNS] clusteroperator/dns should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Etcd] clusteroperator/etcd should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Image Registry] clusteroperator/image-registry should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Insights Operator] clusteroperator/insights should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Machine Config Operator] clusteroperator/machine-config must go Progressing=True during an upgrade test" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Management Console] clusteroperator/console should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Monitoring] clusteroperator/monitoring should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Networking] clusteroperator/network should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Node Tuning Operator] clusteroperator/node-tuning should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/marketplace should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/operator-lifecycle-manager should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/operator-lifecycle-manager-catalog should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/operator-lifecycle-manager-packageserver should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]

(...showing 20 of 33 tests)

hongkailiu · 2025-09-25T19:47:39Z

Let us see if https://github.com/openshift/origin/compare/d41555013e72e50e055e6fc1ecf38229560c5b35..969fcc5a0bf55a5242c3e57a302f9e2fd2a04370 helps.

/payload-job-with-prs periodic-ci-openshift-release-master-ci-4.21-upgrade-from-stable-4.20-e2e-gcp-ovn-rt-upgrade #30296

openshift-ci · 2025-09-25T19:47:44Z

@hongkailiu: trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

periodic-ci-openshift-release-master-ci-4.21-upgrade-from-stable-4.20-e2e-gcp-ovn-rt-upgrade

See details on https://pr-payload-tests.ci.openshift.org/runs/ci/7f025ef0-9a48-11f0-971e-3b18f6cdf426-0

openshift-ci · 2025-09-25T19:47:44Z

@hongkailiu: This PR was included in a payload test run from #30296
trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

periodic-ci-openshift-release-master-ci-4.21-upgrade-from-stable-4.20-e2e-gcp-ovn-rt-upgrade

See details on https://pr-payload-tests.ci.openshift.org/runs/ci/7f025ef0-9a48-11f0-971e-3b18f6cdf426-0

hongkailiu · 2025-09-25T23:43:36Z

The last job failed too earlier for an irrelevant reason.
Let us rerun:

/payload-job-with-prs periodic-ci-openshift-release-master-ci-4.21-upgrade-from-stable-4.20-e2e-gcp-ovn-rt-upgrade #30296

hongkailiu · 2025-10-23T15:11:00Z

/retest-required

xueqzhan

Looking good. With some comments.

pkg/monitortests/clusterversionoperator/legacycvomonitortests/operators.go

hongkailiu · 2025-10-24T02:51:47Z

/payload-job periodic-ci-openshift-release-master-ci-4.21-upgrade-from-stable-4.20-e2e-gcp-ovn-rt-upgrade

openshift-ci · 2025-10-24T02:51:50Z

@hongkailiu: trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

periodic-ci-openshift-release-master-ci-4.21-upgrade-from-stable-4.20-e2e-gcp-ovn-rt-upgrade

See details on https://pr-payload-tests.ci.openshift.org/runs/ci/622244b0-b084-11f0-8bd2-31946e34d33f-0

openshift-trt · 2025-10-24T06:36:42Z

Risk analysis has seen new tests most likely introduced by this PR.
Please ensure that new tests meet guidelines for naming and stability.

New Test Risks for sha: 7d824bf

Job Name	New Test Risk
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Bare Metal Hardware Provisioning] clusteroperator/baremetal should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/cloud-controller-manager should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/cluster-autoscaler should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/control-plane-machine-set should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/machine-api should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/machine-approver should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Cloud Credential Operator] clusteroperator/cloud-credential should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-DNS] clusteroperator/dns should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Etcd] clusteroperator/etcd should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Image Registry] clusteroperator/image-registry should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Insights Operator] clusteroperator/insights should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Machine Config Operator] clusteroperator/machine-config must go Progressing=True during an upgrade test" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Management Console] clusteroperator/console should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Monitoring] clusteroperator/monitoring should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Networking] clusteroperator/network should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Node Tuning Operator] clusteroperator/node-tuning should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/marketplace should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/olm should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/operator-lifecycle-manager should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/operator-lifecycle-manager-catalog should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
	(...showing 20 of 34 rows)

New tests seen in this PR at sha: 7d824bf

"[Monitor:legacy-cvo-invariants][bz-Bare Metal Hardware Provisioning] clusteroperator/baremetal should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/cloud-controller-manager should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/cluster-autoscaler should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/control-plane-machine-set should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/machine-api should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/machine-approver should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Cloud Credential Operator] clusteroperator/cloud-credential should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-DNS] clusteroperator/dns should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Etcd] clusteroperator/etcd should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Image Registry] clusteroperator/image-registry should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Insights Operator] clusteroperator/insights should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Machine Config Operator] clusteroperator/machine-config must go Progressing=True during an upgrade test" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Management Console] clusteroperator/console should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Monitoring] clusteroperator/monitoring should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Networking] clusteroperator/network should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Node Tuning Operator] clusteroperator/node-tuning should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/marketplace should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/olm should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/operator-lifecycle-manager should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/operator-lifecycle-manager-catalog should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]

(...showing 20 of 34 tests)

openshift-trt · 2025-10-24T07:11:24Z

Risk analysis has seen new tests most likely introduced by this PR.
Please ensure that new tests meet guidelines for naming and stability.

New Test Risks for sha: 7d824bf

Job Name	New Test Risk
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Bare Metal Hardware Provisioning] clusteroperator/baremetal should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/cloud-controller-manager should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/cluster-autoscaler should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/control-plane-machine-set should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/machine-api should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/machine-approver should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Cloud Credential Operator] clusteroperator/cloud-credential should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-DNS] clusteroperator/dns should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Etcd] clusteroperator/etcd should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Image Registry] clusteroperator/image-registry should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Insights Operator] clusteroperator/insights should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Machine Config Operator] clusteroperator/machine-config must go Progressing=True during an upgrade test" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Management Console] clusteroperator/console should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Monitoring] clusteroperator/monitoring should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Networking] clusteroperator/network should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Node Tuning Operator] clusteroperator/node-tuning should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/marketplace should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/olm should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/operator-lifecycle-manager should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/operator-lifecycle-manager-catalog should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
	(...showing 20 of 34 rows)

New tests seen in this PR at sha: 7d824bf

"[Monitor:legacy-cvo-invariants][bz-Bare Metal Hardware Provisioning] clusteroperator/baremetal should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/cloud-controller-manager should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/cluster-autoscaler should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/control-plane-machine-set should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/machine-api should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/machine-approver should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Cloud Credential Operator] clusteroperator/cloud-credential should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-DNS] clusteroperator/dns should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Etcd] clusteroperator/etcd should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Image Registry] clusteroperator/image-registry should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Insights Operator] clusteroperator/insights should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Machine Config Operator] clusteroperator/machine-config must go Progressing=True during an upgrade test" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Management Console] clusteroperator/console should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Monitoring] clusteroperator/monitoring should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Networking] clusteroperator/network should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Node Tuning Operator] clusteroperator/node-tuning should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/marketplace should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/olm should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/operator-lifecycle-manager should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/operator-lifecycle-manager-catalog should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]

(...showing 20 of 34 tests)

xueqzhan · 2025-10-24T20:43:10Z

/approve

DavidHurta · 2025-10-27T14:15:43Z

/lgtm

openshift-ci · 2025-10-27T14:16:12Z

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: DavidHurta, hongkailiu, petr-muller, xueqzhan

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

~~OWNERS~~ [xueqzhan]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

hongkailiu · 2025-10-27T22:53:51Z

#30296 (comment)

/verified by @hongkailiu

openshift-ci-robot · 2025-10-27T22:54:01Z

@hongkailiu: This PR has been marked as verified by @hongkailiu.

In response to this:

#30296 (comment)

/verified by @hongkailiu

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

openshift-ci · 2025-10-28T02:59:04Z

@hongkailiu: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name	Commit	Details	Required	Rerun command
ci/prow/e2e-metal-ipi-ovn-dualstack-local-gateway	`5feff1f`	link	false	`/test e2e-metal-ipi-ovn-dualstack-local-gateway`
ci/prow/e2e-aws-disruptive	`5feff1f`	link	false	`/test e2e-aws-disruptive`
ci/prow/e2e-aws-ovn	`5feff1f`	link	false	`/test e2e-aws-ovn`
ci/prow/e2e-metal-ipi-virtualmedia	`5feff1f`	link	false	`/test e2e-metal-ipi-virtualmedia`
ci/prow/e2e-aws-ovn-kube-apiserver-rollout	`5feff1f`	link	false	`/test e2e-aws-ovn-kube-apiserver-rollout`
ci/prow/e2e-metal-ipi-ovn-dualstack	`5feff1f`	link	false	`/test e2e-metal-ipi-ovn-dualstack`
ci/prow/e2e-openstack-ovn	`d5c10bf`	link	false	`/test e2e-openstack-ovn`
ci/prow/e2e-metal-ipi-ovn	`d5c10bf`	link	false	`/test e2e-metal-ipi-ovn`
ci/prow/e2e-aws-ovn-single-node-upgrade	`d5c10bf`	link	false	`/test e2e-aws-ovn-single-node-upgrade`
ci/prow/e2e-aws-ovn-single-node	`d5c10bf`	link	false	`/test e2e-aws-ovn-single-node`
ci/prow/e2e-aws-ovn-single-node-serial	`d5c10bf`	link	false	`/test e2e-aws-ovn-single-node-serial`

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

openshift-trt · 2025-10-28T03:05:33Z

Risk analysis has seen new tests most likely introduced by this PR.
Please ensure that new tests meet guidelines for naming and stability.

New Test Risks for sha: 7d824bf

Job Name	New Test Risk
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Bare Metal Hardware Provisioning] clusteroperator/baremetal should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/cloud-controller-manager should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/cluster-autoscaler should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/control-plane-machine-set should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/machine-api should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/machine-approver should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Cloud Credential Operator] clusteroperator/cloud-credential should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-DNS] clusteroperator/dns should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Etcd] clusteroperator/etcd should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Image Registry] clusteroperator/image-registry should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Insights Operator] clusteroperator/insights should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Machine Config Operator] clusteroperator/machine-config must go Progressing=True during an upgrade test" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Management Console] clusteroperator/console should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Monitoring] clusteroperator/monitoring should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Networking] clusteroperator/network should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Node Tuning Operator] clusteroperator/node-tuning should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/marketplace should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/olm should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/operator-lifecycle-manager should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/operator-lifecycle-manager-catalog should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
	(...showing 20 of 34 rows)

New tests seen in this PR at sha: 7d824bf

"[Monitor:legacy-cvo-invariants][bz-Bare Metal Hardware Provisioning] clusteroperator/baremetal should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/cloud-controller-manager should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/cluster-autoscaler should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/control-plane-machine-set should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/machine-api should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/machine-approver should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Cloud Credential Operator] clusteroperator/cloud-credential should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-DNS] clusteroperator/dns should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Etcd] clusteroperator/etcd should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Image Registry] clusteroperator/image-registry should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Insights Operator] clusteroperator/insights should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Machine Config Operator] clusteroperator/machine-config must go Progressing=True during an upgrade test" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Management Console] clusteroperator/console should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Monitoring] clusteroperator/monitoring should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Networking] clusteroperator/network should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Node Tuning Operator] clusteroperator/node-tuning should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/marketplace should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/olm should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/operator-lifecycle-manager should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/operator-lifecycle-manager-catalog should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]

(...showing 20 of 34 tests)

openshift-trt · 2025-10-28T03:10:22Z

Risk analysis has seen new tests most likely introduced by this PR.
Please ensure that new tests meet guidelines for naming and stability.

New Test Risks for sha: 7d824bf

Job Name	New Test Risk
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Bare Metal Hardware Provisioning] clusteroperator/baremetal should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/cloud-controller-manager should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/cluster-autoscaler should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/control-plane-machine-set should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/machine-api should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/machine-approver should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Cloud Credential Operator] clusteroperator/cloud-credential should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-DNS] clusteroperator/dns should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Etcd] clusteroperator/etcd should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Image Registry] clusteroperator/image-registry should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Insights Operator] clusteroperator/insights should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Machine Config Operator] clusteroperator/machine-config must go Progressing=True during an upgrade test" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Management Console] clusteroperator/console should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Monitoring] clusteroperator/monitoring should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Networking] clusteroperator/network should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-Node Tuning Operator] clusteroperator/node-tuning should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/marketplace should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/olm should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/operator-lifecycle-manager should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade	Medium - "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/operator-lifecycle-manager-catalog should stay Progressing=False while MCO is Progressing=True" is a new test, and was only seen in one job.
	(...showing 20 of 34 rows)

New tests seen in this PR at sha: 7d824bf

"[Monitor:legacy-cvo-invariants][bz-Bare Metal Hardware Provisioning] clusteroperator/baremetal should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/cloud-controller-manager should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/cluster-autoscaler should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/control-plane-machine-set should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/machine-api should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/machine-approver should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Cloud Credential Operator] clusteroperator/cloud-credential should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-DNS] clusteroperator/dns should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Etcd] clusteroperator/etcd should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Image Registry] clusteroperator/image-registry should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Insights Operator] clusteroperator/insights should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Machine Config Operator] clusteroperator/machine-config must go Progressing=True during an upgrade test" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Management Console] clusteroperator/console should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Monitoring] clusteroperator/monitoring should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Networking] clusteroperator/network should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-Node Tuning Operator] clusteroperator/node-tuning should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/marketplace should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/olm should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/operator-lifecycle-manager should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
"[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/operator-lifecycle-manager-catalog should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]

(...showing 20 of 34 tests)

openshift-ci-robot · 2025-10-28T03:10:54Z

/retest-required

Remaining retests: 0 against base HEAD b60bbfe and 2 for PR HEAD 7d824bf in total

…eboot" This reverts commit e603cd9, reversing changes made to b60bbfe.

…A-1637-reboot"" This reverts commit 7657bcc.

TRT-2386: Revert #30296 "OTA-1637: ClusterOperators should not go Progressing only for a node reboot"

…A-1637-reboot"" This reverts commit 7657bcc.

TRT-2386: Revert "Revert "Merge pull request #30296 from hongkailiu/OTA-1637-reboot""

openshift-ci-robot added the jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. label Sep 23, 2025

openshift-ci bot requested review from p0lyn0mial and sjenning September 23, 2025 15:12

hongkailiu force-pushed the OTA-1637-reboot branch 2 times, most recently from 22125c5 to dbb8c76 Compare September 23, 2025 18:29

hongkailiu force-pushed the OTA-1637-reboot branch from dbb8c76 to bad744e Compare September 24, 2025 21:21

hongkailiu force-pushed the OTA-1637-reboot branch from bad744e to d415550 Compare September 25, 2025 13:33

hongkailiu mentioned this pull request Sep 25, 2025

OTA-1637: ClusterOperators should not go Progressing only for cluster scaling #30297

Merged

hongkailiu force-pushed the OTA-1637-reboot branch from d415550 to 969fcc5 Compare September 25, 2025 19:46

xueqzhan reviewed Oct 23, 2025

View reviewed changes

Address comments from review

7d824bf

hongkailiu force-pushed the OTA-1637-reboot branch from 2161edf to 7d824bf Compare October 24, 2025 02:50

openshift-ci-robot removed the verified Signifies that the PR passed pre-merge verification criteria label Oct 24, 2025

openshift-ci bot removed the lgtm Indicates that a PR is ready to be merged. label Oct 24, 2025

openshift-ci bot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Oct 24, 2025

DavidHurta approved these changes Oct 27, 2025

View reviewed changes

openshift-ci bot added the lgtm Indicates that a PR is ready to be merged. label Oct 27, 2025

openshift-ci-robot added the verified Signifies that the PR passed pre-merge verification criteria label Oct 27, 2025

openshift-merge-bot bot merged commit e603cd9 into openshift:main Oct 28, 2025
20 checks passed

xueqzhan added a commit to xueqzhan/origin that referenced this pull request Oct 29, 2025

Revert "Merge pull request openshift#30296 from hongkailiu/OTA-1637-r…

7657bcc

…eboot" This reverts commit e603cd9, reversing changes made to b60bbfe.

xueqzhan mentioned this pull request Oct 29, 2025

TRT-2386: Revert #30296 "OTA-1637: ClusterOperators should not go Progressing only for a node reboot" #30437

Merged

hongkailiu added a commit to hongkailiu/origin that referenced this pull request Oct 29, 2025

Revert "Revert "Merge pull request openshift#30296 from hongkailiu/OT…

2f4e72b

…A-1637-reboot"" This reverts commit 7657bcc.

openshift-merge-bot bot added a commit that referenced this pull request Oct 29, 2025

Merge pull request #30437 from xueqzhan/revert-30296-1761742915924

a91d3d0

TRT-2386: Revert #30296 "OTA-1637: ClusterOperators should not go Progressing only for a node reboot"

hongkailiu added a commit to hongkailiu/origin that referenced this pull request Oct 29, 2025

Revert "Revert "Merge pull request openshift#30296 from hongkailiu/OT…

c65d2d1

…A-1637-reboot"" This reverts commit 7657bcc.

openshift-merge-bot bot added a commit that referenced this pull request Nov 2, 2025

Merge pull request #30438 from hongkailiu/pr30437

387947a

TRT-2386: Revert "Revert "Merge pull request #30296 from hongkailiu/OTA-1637-reboot""

OTA-1637: ClusterOperators should not go Progressing only for a node reboot #30296

OTA-1637: ClusterOperators should not go Progressing only for a node reboot #30296

Uh oh!

Conversation

hongkailiu commented Sep 23, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

openshift-ci-robot commented Sep 23, 2025 • edited by openshift-ci bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

openshift-ci-robot commented Sep 23, 2025 • edited by openshift-ci bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

hongkailiu commented Sep 23, 2025

Uh oh!

hongkailiu commented Sep 23, 2025

Uh oh!

openshift-trt bot commented Sep 24, 2025

Uh oh!

hongkailiu commented Sep 24, 2025

Uh oh!

openshift-ci bot commented Sep 24, 2025

Uh oh!

openshift-ci bot commented Sep 24, 2025

Uh oh!

hongkailiu commented Sep 24, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

hongkailiu commented Sep 24, 2025

Uh oh!

openshift-ci bot commented Sep 24, 2025

Uh oh!

openshift-ci bot commented Sep 24, 2025

Uh oh!

openshift-trt bot commented Sep 25, 2025

Uh oh!

hongkailiu commented Sep 25, 2025

Uh oh!

openshift-ci bot commented Sep 25, 2025

Uh oh!

openshift-ci bot commented Sep 25, 2025

Uh oh!

openshift-trt bot commented Sep 25, 2025

Uh oh!

hongkailiu commented Sep 25, 2025

Uh oh!

openshift-ci bot commented Sep 25, 2025

Uh oh!

openshift-ci bot commented Sep 25, 2025

Uh oh!

hongkailiu commented Sep 25, 2025

Uh oh!

hongkailiu commented Oct 23, 2025

Uh oh!

xueqzhan left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

hongkailiu commented Oct 24, 2025

Uh oh!

openshift-ci bot commented Oct 24, 2025

Uh oh!

openshift-trt bot commented Oct 24, 2025

Uh oh!

openshift-trt bot commented Oct 24, 2025

Uh oh!

xueqzhan commented Oct 24, 2025

Uh oh!

DavidHurta commented Oct 27, 2025

Uh oh!

openshift-ci bot commented Oct 27, 2025

Uh oh!

hongkailiu commented Oct 27, 2025

Uh oh!

openshift-ci-robot commented Oct 27, 2025

Uh oh!

openshift-ci bot commented Oct 28, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

hongkailiu commented Sep 23, 2025 •

edited

Loading

openshift-ci-robot commented Sep 23, 2025 •

edited by openshift-ci bot

Loading

openshift-ci-robot commented Sep 23, 2025 •

edited by openshift-ci bot

Loading

hongkailiu commented Sep 24, 2025 •

edited

Loading

openshift-ci bot commented Oct 28, 2025 •

edited

Loading