Skip to content

Conversation

@dinhxuanvu
Copy link
Member

Currently, openshift-tests images cmd uses vendored GetMappedImageConfigs() function to map upstream images to mirrored ones. After this change, images cmd will parsed mapped images directly from outputs from the k8s-tests-ext binary. This prevents unexpected issues from imcompatible upstreams changes with vendored funcs.

@openshift-ci openshift-ci bot added the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Sep 29, 2025
@openshift-ci
Copy link
Contributor

openshift-ci bot commented Sep 29, 2025

Skipping CI for Draft Pull Request.
If you want CI signal for your change, please convert it to an actual PR.
You can still manually trigger a test run with /test all

@openshift-ci openshift-ci bot added the vendor-update Touching vendor dir or related files label Sep 29, 2025
@dinhxuanvu
Copy link
Member Author

/cc @bertinatto PTAL

@openshift-ci openshift-ci bot requested a review from bertinatto September 29, 2025 23:10
@openshift-ci
Copy link
Contributor

openshift-ci bot commented Sep 29, 2025

@dinhxuanvu: GitHub didn't allow me to request PR reviews from the following users: PTAL.

Note that only openshift members and repo collaborators can review this PR, and authors cannot review their own PRs.

In response to this:

/cc @bertinatto PTAL

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

Copy link
Member

@bertinatto bertinatto left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Together with openshift/kubernetes#2447, is this change getting us both original and mapped images?

@bertinatto
Copy link
Member

Together with openshift/kubernetes#2447, is this change getting us both original and mapped images?

Just in case you are not familiar with it, we can do that with this command:

/payload-job-with-prs periodic-ci-openshift-release-master-ci-4.21-e2e-aws-ovn openshift/kubernetes#2447

@openshift-ci
Copy link
Contributor

openshift-ci bot commented Sep 30, 2025

@bertinatto: trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

  • periodic-ci-openshift-release-master-ci-4.21-e2e-aws-ovn

See details on https://pr-payload-tests.ci.openshift.org/runs/ci/02629160-9e28-11f0-963d-726455cb7bc7-0

@dinhxuanvu dinhxuanvu marked this pull request as ready for review October 8, 2025 06:04
@openshift-ci openshift-ci bot removed the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Oct 8, 2025
@openshift-ci openshift-ci bot requested review from deads2k and p0lyn0mial October 8, 2025 06:05
@dinhxuanvu dinhxuanvu force-pushed the ot-images branch 3 times, most recently from c325563 to a88fe10 Compare October 10, 2025 07:13
@openshift-ci
Copy link
Contributor

openshift-ci bot commented Oct 10, 2025

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: dinhxuanvu
Once this PR has been reviewed and has the lgtm label, please assign bertinatto for approval. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-ci openshift-ci bot added the e2e-images-update Related to images used by e2e tests label Oct 10, 2025
@openshift-trt
Copy link

openshift-trt bot commented Oct 10, 2025

Job Failure Risk Analysis for sha: a88fe10

Job Name Failure Risk
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgrade IncompleteTests

@dinhxuanvu dinhxuanvu force-pushed the ot-images branch 2 times, most recently from 8a7c5af to 0913c46 Compare October 10, 2025 20:50
@dinhxuanvu
Copy link
Member Author

/payload-job-with-prs periodic-ci-openshift-release-master-ci-4.21-e2e-aws-ovn openshift/kubernetes#2447

@openshift-ci
Copy link
Contributor

openshift-ci bot commented Oct 10, 2025

@dinhxuanvu: trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

  • periodic-ci-openshift-release-master-ci-4.21-e2e-aws-ovn

See details on https://pr-payload-tests.ci.openshift.org/runs/ci/d9236830-a631-11f0-909f-cfa810781685-0

@dinhxuanvu
Copy link
Member Author

/retest-required

@dinhxuanvu
Copy link
Member Author

/test e2e-metal-ipi-ovn-ipv6

@openshift-trt
Copy link

openshift-trt bot commented Oct 13, 2025

Job Failure Risk Analysis for sha: 0913c46

Job Name Failure Risk
pull-ci-openshift-origin-main-e2e-metal-ipi-ovn-ipv6 IncompleteTests
Tests for this run (142) are below the historical average (3147): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)

@dinhxuanvu dinhxuanvu force-pushed the ot-images branch 2 times, most recently from 34d23eb to 52c391e Compare October 13, 2025 22:15
@openshift-trt
Copy link

openshift-trt bot commented Oct 14, 2025

Job Failure Risk Analysis for sha: 52c391e

Job Name Failure Risk
pull-ci-openshift-origin-main-e2e-metal-ipi-ovn-ipv6 IncompleteTests
Tests for this run (142) are below the historical average (3183): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)

@openshift-trt
Copy link

openshift-trt bot commented Oct 14, 2025

Job Failure Risk Analysis for sha: 6364e89

Job Name Failure Risk
pull-ci-openshift-origin-main-e2e-metal-ipi-ovn-ipv6 IncompleteTests
Tests for this run (142) are below the historical average (3139): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)

… binary

Currently, openshift-tests images cmd uses vendored GetMappedImageConfigs()
function to map upstream images to mirrored ones. After this change, images
cmd will parsed mapped images directly from outputs from the k8s-tests-ext
binary. This prevents unexpected issues from imcompatible upstreams changes
with vendored funcs.

Signed-off-by: Vu Dinh <[email protected]>
go mod vendor

Signed-off-by: Vu Dinh <[email protected]>
@dinhxuanvu
Copy link
Member Author

@bertinatto Ready for another round of review. PTAL. Thanks.

@openshift-ci
Copy link
Contributor

openshift-ci bot commented Nov 18, 2025

@dinhxuanvu: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/okd-scos-e2e-aws-ovn 6364e89 link false /test okd-scos-e2e-aws-ovn
ci/prow/verify 4d6ce8e link true /test verify
ci/prow/e2e-metal-ipi-ovn-ipv6 4d6ce8e link true /test e2e-metal-ipi-ovn-ipv6

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

@openshift-merge-robot openshift-merge-robot added the needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. label Nov 18, 2025
@openshift-merge-robot
Copy link
Contributor

PR needs rebase.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

@openshift-trt
Copy link

openshift-trt bot commented Nov 18, 2025

Job Failure Risk Analysis for sha: 4d6ce8e

Job Name Failure Risk
pull-ci-openshift-origin-main-e2e-metal-ipi-ovn-ipv6 IncompleteTests
Tests for this run (3) are below the historical average (2444): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)

@bertinatto
Copy link
Member

/payload-job-with-prs periodic-ci-openshift-release-master-ci-4.21-e2e-aws-ovn openshift/kubernetes#2447

@openshift-ci
Copy link
Contributor

openshift-ci bot commented Nov 24, 2025

@bertinatto: trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

  • periodic-ci-openshift-release-master-ci-4.21-e2e-aws-ovn

See details on https://pr-payload-tests.ci.openshift.org/runs/ci/29a7cf10-c952-11f0-8f49-cbdc43e1a601-0

Copy link
Member

@bertinatto bertinatto left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It seems like this isn't mapping to the right repository, for example:

openshift-tests images --to-repository quay.io/bertinatto/openshift-tests --upstream

(...)

registry.k8s.io/sig-storage/hostpathplugin:v1.15.0 quay.io/openshift/community-e2e-images:e2e-47-registry-k8s-io-sig-storage-hostpathplugin-v1-15-0-YS6opQN6AdImbOb6

}
mu.Lock()
allImages = append(allImages, imageConfig)
allImages = append(allImages, image...)
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think this change (ImageSet to extension.Image) is making this PR a lot harder to review. We now have confusing var names, like this in images_command.go:

	externalImageSets := []extension.Image{}
	initialImageSets := []extensions.ImageSet{

If you have a chance, and if it makes sense, I'd love to see this kind of change in separate, logical commits.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I can make changes to funcs in origin/pkg/test/extensions/binary.go but it means some funcs will have a different signatures moving forward. It may simplify the logic in images_command.go a bit but there will still be some changes.

Honestly, I find this whole operation combination (openshift-tests images + oc image mirror) is ugly because we modify from image paths from various image sources (upstream, internal and etc) which have their own sets of filters and modification on their own. Also, there are too many option combinations from two commands (are these mirrored already or not + upsteam or not) which lead to complex logic. Plus, we implemented this mirrored ImageSet only for one binary so it is a special case that is added on top of all of these options.

Anyway, let me make some changes on binary.go to see if those changes there will result in a simpler login on images_command.go side.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

e2e-images-update Related to images used by e2e tests needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. vendor-update Touching vendor dir or related files

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants