Skip to content

Conversation

wking
Copy link
Member

@wking wking commented Aug 25, 2025

The ConfigMap retrieval occasionally fails:

$ curl -s 'https://search.dptools.openshift.org/search?maxAge=24h&type=junit&context=0&search=error%20accessing%20microshift-version%20configmap' | jq -r 'to_entries[] | .key as $k | .value | to_entries[].value[].context[] | $k + "\n  " + .'
https://prow.ci.openshift.org/view/gs/test-platform-results/logs/periodic-ci-openshift-release-master-ci-4.17-e2e-aws-ovn-techpreview/1959742094134218752
    I0824 23:53:47.495715 90800 framework.go:2294] error accessing microshift-version configmap: Get "https://api.ci-op-hfy5sixp-82aa7.origin-ci-int-aws.dev.rhcloud.com:6443/api/v1/namespaces/kube-public/configmaps/microshift-version": dial tcp: lookup api.ci-op-hfy5sixp-82aa7.origin-ci-int-aws.dev.rhcloud.com on 172.30.0.10:53: read udp 10.129.136.246:33085->172.30.0.10:53: i/o timeout
https://prow.ci.openshift.org/view/gs/test-platform-results/logs/periodic-ci-openshift-release-master-nightly-4.17-e2e-aws-ovn-cgroupsv2/1959742058285502464
    I0824 23:53:34.234531 68956 framework.go:2294] error accessing microshift-version configmap: Get "https://api.ci-op-950shpk8-29422.XXXXXXXXXXXXXXXXXXXXXX:6443/api/v1/namespaces/kube-public/configmaps/microshift-version": dial tcp: lookup api.ci-op-950shpk8-29422.XXXXXXXXXXXXXXXXXXXXXX on 172.30.0.10:53: read udp 10.130.176.97:35168->172.30.0.10:53: i/o timeout
https://prow.ci.openshift.org/view/gs/test-platform-results/logs/release-openshift-origin-installer-e2e-aws-upgrade-4.14-to-4.15-to-4.16-to-4.17-ci/1959761685916946432
    I0825 04:30:25.015456 907 framework.go:2294] error accessing microshift-version configmap: Get "https://api.ci-op-wwl4bdif-d25a9.origin-ci-int-aws.dev.rhcloud.com:6443/api/v1/namespaces/kube-public/configmaps/microshift-version": dial tcp: lookup api.ci-op-wwl4bdif-d25a9.origin-ci-int-aws.dev.rhcloud.com on 172.30.0.10:53: no such host
https://prow.ci.openshift.org/view/gs/test-platform-results/pr-logs/pull/30067/pull-ci-openshift-origin-main-e2e-hypershift-conformance/1959846453614481408
    I0825 07:00:44.838632 72570 framework.go:2320] error accessing microshift-version configmap: Get "https://add640066b4a046d58cb9cc48def1e09-925574a45e949171.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/kube-public/configmaps/microshift-version": dial tcp: lookup add640066b4a046d58cb9cc48def1e09-925574a45e949171.elb.us-east-1.amazonaws.com on 172.30.0.10:53: read udp 172.24.238.50:43260->172.30.0.10:53: i/o timeout

Placing it within a poll loop will avoid failing test-cases while they try to decide if the cluster is MicroShift or not, which is likely to be part of setup (e.g. "skip this test-case if the cluster is MicroShift"), and not the fundamental thing the test-case is trying to exercise.

Ideally there would be no hard-coded duration, and IsMicroShiftCluster would take a Context argument set up with whatever the caller felt was a reasonable time to make that determination. But I didn't want to get into adjusting all the IsMicroShiftCluster callers, so for now, I'm just hard-coding the duration.

@openshift-ci-robot openshift-ci-robot added the jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. label Aug 25, 2025
@openshift-ci-robot
Copy link

@wking: This pull request explicitly references no jira issue.

In response to this:

The ConfigMap retrieval occasionally fails:

$ curl -s 'https://search.dptools.openshift.org/search?maxAge=24h&type=junit&context=0&search=error%20accessing%20microshift-version%20configmap' | jq -r 'to_entries[] | .key as $k | .value | to_entries[].value[].context[] | $k + "\n  " + .'
https://prow.ci.openshift.org/view/gs/test-platform-results/logs/periodic-ci-openshift-release-master-ci-4.17-e2e-aws-ovn-techpreview/1959742094134218752
   I0824 23:53:47.495715 90800 framework.go:2294] error accessing microshift-version configmap: Get "https://api.ci-op-hfy5sixp-82aa7.origin-ci-int-aws.dev.rhcloud.com:6443/api/v1/namespaces/kube-public/configmaps/microshift-version": dial tcp: lookup api.ci-op-hfy5sixp-82aa7.origin-ci-int-aws.dev.rhcloud.com on 172.30.0.10:53: read udp 10.129.136.246:33085->172.30.0.10:53: i/o timeout
https://prow.ci.openshift.org/view/gs/test-platform-results/logs/periodic-ci-openshift-release-master-nightly-4.17-e2e-aws-ovn-cgroupsv2/1959742058285502464
   I0824 23:53:34.234531 68956 framework.go:2294] error accessing microshift-version configmap: Get "https://api.ci-op-950shpk8-29422.XXXXXXXXXXXXXXXXXXXXXX:6443/api/v1/namespaces/kube-public/configmaps/microshift-version": dial tcp: lookup api.ci-op-950shpk8-29422.XXXXXXXXXXXXXXXXXXXXXX on 172.30.0.10:53: read udp 10.130.176.97:35168->172.30.0.10:53: i/o timeout
https://prow.ci.openshift.org/view/gs/test-platform-results/logs/release-openshift-origin-installer-e2e-aws-upgrade-4.14-to-4.15-to-4.16-to-4.17-ci/1959761685916946432
   I0825 04:30:25.015456 907 framework.go:2294] error accessing microshift-version configmap: Get "https://api.ci-op-wwl4bdif-d25a9.origin-ci-int-aws.dev.rhcloud.com:6443/api/v1/namespaces/kube-public/configmaps/microshift-version": dial tcp: lookup api.ci-op-wwl4bdif-d25a9.origin-ci-int-aws.dev.rhcloud.com on 172.30.0.10:53: no such host
https://prow.ci.openshift.org/view/gs/test-platform-results/pr-logs/pull/30067/pull-ci-openshift-origin-main-e2e-hypershift-conformance/1959846453614481408
   I0825 07:00:44.838632 72570 framework.go:2320] error accessing microshift-version configmap: Get "https://add640066b4a046d58cb9cc48def1e09-925574a45e949171.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/kube-public/configmaps/microshift-version": dial tcp: lookup add640066b4a046d58cb9cc48def1e09-925574a45e949171.elb.us-east-1.amazonaws.com on 172.30.0.10:53: read udp 172.24.238.50:43260->172.30.0.10:53: i/o timeout

Placing it within a poll loop will avoid failing test-cases while they try to decide if the cluster is MicroShift or not, which is likely to be part of setup (e.g. "skip this test-case if the cluster is MicroShift"), and not the fundamental thing the test-case is trying to exercise.

Ideally there would be no hard-coded duration, and IsMicroShiftCluster would take a Context argument set up with whatever the caller felt was a reasonable time to make that determination. But I didn't want to get into adjusting all the IsMicroShiftCluster callers, so for now, I'm just hard-coding the duration.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@openshift-ci openshift-ci bot requested review from deads2k and sjenning August 25, 2025 12:16
The ConfigMap retrieval occasionally fails:

  $ curl -s 'https://search.dptools.openshift.org/search?maxAge=24h&type=junit&context=0&search=error%20accessing%20microshift-version%20configmap' | jq -r 'to_entries[] | .key as $k | .value | to_entries[].value[].context[] | $k + "\n  " + .'
  https://prow.ci.openshift.org/view/gs/test-platform-results/logs/periodic-ci-openshift-release-master-ci-4.17-e2e-aws-ovn-techpreview/1959742094134218752
      I0824 23:53:47.495715 90800 framework.go:2294] error accessing microshift-version configmap: Get "https://api.ci-op-hfy5sixp-82aa7.origin-ci-int-aws.dev.rhcloud.com:6443/api/v1/namespaces/kube-public/configmaps/microshift-version": dial tcp: lookup api.ci-op-hfy5sixp-82aa7.origin-ci-int-aws.dev.rhcloud.com on 172.30.0.10:53: read udp 10.129.136.246:33085->172.30.0.10:53: i/o timeout
  https://prow.ci.openshift.org/view/gs/test-platform-results/logs/periodic-ci-openshift-release-master-nightly-4.17-e2e-aws-ovn-cgroupsv2/1959742058285502464
      I0824 23:53:34.234531 68956 framework.go:2294] error accessing microshift-version configmap: Get "https://api.ci-op-950shpk8-29422.XXXXXXXXXXXXXXXXXXXXXX:6443/api/v1/namespaces/kube-public/configmaps/microshift-version": dial tcp: lookup api.ci-op-950shpk8-29422.XXXXXXXXXXXXXXXXXXXXXX on 172.30.0.10:53: read udp 10.130.176.97:35168->172.30.0.10:53: i/o timeout
  https://prow.ci.openshift.org/view/gs/test-platform-results/logs/release-openshift-origin-installer-e2e-aws-upgrade-4.14-to-4.15-to-4.16-to-4.17-ci/1959761685916946432
      I0825 04:30:25.015456 907 framework.go:2294] error accessing microshift-version configmap: Get "https://api.ci-op-wwl4bdif-d25a9.origin-ci-int-aws.dev.rhcloud.com:6443/api/v1/namespaces/kube-public/configmaps/microshift-version": dial tcp: lookup api.ci-op-wwl4bdif-d25a9.origin-ci-int-aws.dev.rhcloud.com on 172.30.0.10:53: no such host
  https://prow.ci.openshift.org/view/gs/test-platform-results/pr-logs/pull/30067/pull-ci-openshift-origin-main-e2e-hypershift-conformance/1959846453614481408
      I0825 07:00:44.838632 72570 framework.go:2320] error accessing microshift-version configmap: Get "https://add640066b4a046d58cb9cc48def1e09-925574a45e949171.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/kube-public/configmaps/microshift-version": dial tcp: lookup add640066b4a046d58cb9cc48def1e09-925574a45e949171.elb.us-east-1.amazonaws.com on 172.30.0.10:53: read udp 172.24.238.50:43260->172.30.0.10:53: i/o timeout

Placing it within a poll loop will avoid failing test-cases while they
try to decide if the cluster is MicroShift or not, which is likely to
be part of setup (e.g. "skip this test-case if the cluster is
MicroShift"), and not the fundamental thing the test-case is trying to
exercise.

Ideally there would be no hard-coded duration, and IsMicroShiftCluster
would take a Context argument set up with whatever the caller felt was
a reasonable time to make that determination.  But I didn't want to
get into adjusting all the IsMicroShiftCluster callers, so for now,
I'm just hard-coding the duration.
@stbenjam
Copy link
Member

/lgtm

Copy link
Member

@sosiouxme sosiouxme left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/lgtm

@openshift-ci openshift-ci bot added the lgtm Indicates that a PR is ready to be merged. label Aug 25, 2025
Copy link
Contributor

openshift-ci bot commented Aug 25, 2025

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: sosiouxme, stbenjam, wking

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-ci openshift-ci bot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Aug 25, 2025
@openshift-ci-robot
Copy link

/retest-required

Remaining retests: 0 against base HEAD cc8ae10 and 2 for PR HEAD d63d774 in total

Copy link
Contributor

openshift-ci bot commented Aug 25, 2025

@wking: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/e2e-gcp-ovn-techpreview d63d774 link false /test e2e-gcp-ovn-techpreview
ci/prow/e2e-metal-ipi-serial-ovn-ipv6-2of2 d63d774 link false /test e2e-metal-ipi-serial-ovn-ipv6-2of2
ci/prow/e2e-vsphere-ovn-upi d63d774 link true /test e2e-vsphere-ovn-upi
ci/prow/e2e-azure d63d774 link false /test e2e-azure
ci/prow/e2e-gcp-ovn-upgrade d63d774 link true /test e2e-gcp-ovn-upgrade
ci/prow/e2e-metal-ipi-ovn-kube-apiserver-rollout d63d774 link false /test e2e-metal-ipi-ovn-kube-apiserver-rollout
ci/prow/e2e-metal-ipi-ovn-dualstack d63d774 link false /test e2e-metal-ipi-ovn-dualstack
ci/prow/e2e-aws-ovn-upgrade d63d774 link false /test e2e-aws-ovn-upgrade
ci/prow/e2e-metal-ipi-ovn-dualstack-local-gateway d63d774 link false /test e2e-metal-ipi-ovn-dualstack-local-gateway
ci/prow/okd-scos-e2e-aws-ovn d63d774 link false /test okd-scos-e2e-aws-ovn
ci/prow/e2e-metal-ipi-ovn-ipv6 d63d774 link true /test e2e-metal-ipi-ovn-ipv6
ci/prow/e2e-metal-ipi-virtualmedia d63d774 link false /test e2e-metal-ipi-virtualmedia
ci/prow/e2e-aws-ovn-fips d63d774 link true /test e2e-aws-ovn-fips
ci/prow/e2e-openstack-ovn d63d774 link false /test e2e-openstack-ovn
ci/prow/e2e-aws-ovn-single-node d63d774 link false /test e2e-aws-ovn-single-node
ci/prow/e2e-vsphere-ovn d63d774 link true /test e2e-vsphere-ovn
ci/prow/e2e-metal-ipi-serial-1of2 d63d774 link false /test e2e-metal-ipi-serial-1of2
ci/prow/e2e-aws-proxy d63d774 link false /test e2e-aws-proxy
ci/prow/e2e-aws-ovn-single-node-upgrade d63d774 link false /test e2e-aws-ovn-single-node-upgrade
ci/prow/e2e-metal-ipi-serial-2of2 d63d774 link false /test e2e-metal-ipi-serial-2of2
ci/prow/e2e-gcp-ovn d63d774 link true /test e2e-gcp-ovn
ci/prow/e2e-aws-ovn d63d774 link false /test e2e-aws-ovn
ci/prow/e2e-metal-ipi-ovn d63d774 link false /test e2e-metal-ipi-ovn
ci/prow/e2e-gcp-ovn-techpreview-serial-2of2 d63d774 link false /test e2e-gcp-ovn-techpreview-serial-2of2
ci/prow/e2e-gcp-ovn-rt-upgrade d63d774 link false /test e2e-gcp-ovn-rt-upgrade
ci/prow/e2e-aws-ovn-edge-zones d63d774 link false /test e2e-aws-ovn-edge-zones
ci/prow/e2e-aws-disruptive d63d774 link false /test e2e-aws-disruptive
ci/prow/e2e-metal-ipi-serial-ovn-ipv6-1of2 d63d774 link false /test e2e-metal-ipi-serial-ovn-ipv6-1of2
ci/prow/e2e-aws-ovn-cgroupsv2 d63d774 link false /test e2e-aws-ovn-cgroupsv2

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. lgtm Indicates that a PR is ready to be merged.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants