Skip to content

Extended. DNS should answer endpoint and wildcard queries for the cluster [Conformance] #15630

New issue
New issue
Closed
Closed
Extended. DNS should answer endpoint and wildcard queries for the cluster [Conformance]#15630
Assignees
knobuncdcbw
Labels
area/testscomponent/networkingkind/test-flakeCategorizes issue or PR as related to test flakes.priority/P1sig/continuous-infrastructure
@ingvagabund

Description

@ingvagabund
ingvagabund
opened on Aug 4, 2017

The test is failing when running e2e extended conformance tests over system container based deployment. The Jenkins Job producing the failures at https://ci.openshift.redhat.com/jenkins/job/test_pull_request_openshift_ansible_extended_conformance_install_system_containers/31/consoleFull (the job will get deleted eventually):

DNS 
  should answer endpoint and wildcard queries for the cluster [Conformance]
  /go/src/github.com/openshift/origin/_output/local/go/src/github.com/openshift/origin/test/extended/dns/dns.go:378

[BeforeEach] [Top Level]
  /go/src/github.com/openshift/origin/_output/local/go/src/github.com/openshift/origin/test/extended/util/test.go:52
[BeforeEach] DNS
  /go/src/github.com/openshift/origin/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:130
STEP: Creating a kubernetes client
Aug  3 04:23:24.661: INFO: >>> kubeConfig: /etc/origin/master/admin.kubeconfig
STEP: Building a namespace api object
STEP: Waiting for a default service account to be provisioned in namespace
[It] should answer endpoint and wildcard queries for the cluster [Conformance]
  /go/src/github.com/openshift/origin/_output/local/go/src/github.com/openshift/origin/test/extended/dns/dns.go:378
STEP: Running these commands:for i in `seq 1 10`; do test -n "$$(dig +notcp +noall +answer +search prefix.kubernetes.default A)" && echo "test_udp@prefix.kubernetes.default";test -n "$$(dig +tcp +noall +answer +search prefix.kubernetes.default A)" && echo "test_tcp@prefix.kubernetes.default";test -n "$$(dig +notcp +noall +answer +search prefix.kubernetes.default.svc A)" && echo "test_udp@prefix.kubernetes.default.svc";test -n "$$(dig +tcp +noall +answer +search prefix.kubernetes.default.svc A)" && echo "test_tcp@prefix.kubernetes.default.svc";test -n "$$(dig +notcp +noall +answer +search prefix.kubernetes.default.svc.cluster.local A)" && echo "test_udp@prefix.kubernetes.default.svc.cluster.local";test -n "$$(dig +tcp +noall +answer +search prefix.kubernetes.default.svc.cluster.local A)" && echo "test_tcp@prefix.kubernetes.default.svc.cluster.local";test -n "$$(dig +notcp +noall +answer +search prefix.clusterip.e2e-tests-dns-31d7m A)" && echo "test_udp@prefix.clusterip.e2e-tests-dns-31d7m";test -n "$$(dig +tcp +noall +answer +search prefix.clusterip.e2e-tests-dns-31d7m A)" && echo "test_tcp@prefix.clusterip.e2e-tests-dns-31d7m"; test -n "$$(dig +notcp +noall +additional +search _http._tcp.externalname.e2e-tests-dns-31d7m.svc SRV)" && echo "test_udp@_http._tcp.externalname.e2e-tests-dns-31d7m.svc";test -n "$$(dig +tcp +noall +additional +search _http._tcp.externalname.e2e-tests-dns-31d7m.svc SRV)" && echo "test_tcp@_http._tcp.externalname.e2e-tests-dns-31d7m.svc"; test -n "$$(dig +notcp +noall +answer +search externalname.e2e-tests-dns-31d7m.svc CNAME)" && echo "test_udp@externalname.e2e-tests-dns-31d7m.svc";test -n "$$(dig +tcp +noall +answer +search externalname.e2e-tests-dns-31d7m.svc CNAME)" && echo "test_tcp@externalname.e2e-tests-dns-31d7m.svc"; [ "$$(dig +short +notcp +noall +answer +search headless.e2e-tests-dns-31d7m.endpoints A | sort | xargs echo)" = "1.1.1.1 1.1.1.2" ] && echo "test_endpoints@headless.e2e-tests-dns-31d7m.endpoints";[ "$$(dig +short +notcp +noall +answer +search clusterip.e2e-tests-dns-31d7m.endpoints A | sort | xargs echo)" = "1.1.1.1 1.1.1.2" ] && echo "test_endpoints@clusterip.e2e-tests-dns-31d7m.endpoints";[ "$$(dig +short +notcp +noall +answer +search endpoint1.headless.e2e-tests-dns-31d7m.endpoints A | sort | xargs echo)" = "1.1.1.1" ] && echo "test_endpoints@endpoint1.headless.e2e-tests-dns-31d7m.endpoints";[ "$$(dig +short +notcp +noall +answer +search endpoint1.clusterip.e2e-tests-dns-31d7m.endpoints A | sort | xargs echo)" = "1.1.1.1" ] && echo "test_endpoints@endpoint1.clusterip.e2e-tests-dns-31d7m.endpoints";[ "$$(dig +short +notcp +noall +answer +search kubernetes.default.endpoints A | sort | xargs echo)" = "172.18.2.135" ] && echo "test_endpoints@kubernetes.default.endpoints";[ "$$(dig +short +notcp +noall +answer +search headless.e2e-tests-dns-31d7m.svc A | sort | xargs echo)" = "1.1.1.1 1.1.1.2" ] && echo "test_endpoints@headless.e2e-tests-dns-31d7m.svc"; [ "$(dig +short +notcp +noall +answer +search 2.1.1.1.in-addr.arpa PTR)" = "" ] && echo "test_ptr@1.1.1.2";[ "$(dig +short +notcp +noall +answer +search 1.1.1.2.in-addr.arpa PTR)" = "" ] && echo "test_ptr@2.1.1.1";[ "$(dig +short +notcp +noall +answer +search 1.1.1.1.in-addr.arpa PTR)" = "endpoint1.headless.e2e-tests-dns-31d7m.svc.cluster.local." ] && echo "test_ptr@1.1.1.1"; podARec=$$(hostname -i| awk -F. '{print $$1"-"$$2"-"$$3"-"$$4".e2e-tests-dns-31d7m.pod.cluster.local"}');test -n "$$(dig +notcp +noall +answer +search $${podARec} A)" && echo "test_udp@PodARecord";test -n "$$(dig +tcp +noall +answer +search $${podARec} A)" && echo "test_tcp@PodARecord";sleep 1; done

STEP: creating a pod to probe DNS
STEP: submitting the pod to kubernetes
STEP: retrieving the pod logs
STEP: looking for the results for each expected name from probiers
Aug  3 04:23:40.074: INFO: Got results from pod:
test_udp@prefix.kubernetes.default
test_udp@prefix.kubernetes.default.svc
test_udp@prefix.kubernetes.default.svc.cluster.local
test_tcp@prefix.kubernetes.default.svc.cluster.local
test_udp@prefix.clusterip.e2e-tests-dns-31d7m
test_udp@_http._tcp.externalname.e2e-tests-dns-31d7m.svc
test_udp@externalname.e2e-tests-dns-31d7m.svc
test_endpoints@headless.e2e-tests-dns-31d7m.endpoints
test_endpoints@clusterip.e2e-tests-dns-31d7m.endpoints
test_endpoints@endpoint1.headless.e2e-tests-dns-31d7m.endpoints
test_endpoints@endpoint1.clusterip.e2e-tests-dns-31d7m.endpoints
test_endpoints@kubernetes.default.endpoints
test_endpoints@headless.e2e-tests-dns-31d7m.svc
test_ptr@1.1.1.2
test_ptr@2.1.1.1
test_udp@PodARecord
test_udp@prefix.kubernetes.default
test_udp@prefix.kubernetes.default.svc
test_udp@prefix.kubernetes.default.svc.cluster.local
test_tcp@prefix.kubernetes.default.svc.cluster.local
test_udp@prefix.clusterip.e2e-tests-dns-31d7m
test_udp@_http._tcp.externalname.e2e-tests-dns-31d7m.svc
test_udp@externalname.e2e-tests-dns-31d7m.svc
test_endpoints@headless.e2e-tests-dns-31d7m.endpoints
test_endpoints@clusterip.e2e-tests-dns-31d7m.endpoints
test_endpoints@endpoint1.headless.e2e-tests-dns-31d7m.endpoints
test_endpoints@endpoint1.clusterip.e2e-tests-dns-31d7m.endpoints
test_endpoints@kubernetes.default.endpoints
test_endpoints@headless.e2e-tests-dns-31d7m.svc
test_ptr@1.1.1.2
test_ptr@2.1.1.1
test_udp@PodARecord
test_udp@prefix.kubernetes.default
test_udp@prefix.kubernetes.default.svc
test_udp@prefix.kubernetes.default.svc.cluster.local
test_tcp@prefix.kubernetes.default.svc.cluster.local
test_udp@prefix.clusterip.e2e-tests-dns-31d7m
test_udp@_http._tcp.externalname.e2e-tests-dns-31d7m.svc
test_udp@externalname.e2e-tests-dns-31d7m.svc
test_endpoints@headless.e2e-tests-dns-31d7m.endpoints
test_endpoints@clusterip.e2e-tests-dns-31d7m.endpoints
test_endpoints@endpoint1.headless.e2e-tests-dns-31d7m.endpoints
test_endpoints@endpoint1.clusterip.e2e-tests-dns-31d7m.endpoints
test_endpoints@kubernetes.default.endpoints
test_endpoints@headless.e2e-tests-dns-31d7m.svc
test_ptr@1.1.1.2
test_ptr@2.1.1.1
test_udp@PodARecord
test_udp@prefix.kubernetes.default
test_udp@prefix.kubernetes.default.svc
test_udp@prefix.kubernetes.default.svc.cluster.local
test_tcp@prefix.kubernetes.default.svc.cluster.local
test_udp@prefix.clusterip.e2e-tests-dns-31d7m
test_udp@_http._tcp.externalname.e2e-tests-dns-31d7m.svc
test_udp@externalname.e2e-tests-dns-31d7m.svc
test_endpoints@headless.e2e-tests-dns-31d7m.endpoints
test_endpoints@clusterip.e2e-tests-dns-31d7m.endpoints
test_endpoints@endpoint1.headless.e2e-tests-dns-31d7m.endpoints
test_endpoints@endpoint1.clusterip.e2e-tests-dns-31d7m.endpoints
test_endpoints@kubernetes.default.endpoints
test_endpoints@headless.e2e-tests-dns-31d7m.svc
test_ptr@1.1.1.2
test_ptr@2.1.1.1
test_udp@PodARecord
test_udp@prefix.kubernetes.default
test_udp@prefix.kubernetes.default.svc
test_udp@prefix.kubernetes.default.svc.cluster.local
test_tcp@prefix.kubernetes.default.svc.cluster.local
test_udp@prefix.clusterip.e2e-tests-dns-31d7m
test_udp@_http._tcp.externalname.e2e-tests-dns-31d7m.svc
test_udp@externalname.e2e-tests-dns-31d7m.svc
test_endpoints@headless.e2e-tests-dns-31d7m.endpoints
test_endpoints@clusterip.e2e-tests-dns-31d7m.endpoints
test_endpoints@endpoint1.headless.e2e-tests-dns-31d7m.endpoints
test_endpoints@endpoint1.clusterip.e2e-tests-dns-31d7m.endpoints
test_endpoints@kubernetes.default.endpoints
test_endpoints@headless.e2e-tests-dns-31d7m.svc
test_ptr@1.1.1.2
test_ptr@2.1.1.1
test_udp@PodARecord
test_udp@prefix.kubernetes.default
test_udp@prefix.kubernetes.default.svc
test_udp@prefix.kubernetes.default.svc.cluster.local
test_tcp@prefix.kubernetes.default.svc.cluster.local
test_udp@prefix.clusterip.e2e-tests-dns-31d7m
test_udp@_http._tcp.externalname.e2e-tests-dns-31d7m.svc
test_udp@externalname.e2e-tests-dns-31d7m.svc
test_endpoints@headless.e2e-tests-dns-31d7m.endpoints
test_endpoints@clusterip.e2e-tests-dns-31d7m.endpoints
test_endpoints@endpoint1.headless.e2e-tests-dns-31d7m.endpoints
test_endpoints@endpoint1.clusterip.e2e-tests-dns-31d7m.endpoints
test_endpoints@kubernetes.default.endpoints
test_endpoints@headless.e2e-tests-dns-31d7m.svc
test_ptr@1.1.1.2
test_ptr@2.1.1.1
test_udp@PodARecord
test_udp@prefix.kubernetes.default
test_udp@prefix.kubernetes.default.svc
test_udp@prefix.kubernetes.default.svc.cluster.local
test_tcp@prefix.kubernetes.default.svc.cluster.local
test_udp@prefix.clusterip.e2e-tests-dns-31d7m
test_udp@_http._tcp.externalname.e2e-tests-dns-31d7m.svc
test_udp@externalname.e2e-tests-dns-31d7m.svc
test_endpoints@headless.e2e-tests-dns-31d7m.endpoints
test_endpoints@clusterip.e2e-tests-dns-31d7m.endpoints
test_endpoints@endpoint1.headless.e2e-tests-dns-31d7m.endpoints
test_endpoints@endpoint1.clusterip.e2e-tests-dns-31d7m.endpoints
test_endpoints@kubernetes.default.endpoints
test_endpoints@headless.e2e-tests-dns-31d7m.svc
test_ptr@1.1.1.2
test_ptr@2.1.1.1
test_udp@PodARecord
test_udp@prefix.kubernetes.default
test_udp@prefix.kubernetes.default.svc
test_udp@prefix.kubernetes.default.svc.cluster.local
test_tcp@prefix.kubernetes.default.svc.cluster.local
test_udp@prefix.clusterip.e2e-tests-dns-31d7m
test_udp@_http._tcp.externalname.e2e-tests-dns-31d7m.svc
test_udp@externalname.e2e-tests-dns-31d7m.svc
test_endpoints@headless.e2e-tests-dns-31d7m.endpoints
test_endpoints@clusterip.e2e-tests-dns-31d7m.endpoints
test_endpoints@endpoint1.headless.e2e-tests-dns-31d7m.endpoints
test_endpoints@endpoint1.clusterip.e2e-tests-dns-31d7m.endpoints
test_endpoints@kubernetes.default.endpoints
test_endpoints@headless.e2e-tests-dns-31d7m.svc
test_ptr@1.1.1.2
test_ptr@2.1.1.1
test_udp@PodARecord
test_udp@prefix.kubernetes.default
test_udp@prefix.kubernetes.default.svc
test_udp@prefix.kubernetes.default.svc.cluster.local
test_tcp@prefix.kubernetes.default.svc.cluster.local
test_udp@prefix.clusterip.e2e-tests-dns-31d7m
test_udp@_http._tcp.externalname.e2e-tests-dns-31d7m.svc
test_udp@externalname.e2e-tests-dns-31d7m.svc
test_endpoints@headless.e2e-tests-dns-31d7m.endpoints
test_endpoints@clusterip.e2e-tests-dns-31d7m.endpoints
test_endpoints@endpoint1.headless.e2e-tests-dns-31d7m.endpoints
test_endpoints@endpoint1.clusterip.e2e-tests-dns-31d7m.endpoints
test_endpoints@kubernetes.default.endpoints
test_endpoints@headless.e2e-tests-dns-31d7m.svc
test_ptr@1.1.1.2
test_ptr@2.1.1.1
test_udp@PodARecord
test_udp@prefix.kubernetes.default
test_udp@prefix.kubernetes.default.svc
test_udp@prefix.kubernetes.default.svc.cluster.local
test_tcp@prefix.kubernetes.default.svc.cluster.local
test_udp@prefix.clusterip.e2e-tests-dns-31d7m
test_udp@_http._tcp.externalname.e2e-tests-dns-31d7m.svc
test_udp@externalname.e2e-tests-dns-31d7m.svc
test_endpoints@headless.e2e-tests-dns-31d7m.endpoints
test_endpoints@clusterip.e2e-tests-dns-31d7m.endpoints
test_endpoints@endpoint1.headless.e2e-tests-dns-31d7m.endpoints
test_endpoints@endpoint1.clusterip.e2e-tests-dns-31d7m.endpoints
test_endpoints@kubernetes.default.endpoints
test_endpoints@headless.e2e-tests-dns-31d7m.svc
test_ptr@1.1.1.2
test_ptr@2.1.1.1
test_udp@PodARecord

Aug  3 04:23:40.074: INFO: Unexpected results: unexpected count 0/10 for "test_tcp@externalname.e2e-tests-dns-31d7m.svc": map[]
STEP: deleting the pod
[AfterEach] DNS
  /go/src/github.com/openshift/origin/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:131
STEP: Collecting events from namespace "e2e-tests-dns-31d7m".
STEP: Found 5 events.
Aug  3 04:23:40.086: INFO: At 2017-08-03 04:23:24 -0400 EDT - event for dns-test-04cfbb38-7825-11e7-96dc-0e3e3be55932: {default-scheduler } Scheduled: Successfully assigned dns-test-04cfbb38-7825-11e7-96dc-0e3e3be55932 to ip-172-18-2-135.ec2.internal
Aug  3 04:23:40.086: INFO: At 2017-08-03 04:23:25 -0400 EDT - event for dns-test-04cfbb38-7825-11e7-96dc-0e3e3be55932: {kubelet ip-172-18-2-135.ec2.internal} SuccessfulMountVolume: MountVolume.SetUp succeeded for volume "default-token-nt2gg" 
Aug  3 04:23:40.086: INFO: At 2017-08-03 04:23:26 -0400 EDT - event for dns-test-04cfbb38-7825-11e7-96dc-0e3e3be55932: {kubelet ip-172-18-2-135.ec2.internal} Pulled: Container image "gcr.io/google_containers/dnsutils:e2e" already present on machine
Aug  3 04:23:40.086: INFO: At 2017-08-03 04:23:27 -0400 EDT - event for dns-test-04cfbb38-7825-11e7-96dc-0e3e3be55932: {kubelet ip-172-18-2-135.ec2.internal} Created: Created container
Aug  3 04:23:40.086: INFO: At 2017-08-03 04:23:27 -0400 EDT - event for dns-test-04cfbb38-7825-11e7-96dc-0e3e3be55932: {kubelet ip-172-18-2-135.ec2.internal} Started: Started container
Aug  3 04:23:40.093: INFO: POD                                            NODE                          PHASE    GRACE  CONDITIONS
Aug  3 04:23:40.093: INFO: docker-registry-1-d3t61                        ip-172-18-2-135.ec2.internal  Running         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:10:06 -0400 EDT  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:17:05 -0400 EDT  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:10:06 -0400 EDT  }]
Aug  3 04:23:40.093: INFO: registry-console-1-52065                       ip-172-18-2-135.ec2.internal  Running         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:10:27 -0400 EDT  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:17:00 -0400 EDT  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:10:27 -0400 EDT  }]
Aug  3 04:23:40.093: INFO: router-1-sc0jx                                 ip-172-18-2-135.ec2.internal  Running         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:09:22 -0400 EDT  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:17:09 -0400 EDT  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:09:22 -0400 EDT  }]
Aug  3 04:23:40.093: INFO: dns-test-7cc04317-7824-11e7-98b3-0e3e3be55932  ip-172-18-2-135.ec2.internal  Running         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:19:37 -0400 EDT  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:20:00 -0400 EDT  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:19:36 -0400 EDT  }]
Aug  3 04:23:40.093: INFO: redis-master-28p94                             ip-172-18-2-135.ec2.internal  Pending         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:23:37 -0400 EDT  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:23:37 -0400 EDT ContainersNotReady containers with unready status: [redis-master]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:23:37 -0400 EDT  }]
Aug  3 04:23:40.093: INFO: ss2-0                                          ip-172-18-2-135.ec2.internal  Running         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:23:11 -0400 EDT  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:23:19 -0400 EDT  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:23:11 -0400 EDT  }]
Aug  3 04:23:40.093: INFO: ss2-1                                          ip-172-18-2-135.ec2.internal  Running         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:22:55 -0400 EDT  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:23:05 -0400 EDT  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:22:55 -0400 EDT  }]
Aug  3 04:23:40.093: INFO: ss2-2                                          ip-172-18-2-135.ec2.internal  Running         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:22:45 -0400 EDT  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:22:53 -0400 EDT  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:22:45 -0400 EDT  }]
Aug  3 04:23:40.093: INFO: history-limit-4-jcnsf                          ip-172-18-2-135.ec2.internal  Running  30s    [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:22:47 -0400 EDT  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:23:35 -0400 EDT ContainersNotReady containers with unready status: [myapp]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:22:47 -0400 EDT  }]
Aug  3 04:23:40.093: INFO: history-limit-5-v8kr8                          ip-172-18-2-135.ec2.internal  Running  30s    [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:22:58 -0400 EDT  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:23:03 -0400 EDT  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:22:58 -0400 EDT  }]
Aug  3 04:23:40.093: INFO: history-limit-6-fgwz7                          ip-172-18-2-135.ec2.internal  Running  30s    [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:23:12 -0400 EDT  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:23:17 -0400 EDT  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:23:12 -0400 EDT  }]
Aug  3 04:23:40.093: INFO: history-limit-7-vj1f0                          ip-172-18-2-135.ec2.internal  Running  30s    [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:23:27 -0400 EDT  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:23:29 -0400 EDT  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:23:27 -0400 EDT  }]
Aug  3 04:23:40.093: INFO: history-limit-8-0xgjw                          ip-172-18-2-135.ec2.internal  Running         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:23:36 -0400 EDT  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:23:38 -0400 EDT  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:23:36 -0400 EDT  }]
Aug  3 04:23:40.093: INFO: history-limit-8-deploy                         ip-172-18-2-135.ec2.internal  Running         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:23:32 -0400 EDT  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:23:35 -0400 EDT  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:23:32 -0400 EDT  }]
Aug  3 04:23:40.093: INFO: 
Aug  3 04:23:40.097: INFO: 
Logging node info for node ip-172-18-2-135.ec2.internal
Aug  3 04:23:40.114: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:ip-172-18-2-135.ec2.internal,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/ip-172-18-2-135.ec2.internal,UID:c0973c6c-7822-11e7-8b36-0e3e3be55932,ResourceVersion:6690,Generation:0,CreationTimestamp:2017-08-03 04:07:11 -0400 EDT,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/os: linux,kubernetes.io/hostname: ip-172-18-2-135.ec2.internal,region: infra,zone: default,},Annotations:map[string]string{volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,},Spec:NodeSpec{PodCIDR:,ExternalID:ip-172-18-2-135.ec2.internal,ProviderID:aws:////i-0762c70264ba973bb,Unschedulable:false,Taints:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{4 0} {<nil>} 4 DecimalSI},memory: {{16388919296 0} {<nil>} 16004804Ki BinarySI},pods: {{40 0} {<nil>} 40 DecimalSI},},Allocatable:ResourceList{cpu: {{4 0} {<nil>} 4 DecimalSI},memory: {{16284061696 0} {<nil>} 15902404Ki BinarySI},pods: {{40 0} {<nil>} 40 DecimalSI},},Phase:,Conditions:[{OutOfDisk False 2017-08-03 04:23:30 -0400 EDT 2017-08-03 04:07:11 -0400 EDT KubeletHasSufficientDisk kubelet has sufficient disk space available} {MemoryPressure False 2017-08-03 04:23:30 -0400 EDT 2017-08-03 04:07:11 -0400 EDT KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2017-08-03 04:23:30 -0400 EDT 2017-08-03 04:07:11 -0400 EDT KubeletHasNoDiskPressure kubelet has no disk pressure} {Ready True 2017-08-03 04:23:30 -0400 EDT 2017-08-03 04:17:05 -0400 EDT KubeletReady kubelet is posting ready status}],Addresses:[{InternalIP 172.18.2.135} {Hostname ip-172-18-2-135.ec2.internal}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f9370ed252a14f73b014c1301a9b6d1b,SystemUUID:EC2F4FBB-3BAF-A110-30DE-33DED71B4EDD,BootID:8cf24619-f718-4393-9f04-020003d2a5e4,KernelVersion:3.10.0-514.26.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://1.12.6,KubeletVersion:v1.7.0+695f48a16f,KubeProxyVersion:v1.7.0+695f48a16f,OperatingSystem:linux,Architecture:amd64,},Images:[{[openshift/origin-federation:latest openshift/origin-federation:v3.6.0-rc.0] 1269982240} {[openshift/openvswitch:latest openshift/openvswitch:v3.6.0-rc.0] 1232140489} {[openshift/node:latest openshift/node:v3.6.0-rc.0] 1230458678} {[openshift/origin-docker-registry:latest openshift/origin-docker-registry:v3.6.0-rc.0] 1132989947} {[openshift/origin-gitserver:latest openshift/origin-gitserver:v3.6.0-rc.0] 1119865414} {[openshift/origin-keepalived-ipfailover:latest openshift/origin-keepalived-ipfailover:v3.6.0-rc.0] 1075578822} {[openshift/origin-haproxy-router:latest openshift/origin-haproxy-router:v3.6.0-rc.0] 1069814043} {[openshift/origin-service-catalog:latest openshift/origin-service-catalog:v3.6.0-rc.0] 1062742565} {[openshift/origin-deployer:latest openshift/origin-deployer:v3.6.0-rc.0] 1048789100} {[openshift/origin-recycler:latest openshift/origin-recycler:v3.6.0-rc.0] 1048789100} {[openshift/origin-sti-builder:latest openshift/origin-sti-builder:v3.6.0-rc.0] 1048789100} {[openshift/origin-docker-builder:latest openshift/origin-docker-builder:v3.6.0-rc.0] 1048789100} {[openshift/origin-f5-router:latest openshift/origin-f5-router:v3.6.0-rc.0] 1048789100} {[openshift/origin:latest openshift/origin:v3.6.0-rc.0] 1048789100} {[openshift/origin-cluster-capacity:latest openshift/origin-cluster-capacity:v3.6.0-rc.0] 1002533207} {[docker.io/openshift/origin@sha256:fe7d5b3244f0e7fe83b8742947fa6dc091dd278c248fe1db87a6508a3861f00e docker.io/openshift/origin:v3.6.0-rc.0] 974057765} {[docker.io/openshift/origin-release@sha256:d03fa29a86385176442f712e8f1e85763f930e076657cf285586fadf62249d7a docker.io/openshift/origin-release:golang-1.8] 889401157} {[docker.io/openshift/origin-release@sha256:e7830c1917b24cd07897d69044d0a831d32563daeed2e5ef8260e080e841ba63] 888265752} {[docker.io/openshift/origin-release@sha256:28ba70dba48e007062d84740596478a34db8ba933955cd7fbd2fe4cb631fb8fe docker.io/openshift/origin-release:golang-1.7] 861320249} {[docker.io/openshift/origin-gce@sha256:409e2746c9e376c304ebe64928926f916e8d2b54e9c63630bbb598a9bc9857fb docker.io/openshift/origin-gce:latest] 779683339} {[docker-registry.default.svc:5000/extended-test-build-valuefrom-j74nq-g6qtg/test@sha256:e5ef6dc87227dd06631d823925ede3d56671478152f504a9f5577cd532c1388b docker-registry.default.svc:5000/extended-test-build-valuefrom-j74nq-g6qtg/test:latest] 539238390} {[docker.io/centos/s2i-base-centos7@sha256:78383cd807c6f700bc0c1310d06acd986d15288c80ffa735eecff346d85d4423 docker.io/centos/s2i-base-centos7:latest] 429895545} {[docker.io/cockpit/kubernetes@sha256:c5f076d8317ff1f9c77352f1b4e128662b9567dbf29941df3093e876b06f5d07 docker.io/cockpit/kubernetes:latest] 407281755} {[openshift/origin-egress-http-proxy:latest openshift/origin-egress-http-proxy:v3.6.0-rc.0] 395971365} {[openshift/origin-egress-router:latest openshift/origin-egress-router:v3.6.0-rc.0] 364719653} {[openshift/origin-base:8ef052d openshift/origin-base:latest] 363043407} {[openshift/origin-pod:latest openshift/origin-pod:v3.6.0-rc.0] 213205928} {[openshift/origin-source:8ef052d openshift/origin-source:latest] 192530021} {[docker.io/centos@sha256:c1010e2fe2b635822d99a096b1f4184becf5d1c98707cbccae00be663a9b9131 docker.io/centos:7] 192529651} {[gcr.io/google_containers/jessie-dnsutils@sha256:2460d596912244b5f8973573f7150e7264b570015f4becc2d0096f0bd1d17e36 gcr.io/google_containers/jessie-dnsutils:e2e] 190122856} {[gcr.io/google_containers/nginx-slim@sha256:8b4501fe0fe221df663c22e16539f399e89594552f400408303c42f3dd8d0e52 gcr.io/google_containers/nginx-slim:0.8] 110461313} {[gcr.io/google_containers/nginx-slim@sha256:dd4efd4c13bec2c6f3fe855deeab9524efe434505568421d4f31820485b3a795 gcr.io/google_containers/nginx-slim:0.7] 86838142} {[gcr.io/google_containers/hostexec@sha256:cab8d4e2526f8f767c64febe4ce9e0f0e58cd35fdff81b3aadba4dd041ba9f00 gcr.io/google_containers/hostexec:1.2] 13185747} {[gcr.io/google_containers/dnsutils@sha256:cd9182f6d74e616942db1cef6f25e1e54b49ba0330c2e19d3ec061f027666cc0 gcr.io/google_containers/dnsutils:e2e] 8893907} {[docker.io/openshift/hello-openshift@sha256:a6b8e48ec0d1c06ccd3d3176aac271af0e4ab92139a6658b3af5fcb9c3a2b77c docker.io/openshift/hello-openshift:latest] 5840109} {[openshift/hello-openshift:latest openshift/hello-openshift:v3.6.0-rc.0] 5840109} {[gcr.io/google_containers/update-demo@sha256:89ac104fa7c43880d2324f377b79be95b0b2b3fb32e4bd03b8d1e6d91a41f009 gcr.io/google_containers/update-demo:nautilus] 4555533} {[gcr.io/google_containers/test-webserver@sha256:f804e8837490d1dfdb5002e073f715fd0a08115de74e5a4847ca952315739372 gcr.io/google_containers/test-webserver:e2e] 4534272} {[docker.io/alpine@sha256:1072e499f3f655a032e88542330cf75b02e7bdf673278f701d7ba61629ee3ebe docker.io/alpine:3.6] 3961627} {[gcr.io/google_containers/eptest@sha256:bb088b26ed78613cce171420168db9a6c62a8dbea17d7be13077e7010bae162f gcr.io/google_containers/eptest:0.1] 2970692} {[gcr.io/google_containers/mounttest@sha256:c4dcedb26013ab4231a2b2aaa4eebd5c2a44d5c597fa0613c9ff8bde4fb9fe02 gcr.io/google_containers/mounttest:0.7] 2052704} {[gcr.io/google_containers/mounttest@sha256:bec3122ddcf8bd999e44e46e096659f31241d09f5236bc3dc212ea584ca06856 gcr.io/google_containers/mounttest:0.8] 1450761} {[gcr.io/google_containers/mounttest-user@sha256:5487c126b03abf4119a8f7950cd5f591f72dbe4ab15623f3387d3917e1268b4e gcr.io/google_containers/mounttest-user:0.5] 1450761} {[docker.io/busybox@sha256:2605a2c4875ce5eb27a9f7403263190cd1af31e48a2044d400320548356251c4] 1129193} {[gcr.io/google_containers/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff gcr.io/google_containers/busybox:1.24] 1113554} {[docker.io/busybox@sha256:29f5d56d12684887bdfa50dcd29fc31eea4aaf4ad3bec43daf19026a7ce69912] 1093484} {[gcr.io/google_containers/pause-amd64@sha256:163ac025575b775d1c0f9bf0bdd0f086883171eb475b5068e7defa4ca9e76516 gcr.io/google_containers/pause-amd64:3.0] 746888}],VolumesInUse:[],VolumesAttached:[],},}
Aug  3 04:23:40.114: INFO: 
Logging kubelet events for node ip-172-18-2-135.ec2.internal
Aug  3 04:23:40.117: INFO: 
Logging pods the kubelet thinks is on node ip-172-18-2-135.ec2.internal
Aug  3 04:23:40.142: INFO: history-limit-5-v8kr8 started at 2017-08-03 04:22:58 -0400 EDT (0+1 container statuses recorded)
Aug  3 04:23:40.142: INFO: 	Container myapp ready: true, restart count 0
Aug  3 04:23:40.142: INFO: dns-test-7cc04317-7824-11e7-98b3-0e3e3be55932 started at 2017-08-03 04:19:37 -0400 EDT (0+3 container statuses recorded)
Aug  3 04:23:40.142: INFO: 	Container jessie-querier ready: true, restart count 0
Aug  3 04:23:40.142: INFO: 	Container querier ready: true, restart count 0
Aug  3 04:23:40.142: INFO: 	Container webserver ready: true, restart count 0
Aug  3 04:23:40.142: INFO: registry-console-1-52065 started at 2017-08-03 04:10:27 -0400 EDT (0+1 container statuses recorded)
Aug  3 04:23:40.142: INFO: 	Container registry-console ready: true, restart count 0
Aug  3 04:23:40.142: INFO: ss2-1 started at 2017-08-03 04:22:55 -0400 EDT (0+1 container statuses recorded)
Aug  3 04:23:40.142: INFO: 	Container nginx ready: true, restart count 0
Aug  3 04:23:40.142: INFO: history-limit-6-fgwz7 started at 2017-08-03 04:23:12 -0400 EDT (0+1 container statuses recorded)
Aug  3 04:23:40.142: INFO: 	Container myapp ready: true, restart count 0
Aug  3 04:23:40.142: INFO: history-limit-7-vj1f0 started at 2017-08-03 04:23:27 -0400 EDT (0+1 container statuses recorded)
Aug  3 04:23:40.142: INFO: 	Container myapp ready: true, restart count 0
Aug  3 04:23:40.142: INFO: redis-master-28p94 started at 2017-08-03 04:23:37 -0400 EDT (0+1 container statuses recorded)
Aug  3 04:23:40.142: INFO: 	Container redis-master ready: false, restart count 0
Aug  3 04:23:40.142: INFO: router-1-sc0jx started at 2017-08-03 04:09:22 -0400 EDT (0+1 container statuses recorded)
Aug  3 04:23:40.142: INFO: 	Container router ready: true, restart count 0
Aug  3 04:23:40.142: INFO: docker-registry-1-d3t61 started at 2017-08-03 04:10:06 -0400 EDT (0+1 container statuses recorded)
Aug  3 04:23:40.142: INFO: 	Container registry ready: true, restart count 0
Aug  3 04:23:40.142: INFO: ss2-2 started at 2017-08-03 04:22:45 -0400 EDT (0+1 container statuses recorded)
Aug  3 04:23:40.142: INFO: 	Container nginx ready: true, restart count 0
Aug  3 04:23:40.142: INFO: ss2-0 started at 2017-08-03 04:23:11 -0400 EDT (0+1 container statuses recorded)
Aug  3 04:23:40.142: INFO: 	Container nginx ready: true, restart count 0
Aug  3 04:23:40.142: INFO: history-limit-4-jcnsf started at 2017-08-03 04:22:47 -0400 EDT (0+1 container statuses recorded)
Aug  3 04:23:40.142: INFO: 	Container myapp ready: false, restart count 0
Aug  3 04:23:40.142: INFO: history-limit-8-deploy started at 2017-08-03 04:23:32 -0400 EDT (0+1 container statuses recorded)
Aug  3 04:23:40.142: INFO: 	Container deployment ready: true, restart count 0
Aug  3 04:23:40.142: INFO: history-limit-8-0xgjw started at 2017-08-03 04:23:36 -0400 EDT (0+1 container statuses recorded)
Aug  3 04:23:40.142: INFO: 	Container myapp ready: true, restart count 0
W0803 04:23:40.147380   18660 metrics_grabber.go:74] Master node is not registered. Grabbing metrics from Scheduler and ControllerManager is disabled.
Aug  3 04:23:40.172: INFO: 
Latency metrics for node ip-172-18-2-135.ec2.internal
Aug  3 04:23:40.172: INFO: {Operation:stop_container Method:docker_operations_latency_microseconds Quantile:0.99 Latency:30.119313s}
Aug  3 04:23:40.172: INFO: {Operation:create Method:pod_worker_latency_microseconds Quantile:0.99 Latency:26.297801s}
Aug  3 04:23:40.172: INFO: {Operation:create Method:pod_worker_latency_microseconds Quantile:0.9 Latency:24.853288s}
Aug  3 04:23:40.172: INFO: {Operation: Method:pod_start_latency_microseconds Quantile:0.99 Latency:19.10043s}
Aug  3 04:23:40.172: INFO: {Operation:create Method:pod_worker_latency_microseconds Quantile:0.5 Latency:17.152724s}
Aug  3 04:23:40.172: INFO: {Operation:create_container Method:docker_operations_latency_microseconds Quantile:0.99 Latency:13.048422s}
STEP: Dumping a list of prepulled images on each node...
Aug  3 04:23:40.175: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "e2e-tests-dns-31d7m" for this suite.
Aug  3 04:23:48.220: INFO: namespace: e2e-tests-dns-31d7m, resource: bindings, ignored listing per whitelist
Aug  3 04:23:48.306: INFO: namespace e2e-tests-dns-31d7m deletion completed in 8.128657634s


• Failure [23.645 seconds]
DNS
/go/src/github.com/openshift/origin/_output/local/go/src/github.com/openshift/origin/test/extended/dns/dns.go:379
  should answer endpoint and wildcard queries for the cluster [Conformance] [It]
  /go/src/github.com/openshift/origin/_output/local/go/src/github.com/openshift/origin/test/extended/dns/dns.go:378

  Aug  3 04:23:40.074: Unexpected results: unexpected count 0/10 for "test_tcp@externalname.e2e-tests-dns-31d7m.svc": map[]

  /go/src/github.com/openshift/origin/_output/local/go/src/github.com/openshift/origin/test/extended/dns/dns.go:233

Metadata

Metadata

Assignees

Labels

area/testscomponent/networkingkind/test-flakeCategorizes issue or PR as related to test flakes.priority/P1sig/continuous-infrastructure

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions