{"action":"created","issue":{"url":"https://api.github.com/repos/istio/istio/issues/5778","repository_url":"https://api.github.com/repos/istio/istio","labels_url":"https://api.github.com/repos/istio/istio/issues/5778/labels{/name}","comments_url":"https://api.github.com/repos/istio/istio/issues/5778/comments","events_url":"https://api.github.com/repos/istio/istio/issues/5778/events","html_url":"https://github.com/istio/istio/issues/5778","id":325674684,"number":5778,"title":"404 NR with Istio 0.7.1","user":{"login":"nixgadget","id":2648624,"avatar_url":"https://avatars1.githubusercontent.com/u/2648624?v=4","gravatar_id":"","url":"https://api.github.com/users/nixgadget","html_url":"https://github.com/nixgadget","followers_url":"https://api.github.com/users/nixgadget/followers","following_url":"https://api.github.com/users/nixgadget/following{/other_user}","gists_url":"https://api.github.com/users/nixgadget/gists{/gist_id}","starred_url":"https://api.github.com/users/nixgadget/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/nixgadget/subscriptions","organizations_url":"https://api.github.com/users/nixgadget/orgs","repos_url":"https://api.github.com/users/nixgadget/repos","events_url":"https://api.github.com/users/nixgadget/events{/privacy}","received_events_url":"https://api.github.com/users/nixgadget/received_events","type":"User","site_admin":false},"labels":[{"id":735781806,"url":"https://api.github.com/repos/istio/istio/labels/area/networking","name":"area/networking","color":"0e8a16","default":false}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":1,"created_at":"2018-05-23T12:04:35Z","updated_at":"2018-05-25T03:59:38Z","closed_at":null,"author_association":"NONE","body":"istio 0.7.1\r\nGKE 1.9.7-gke.1\r\nmTLS: Disabled\r\n\r\nWith 0.7.1 we are currently unable to get service-to-service traffic going. Keep getting `404 NR` errors.\r\n\r\nA typical error on the sending microservice proxy is,\r\n```\r\n[2018-05-23T11:56:37.470Z] \"GET /management/health HTTP/1.1\" 200 - 0 103 67 3 \"-\" \"kube-probe/1.9+\" \"5bdd5af0-7ce5-9b5f-9004-bc762239b205\" \"10.4.8.63:9079\" \"127.0.0.1:9079\"\r\n[2018-05-23T11:56:38.673Z] \"GET /management/health HTTP/1.1\" 200 - 0 103 66 4 \"-\" \"kube-probe/1.9+\" \"1ff6689c-abc4-9b64-bd6e-554a35eefa40\" \"10.4.8.63:9079\" \"127.0.0.1:9079\"\r\n[2018-05-23T11:56:39.633Z] \"POST /co.riro.authorizationservice.IdentityManagementService/registerUserIdentity HTTP/2\" 404 NR 0 0 0 - \"-\" \"grpc-java-netty/1.10.0\" \"3e155d7e-e8bf-941b-ab3c-68af8b10b7dc\" \"t-auth\" \"-\"\r\n```\r\n\r\nAnd in the sending microservice application we would also see,\r\n```\r\nCaused by: io.grpc.StatusRuntimeException: UNIMPLEMENTED: HTTP status code 404\r\ninvalid content-type: null\r\ntrailers: Metadata(:status=404,date=Wed, 23 May 2018 11:56:39 GMT,server=envoy)\r\n\tat io.grpc.stub.ClientCalls.toStatusRuntimeException(ClientCalls.java:221)\r\n\tat io.grpc.stub.ClientCalls.getUnchecked(ClientCalls.java:202)\r\n\tat io.grpc.stub.ClientCalls.blockingUnaryCall(ClientCalls.java:131)\r\n\tat authorizationservice.grpc.IdentityManagementServiceGrpc$IdentityManagementServiceBlockingStub.registerUserIdentity(IdentityManagementServiceGrpc.java:337)\r\n\tat onboardingservice.client.IdentityManagementServiceClient.registerUserIdentity(IdentityManagementServiceClient.java:44)\r\n\t... 84 common frames omitted\r\n```\r\n\r\nThese services can talk to each other outside the mesh.\r\n\r\nAny help would be good to diagnose this issue."},"comment":{"url":"https://api.github.com/repos/istio/istio/issues/comments/391934459","html_url":"https://github.com/istio/istio/issues/5778#issuecomment-391934459","issue_url":"https://api.github.com/repos/istio/istio/issues/5778","id":391934459,"user":{"login":"nixgadget","id":2648624,"avatar_url":"https://avatars1.githubusercontent.com/u/2648624?v=4","gravatar_id":"","url":"https://api.github.com/users/nixgadget","html_url":"https://github.com/nixgadget","followers_url":"https://api.github.com/users/nixgadget/followers","following_url":"https://api.github.com/users/nixgadget/following{/other_user}","gists_url":"https://api.github.com/users/nixgadget/gists{/gist_id}","starred_url":"https://api.github.com/users/nixgadget/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/nixgadget/subscriptions","organizations_url":"https://api.github.com/users/nixgadget/orgs","repos_url":"https://api.github.com/users/nixgadget/repos","events_url":"https://api.github.com/users/nixgadget/events{/privacy}","received_events_url":"https://api.github.com/users/nixgadget/received_events","type":"User","site_admin":false},"created_at":"2018-05-25T03:59:38Z","updated_at":"2018-05-25T03:59:38Z","author_association":"NONE","body":"@nrjpoddar I found a fix for the issue. It was due to the way i was creating the grpc channel.\r\nI was doing,\r\n```\r\nNettyChannelBuilder builder = NettyChannelBuilder.forTarget()\r\n                .nameResolverFactory(...)\r\n                .usePlaintext();\r\n``` \r\nI'm guessing `nameResolverFactory` doesnt work in the mesh for some reason.\r\nThis is completely fine outside the mesh."}}
{"actor":{"display_login":"nixgadget"}}