{"action":"created","issue":{"url":"https://api.github.com/repos/linkerd/linkerd2/issues/1288","repository_url":"https://api.github.com/repos/linkerd/linkerd2","labels_url":"https://api.github.com/repos/linkerd/linkerd2/issues/1288/labels{/name}","comments_url":"https://api.github.com/repos/linkerd/linkerd2/issues/1288/comments","events_url":"https://api.github.com/repos/linkerd/linkerd2/issues/1288/events","html_url":"https://github.com/linkerd/linkerd2/issues/1288","id":339056397,"node_id":"MDU6SXNzdWUzMzkwNTYzOTc=","number":1288,"title":"tap hangs indefinitely","user":{"login":"grampelberg","id":47992,"node_id":"MDQ6VXNlcjQ3OTky","avatar_url":"https://avatars0.githubusercontent.com/u/47992?v=4","gravatar_id":"","url":"https://api.github.com/users/grampelberg","html_url":"https://github.com/grampelberg","followers_url":"https://api.github.com/users/grampelberg/followers","following_url":"https://api.github.com/users/grampelberg/following{/other_user}","gists_url":"https://api.github.com/users/grampelberg/gists{/gist_id}","starred_url":"https://api.github.com/users/grampelberg/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/grampelberg/subscriptions","organizations_url":"https://api.github.com/users/grampelberg/orgs","repos_url":"https://api.github.com/users/grampelberg/repos","events_url":"https://api.github.com/users/grampelberg/events{/privacy}","received_events_url":"https://api.github.com/users/grampelberg/received_events","type":"User","site_admin":false},"labels":[{"id":779475981,"node_id":"MDU6TGFiZWw3Nzk0NzU5ODE=","url":"https://api.github.com/repos/linkerd/linkerd2/labels/area/cli","name":"area/cli","color":"0052CC","default":false},{"id":961555725,"node_id":"MDU6TGFiZWw5NjE1NTU3MjU=","url":"https://api.github.com/repos/linkerd/linkerd2/labels/bug","name":"bug","color":"cc0e1a","default":true},{"id":846634582,"node_id":"MDU6TGFiZWw4NDY2MzQ1ODI=","url":"https://api.github.com/repos/linkerd/linkerd2/labels/priority/P2","name":"priority/P2","color":"eeeeee","default":false}],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":{"url":"https://api.github.com/repos/linkerd/linkerd2/milestones/8","html_url":"https://github.com/linkerd/linkerd2/milestone/8","labels_url":"https://api.github.com/repos/linkerd/linkerd2/milestones/8/labels","id":3134349,"node_id":"MDk6TWlsZXN0b25lMzEzNDM0OQ==","number":8,"title":"Gibraltar","description":"Make it easy to debug common service problems (status, latency, throughput).\r\n","creator":{"login":"olix0r","id":240738,"node_id":"MDQ6VXNlcjI0MDczOA==","avatar_url":"https://avatars3.githubusercontent.com/u/240738?v=4","gravatar_id":"","url":"https://api.github.com/users/olix0r","html_url":"https://github.com/olix0r","followers_url":"https://api.github.com/users/olix0r/followers","following_url":"https://api.github.com/users/olix0r/following{/other_user}","gists_url":"https://api.github.com/users/olix0r/gists{/gist_id}","starred_url":"https://api.github.com/users/olix0r/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/olix0r/subscriptions","organizations_url":"https://api.github.com/users/olix0r/orgs","repos_url":"https://api.github.com/users/olix0r/repos","events_url":"https://api.github.com/users/olix0r/events{/privacy}","received_events_url":"https://api.github.com/users/olix0r/received_events","type":"User","site_admin":false},"open_issues":11,"closed_issues":31,"state":"open","created_at":"2018-02-21T19:37:42Z","updated_at":"2018-10-03T23:18:24Z","due_on":null,"closed_at":null},"comments":3,"created_at":"2018-07-06T20:04:44Z","updated_at":"2018-10-03T23:18:23Z","closed_at":"2018-10-03T23:18:23Z","author_association":"CONTRIBUTOR","body":"Client version: v0.5.0\r\nServer version: v0.5.0\r\n\r\nUsing emojivoto with 50 vote-bot pods (96 RPS), running tap with the following command repeatedly eventually gets to the state where tap is hanging indefinitely.\r\n\r\n```\r\n# conduit -n emojivoto tap deploy/web --max-rps 10 --verbose\r\nDEBU[0000] Expecting Conduit Public API to be served over [https://x.x.x.x/api/v1/namespaces/conduit/services/http:api:http/proxy/api/v1/]\r\n```\r\n\r\nNote: it appears that everything else is working fine, I can't find errors anywhere at least. Relaunching the target pod fixes the problem.\r\n\r\n## Logs:\r\n\r\n### controller/tap\r\n\r\n```\r\ntime=\"2018-07-06T20:00:56Z\" level=info msg=\"Tapping 1 pods for target: {Namespace:emojivoto Type:deployments Name:web}\"\r\ntime=\"2018-07-06T20:00:56Z\" level=info msg=\"Establishing tap on 10.4.1.35:4190\"\r\n```\r\n\r\n### web/conduit-proxy\r\n\r\n```\r\nINFO conduit_proxy using controller at Some(HostAndPort { host: DnsName(DnsName(DNSName(\"proxy-api.conduit.svc.cluster.local\"))), port: 8086 })\r\nINFO conduit_proxy routing on V4(127.0.0.1:4140)\r\nINFO conduit_proxy proxying on V4(0.0.0.0:4143) to None\r\nINFO conduit_proxy serving Prometheus metrics on V4(0.0.0.0:4191)\r\nINFO conduit_proxy protocol detection disabled for inbound ports {25, 3306}\r\nINFO conduit_proxy protocol detection disabled for outbound ports {25, 3306}\r\nINFO admin={bg=resolver} conduit_proxy::transport::connect DNS resolved DnsName(DnsName(DNSName(\"proxy-api.conduit.svc.cluster.local\"))) to 10.7.243.70\r\n```"},"comment":{"url":"https://api.github.com/repos/linkerd/linkerd2/issues/comments/426834641","html_url":"https://github.com/linkerd/linkerd2/issues/1288#issuecomment-426834641","issue_url":"https://api.github.com/repos/linkerd/linkerd2/issues/1288","id":426834641,"node_id":"MDEyOklzc3VlQ29tbWVudDQyNjgzNDY0MQ==","user":{"login":"grampelberg","id":47992,"node_id":"MDQ6VXNlcjQ3OTky","avatar_url":"https://avatars0.githubusercontent.com/u/47992?v=4","gravatar_id":"","url":"https://api.github.com/users/grampelberg","html_url":"https://github.com/grampelberg","followers_url":"https://api.github.com/users/grampelberg/followers","following_url":"https://api.github.com/users/grampelberg/following{/other_user}","gists_url":"https://api.github.com/users/grampelberg/gists{/gist_id}","starred_url":"https://api.github.com/users/grampelberg/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/grampelberg/subscriptions","organizations_url":"https://api.github.com/users/grampelberg/orgs","repos_url":"https://api.github.com/users/grampelberg/repos","events_url":"https://api.github.com/users/grampelberg/events{/privacy}","received_events_url":"https://api.github.com/users/grampelberg/received_events","type":"User","site_admin":false},"created_at":"2018-10-03T23:18:23Z","updated_at":"2018-10-03T23:18:23Z","author_association":"CONTRIBUTOR","body":"Has anyone seen this recently? I'm going to close it out for now ..."}}
{"actor":{"display_login":"grampelberg"}}