{"action":"created","issue":{"url":"https://api.github.com/repos/flynn/flynn/issues/2439","repository_url":"https://api.github.com/repos/flynn/flynn","labels_url":"https://api.github.com/repos/flynn/flynn/issues/2439/labels{/name}","comments_url":"https://api.github.com/repos/flynn/flynn/issues/2439/comments","events_url":"https://api.github.com/repos/flynn/flynn/issues/2439/events","html_url":"https://github.com/flynn/flynn/issues/2439","id":132818590,"number":2439,"title":"Controller hang after postgres connections killed","user":{"login":"titanous","id":13026,"avatar_url":"https://avatars.githubusercontent.com/u/13026?v=3","gravatar_id":"","url":"https://api.github.com/users/titanous","html_url":"https://github.com/titanous","followers_url":"https://api.github.com/users/titanous/followers","following_url":"https://api.github.com/users/titanous/following{/other_user}","gists_url":"https://api.github.com/users/titanous/gists{/gist_id}","starred_url":"https://api.github.com/users/titanous/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/titanous/subscriptions","organizations_url":"https://api.github.com/users/titanous/orgs","repos_url":"https://api.github.com/users/titanous/repos","events_url":"https://api.github.com/users/titanous/events{/privacy}","received_events_url":"https://api.github.com/users/titanous/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/flynn/flynn/labels/bug","name":"bug","color":"fc2929"},{"url":"https://api.github.com/repos/flynn/flynn/labels/controller","name":"controller","color":"fef2c0"}],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":2,"created_at":"2016-02-10T21:11:30Z","updated_at":"2016-03-07T16:54:03Z","closed_at":null,"body":"A user saw a high pg connection count and decided to kill some of the connections. One controller instance and the router recovered fine, but the other controller instance ended up hanging on each request:\r\n\r\n```text\r\nt=2016-02-10T19:15:17+0000 lvl=info msg=\"request completed\" component=controller req_id=c0def806-afab-4621-b63c-0ade45b1e9ef status=200 duration=279h53m20.815454711s\r\nt=2016-02-10T19:15:17+0000 lvl=info msg=\"request started\" component=controller req_id=e76cd156-7e85-4d5f-9f52-a2a8ffdb9096 method=GET path=/formations client_ip=100.100.24.3\r\nt=2016-02-10T19:15:17+0000 lvl=eror msg=\"conn is dead\" component=controller req_id=e76cd156-7e85-4d5f-9f52-a2a8ffdb9096\r\nt=2016-02-10T19:15:17+0000 lvl=info msg=\"request completed\" component=controller req_id=e76cd156-7e85-4d5f-9f52-a2a8ffdb9096 status=500 duration=210.09µs\r\nt=2016-02-10T19:15:17+0000 lvl=info msg=\"request started\" component=controller req_id=889d7c78-e940-4c95-ace0-ce3728eb419e method=GET path=/formations client_ip=100.100.46.0\r\nt=2016-02-10T19:15:17+0000 lvl=eror msg=\"conn is dead\" component=controller req_id=889d7c78-e940-4c95-ace0-ce3728eb419e\r\nt=2016-02-10T19:15:17+0000 lvl=info msg=\"request completed\" component=controller req_id=889d7c78-e940-4c95-ace0-ce3728eb419e status=500 duration=203.109µs\r\nt=2016-02-10T19:15:17+0000 lvl=info msg=\"request started\" req_id=4318c8df-3b82-4fa4-a7a8-742d1598d167 component=controller method=GET path=/formations client_ip=100.100.24.4\r\nt=2016-02-10T19:15:17+0000 lvl=eror msg=\"conn is dead\" req_id=4318c8df-3b82-4fa4-a7a8-742d1598d167 component=controller\r\nt=2016-02-10T19:15:17+0000 lvl=info msg=\"request completed\" req_id=4318c8df-3b82-4fa4-a7a8-742d1598d167 component=controller status=500 duration=196.738µs\r\nt=2016-02-10T19:15:17+0000 lvl=info msg=\"request started\" component=controller req_id=b076fb9d-dfc2-4e1e-8dd2-1a592f5235e8 method=GET path=/formations client_ip=100.100.60.0\r\nt=2016-02-10T19:15:17+0000 lvl=eror msg=\"conn is dead\" component=controller req_id=b076fb9d-dfc2-4e1e-8dd2-1a592f5235e8\r\nt=2016-02-10T19:15:17+0000 lvl=info msg=\"request completed\" component=controller req_id=b076fb9d-dfc2-4e1e-8dd2-1a592f5235e8 status=500 duration=223.427µs\r\nt=2016-02-10T19:15:17+0000 lvl=eror msg=\"error streaming events\" component=controller req_id=67ca2022-28f5-4ba5-9781-2bd9dbfdb63a fn=Events err=\"FATAL: terminating connection due to administrator command (SQLSTATE 57P01)\"\r\nt=2016-02-10T19:15:17+0000 lvl=eror msg=\"FATAL: terminating connection due to administrator command (SQLSTATE 57P01)\" component=controller req_id=67ca2022-28f5-4ba5-9781-2bd9dbfdb63a\r\nt=2016-02-10T19:15:17+0000 lvl=info msg=\"request completed\" component=controller req_id=67ca2022-28f5-4ba5-9781-2bd9dbfdb63a status=200 duration=237h26m40.488071364s\r\nt=2016-02-10T19:15:17+0000 lvl=eror msg=\"error streaming events\" component=controller req_id=18c44c31-a247-4095-9499-6a1c432de3b7 fn=Events err=\"FATAL: terminating connection due to administrator command (SQLSTATE 57P01)\"\r\nt=2016-02-10T19:15:17+0000 lvl=eror msg=\"FATAL: terminating connection due to administrator command (SQLSTATE 57P01)\" component=controller req_id=18c44c31-a247-4095-9499-6a1c432de3b7\r\nt=2016-02-10T19:15:17+0000 lvl=info msg=\"request completed\" component=controller req_id=18c44c31-a247-4095-9499-6a1c432de3b7 status=200 duration=236h50m36.043408829s\r\nt=2016-02-10T19:15:17+0000 lvl=eror msg=\"error streaming events\" req_id=1fd56a69-4c80-477e-b276-a070a42c85b5 component=controller fn=Events err=\"FATAL: terminating connection due to administrator command (SQLSTATE 57P01)\"\r\nt=2016-02-10T19:15:17+0000 lvl=eror msg=\"FATAL: terminating connection due to administrator command (SQLSTATE 57P01)\" req_id=1fd56a69-4c80-477e-b276-a070a42c85b5 component=controller\r\nt=2016-02-10T19:15:17+0000 lvl=info msg=\"request completed\" req_id=1fd56a69-4c80-477e-b276-a070a42c85b5 component=controller status=200 duration=237h20m58.800217325s\r\nt=2016-02-10T19:15:17+0000 lvl=eror msg=\"error streaming events\" req_id=4ca754ea-8d5c-42c3-9a1f-aab0351c134c component=controller fn=Events err=\"FATAL: terminating connection due to administrator command (SQLSTATE 57P01)\"\r\nt=2016-02-10T19:15:17+0000 lvl=eror msg=\"FATAL: terminating connection due to administrator command (SQLSTATE 57P01)\" req_id=4ca754ea-8d5c-42c3-9a1f-aab0351c134c component=controller\r\nt=2016-02-10T19:15:17+0000 lvl=info msg=\"request completed\" req_id=4ca754ea-8d5c-42c3-9a1f-aab0351c134c component=controller status=200 duration=236h45m38.516595103s\r\nt=2016-02-10T19:15:17+0000 lvl=info msg=\"request started\" component=controller req_id=91accf59-b5ae-47d2-a349-e51f7405cf9f method=GET path=/formations client_ip=100.100.86.0\r\nt=2016-02-10T19:15:17+0000 lvl=eror msg=\"conn is dead\" component=controller req_id=91accf59-b5ae-47d2-a349-e51f7405cf9f\r\nt=2016-02-10T19:15:17+0000 lvl=info msg=\"request completed\" component=controller req_id=91accf59-b5ae-47d2-a349-e51f7405cf9f status=500 duration=259.827µs\r\nt=2016-02-10T19:15:17+0000 lvl=info msg=\"request started\" req_id=2fec7ca4-4693-4a7a-a286-e11285d193f0 component=controller method=GET path=/formations client_ip=100.100.89.0\r\nt=2016-02-10T19:15:17+0000 lvl=eror msg=\"conn is dead\" req_id=2fec7ca4-4693-4a7a-a286-e11285d193f0 component=controller\r\nt=2016-02-10T19:15:17+0000 lvl=info msg=\"request completed\" req_id=2fec7ca4-4693-4a7a-a286-e11285d193f0 component=controller status=500 duration=243.246µs\r\nt=2016-02-10T19:15:17+0000 lvl=warn msg=\"migration listener disconnected, reconnecting in 5 seconds\" component=controller\r\nt=2016-02-10T19:15:17+0000 lvl=info msg=\"request started\" component=controller req_id=8361e711-4490-4f7f-afa4-1c24b09beeba method=GET path=/formations client_ip=100.100.46.0\r\nt=2016-02-10T19:15:17+0000 lvl=eror msg=\"conn is dead\" component=controller req_id=8361e711-4490-4f7f-afa4-1c24b09beeba\r\nt=2016-02-10T19:15:17+0000 lvl=info msg=\"request completed\" component=controller req_id=8361e711-4490-4f7f-afa4-1c24b09beeba status=500 duration=229.817µs\r\nt=2016-02-10T19:15:17+0000 lvl=info msg=\"request started\" component=controller req_id=29de1f16-9f7c-4fe6-979b-eb670e64f7de method=GET path=/formations client_ip=100.100.24.3\r\nt=2016-02-10T19:15:17+0000 lvl=eror msg=\"conn is dead\" component=controller req_id=29de1f16-9f7c-4fe6-979b-eb670e64f7de\r\nt=2016-02-10T19:15:17+0000 lvl=info msg=\"request completed\" component=controller req_id=29de1f16-9f7c-4fe6-979b-eb670e64f7de status=500 duration=222.42µs\r\nt=2016-02-10T19:15:17+0000 lvl=info msg=\"request started\" component=controller req_id=82544bbe-e26d-4009-8cde-9cd4b731dc4b method=GET path=/formations client_ip=100.100.24.4\r\nt=2016-02-10T19:15:17+0000 lvl=eror msg=\"conn is dead\" component=controller req_id=82544bbe-e26d-4009-8cde-9cd4b731dc4b\r\nt=2016-02-10T19:15:17+0000 lvl=info msg=\"request completed\" component=controller req_id=82544bbe-e26d-4009-8cde-9cd4b731dc4b status=500 duration=316.416µs\r\nt=2016-02-10T19:15:17+0000 lvl=info msg=\"request started\" req_id=f0ac1ec5-844f-410f-9e8b-e357a72264da component=controller method=GET path=/formations client_ip=100.100.60.0\r\nt=2016-02-10T19:15:17+0000 lvl=eror msg=\"conn is dead\" req_id=f0ac1ec5-844f-410f-9e8b-e357a72264da component=controller\r\nt=2016-02-10T19:15:17+0000 lvl=info msg=\"request completed\" req_id=f0ac1ec5-844f-410f-9e8b-e357a72264da component=controller status=500 duration=263.599µs\r\nt=2016-02-10T19:15:17+0000 lvl=info msg=\"request started\" component=controller req_id=0d961bdc-b7ab-4d2b-b2be-e84e89f4c100 method=GET path=/formations client_ip=100.100.89.0\r\nt=2016-02-10T19:15:17+0000 lvl=eror msg=\"conn is dead\" component=controller req_id=0d961bdc-b7ab-4d2b-b2be-e84e89f4c100\r\nt=2016-02-10T19:15:17+0000 lvl=info msg=\"request completed\" component=controller req_id=0d961bdc-b7ab-4d2b-b2be-e84e89f4c100 status=500 duration=314.026µs\r\nt=2016-02-10T19:15:17+0000 lvl=info msg=\"request started\" component=controller req_id=854da4c5-2278-4a36-baed-e95e71ba2b9d method=GET path=/formations client_ip=100.100.86.0\r\nt=2016-02-10T19:15:17+0000 lvl=eror msg=\"conn is dead\" component=controller req_id=854da4c5-2278-4a36-baed-e95e71ba2b9d\r\nt=2016-02-10T19:15:17+0000 lvl=info msg=\"request completed\" component=controller req_id=854da4c5-2278-4a36-baed-e95e71ba2b9d status=500 duration=262.489µs\r\nt=2016-02-10T19:15:17+0000 lvl=info msg=\"request started\" component=controller req_id=1e32f682-b411-4363-a0db-b620e79370a2 method=GET path=/formations client_ip=100.100.46.0\r\nt=2016-02-10T19:15:17+0000 lvl=eror msg=\"conn is dead\" component=controller req_id=1e32f682-b411-4363-a0db-b620e79370a2\r\nt=2016-02-10T19:15:17+0000 lvl=info msg=\"request completed\" component=controller req_id=1e32f682-b411-4363-a0db-b620e79370a2 status=500 duration=207.143µs\r\nt=2016-02-10T19:15:17+0000 lvl=info msg=\"request started\" component=controller req_id=b357366a-4a1f-41dc-9f7d-acbeacab1c01 method=GET path=/formations client_ip=100.100.24.3\r\nt=2016-02-10T19:15:17+0000 lvl=eror msg=\"conn is dead\" component=controller req_id=b357366a-4a1f-41dc-9f7d-acbeacab1c01\r\nt=2016-02-10T19:15:17+0000 lvl=info msg=\"request completed\" component=controller req_id=b357366a-4a1f-41dc-9f7d-acbeacab1c01 status=500 duration=324.902µs\r\nt=2016-02-10T19:15:17+0000 lvl=info msg=\"request started\" component=controller req_id=ffb084dd-18af-43b8-a514-79fa3c46f448 method=GET path=/formations client_ip=100.100.24.4\r\nt=2016-02-10T19:15:17+0000 lvl=eror msg=\"conn is dead\" component=controller req_id=ffb084dd-18af-43b8-a514-79fa3c46f448\r\nt=2016-02-10T19:15:17+0000 lvl=info msg=\"request completed\" component=controller req_id=ffb084dd-18af-43b8-a514-79fa3c46f448 status=500 duration=236.782µs\r\nt=2016-02-10T19:15:17+0000 lvl=info msg=\"request started\" component=controller req_id=b64f9a72-76a1-4762-b713-3ae7f5cb8b21 method=GET path=/formations client_ip=100.100.60.0\r\nt=2016-02-10T19:15:17+0000 lvl=eror msg=\"conn is dead\" component=controller req_id=b64f9a72-76a1-4762-b713-3ae7f5cb8b21\r\nt=2016-02-10T19:15:17+0000 lvl=info msg=\"request completed\" component=controller req_id=b64f9a72-76a1-4762-b713-3ae7f5cb8b21 status=500 duration=230.632µs\r\nt=2016-02-10T19:15:17+0000 lvl=info msg=\"request started\" component=controller req_id=2a0777f8-9c9b-4d45-8973-b77c3e5f665d method=GET path=/formations client_ip=100.100.89.0\r\nt=2016-02-10T19:15:17+0000 lvl=info msg=\"request started\" component=controller req_id=bf45a9b7-329c-4a8e-b5db-d75d3816b363 method=GET path=/formations client_ip=100.100.86.0\r\nt=2016-02-10T19:15:17+0000 lvl=info msg=\"request started\" component=controller req_id=5b878bdd-771f-4376-a7b6-542dd89ac775 method=GET path=/formations client_ip=100.100.46.0\r\nt=2016-02-10T19:15:17+0000 lvl=info msg=\"request started\" component=controller req_id=85af9da8-a9c6-442b-a9e8-d816e5ded456 method=GET path=/formations client_ip=100.100.24.3\r\nt=2016-02-10T19:15:17+0000 lvl=info msg=\"request started\" component=controller req_id=9d3efb55-1f50-4b33-8eac-7e262186fb8c method=GET path=/formations client_ip=100.100.24.4\r\nt=2016-02-10T19:15:17+0000 lvl=info msg=\"request started\" component=controller req_id=5f5c2edc-d516-491d-a54a-8591b60ae5df method=GET path=/formations client_ip=100.100.60.0\r\nt=2016-02-10T19:15:23+0000 lvl=info msg=\"request started\" component=controller req_id=40d5ad4f-ca86-4216-a372-3c560b94ca7d method=GET path=/apps/04920523-efde-4ad5-b490-7eca42a32931/formations/cda81a6f-007c-4add-a139-24ac6d66007c client_ip=100.100.89.0\r\nt=2016-02-10T19:15:26+0000 lvl=info msg=\"request started\" component=controller req_id=64ae9888-6212-4594-a313-c055dc709f23 method=GET path=/apps/04920523-efde-4ad5-b490-7eca42a32931/formations/cda81a6f-007c-4add-a139-24ac6d66007c client_ip=100.100.24.3\r\nt=2016-02-10T19:15:26+0000 lvl=info msg=\"request started\" req_id=a7e7cccc-7b34-4403-bc6c-f084d806c7a6 component=controller method=GET path=/apps/04920523-efde-4ad5-b490-7eca42a32931/formations/cda81a6f-007c-4add-a139-24ac6d66007c client_ip=100.100.24.4\r\nt=2016-02-10T19:15:32+0000 lvl=info msg=\"request started\" component=controller req_id=94e66fdb-b842-4857-9901-c5fabe0bcc12 method=GET path=/apps/04920523-efde-4ad5-b490-7eca42a32931/formations/cda81a6f-007c-4add-a139-24ac6d66007c client_ip=100.100.60.0\r\nt=2016-02-10T19:15:34+0000 lvl=info msg=\"request started\" component=controller req_id=fabace86-e70d-443e-8240-c2d5c5892df6 method=GET path=/apps/04920523-efde-4ad5-b490-7eca42a32931/formations/cda81a6f-007c-4add-a139-24ac6d66007c client_ip=100.100.46.0\r\nt=2016-02-10T19:15:34+0000 lvl=info msg=\"request started\" component=controller req_id=ddaba98e-34b7-4f53-8a90-1b222d12539b method=GET path=/apps/04920523-efde-4ad5-b490-7eca42a32931/formations/cda81a6f-007c-4add-a139-24ac6d66007c client_ip=100.100.86.0\r\nt=2016-02-10T19:18:49+0000 lvl=info msg=\"request started\" component=controller req_id=c42e8590-0d1c-4aac-8328-711f99fa966f method=GET path=/apps/pgweb/release client_ip=76.103.109.137\r\nt=2016-02-10T19:20:23+0000 lvl=info msg=\"request started\" component=controller req_id=5eeb71dd-b448-4811-9c42-fcba05de9e8c method=GET path=/apps/pgweb/jobs client_ip=76.103.109.137\r\nt=2016-02-10T19:21:05+0000 lvl=info msg=\"request started\" component=controller req_id=44b530e8-a6a3-45ae-afed-cb144ff2a98e method=GET path=/apps/pgweb/jobs client_ip=76.103.109.137\r\nt=2016-02-10T19:25:07+0000 lvl=info msg=\"request started\" component=controller req_id=8a35ac34-7b42-4b14-aceb-419ada1a2912 method=GET path=/apps/cerplus-production/release client_ip=76.103.109.137\r\nt=2016-02-10T19:25:24+0000 lvl=info msg=\"request started\" component=controller req_id=f2c679a7-e416-4e7a-976d-64d8aeb72a01 method=GET path=/apps/pgweb/release client_ip=76.103.109.137\r\nt=2016-02-10T19:25:37+0000 lvl=info msg=\"request started\" component=controller req_id=8e6f459b-18bd-4e22-a291-2077501f0a95 method=GET path=/apps/cerplus-production/jobs client_ip=76.103.109.137\r\nt=2016-02-10T19:33:40+0000 lvl=info msg=\"request started\" component=controller req_id=15ed28a7-4e6c-42a3-b51b-c75c579c24ba method=GET path=/apps/pgweb/release client_ip=76.103.109.137\r\nt=2016-02-10T19:33:58+0000 lvl=info msg=\"request started\" req_id=63fc4f42-4589-43bb-95f2-975e8650b1d7 component=controller method=GET path=/apps/cerplus-production/jobs client_ip=76.103.109.137\r\nt=2016-02-10T19:34:02+0000 lvl=info msg=\"request started\" component=controller req_id=43db1e6b-d63d-40ac-9ef5-10ffc6a3ceb0 method=GET path=/apps/cerplus-production/release client_ip=76.103.109.137\r\nt=2016-02-10T19:40:05+0000 lvl=info msg=\"request started\" component=controller req_id=5e2057f4-bcd6-4ef0-a498-a0239b649aa0 method=POST path=/releases client_ip=76.103.109.137\r\nt=2016-02-10T19:41:30+0000 lvl=info msg=\"request started\" component=controller req_id=f2221719-d31c-4330-a339-b622485072ac method=POST path=/apps/pgweb/deploy client_ip=76.103.109.137\r\nt=2016-02-10T19:41:34+0000 lvl=info msg=\"request started\" component=controller req_id=90c6355f-1f68-46b0-baf7-ac3de5322ba0 method=GET path=/apps/pgweb/formations/91c5edec-8748-4d9d-9ef2-88a8fd24ce27 client_ip=76.103.109.137\r\nt=2016-02-10T19:41:47+0000 lvl=info msg=\"request started\" component=controller req_id=ec6040b7-a52d-4672-957e-303d749a8d27 method=GET path=/apps/cerplus-production/release client_ip=76.103.109.137\r\nt=2016-02-10T19:42:28+0000 lvl=info msg=\"request started\" component=controller req_id=c74413a8-a71f-42bb-8e89-dfbad3174dd1 method=GET path=/apps/pgweb/release client_ip=76.103.109.137\r\nt=2016-02-10T19:42:39+0000 lvl=info msg=\"request started\" req_id=b90dc603-749f-42b9-a5da-26de366a6e7d component=controller method=GET path=/apps/pgweb/release client_ip=76.103.109.137\r\nt=2016-02-10T19:42:48+0000 lvl=info msg=\"request started\" component=controller req_id=d585467b-2c9e-48cb-8993-a2b9c53f8e1b method=GET path=/apps/pgweb/formations/91c5edec-8748-4d9d-9ef2-88a8fd24ce27 client_ip=76.103.109.137\r\nt=2016-02-10T19:43:03+0000 lvl=info msg=\"request started\" component=controller req_id=4b8c7303-6dbf-480c-b382-7ccf8a0df7f8 method=GET path=/apps/pgweb/release client_ip=76.103.109.137\r\nt=2016-02-10T19:43:13+0000 lvl=info msg=\"request started\" component=controller req_id=f6e539e7-9a68-4197-b647-72e10ece4f8d method=GET path=/apps/pgweb/release client_ip=76.103.109.137\r\nt=2016-02-10T19:47:24+0000 lvl=info msg=\"request started\" component=controller req_id=051ceca7-2645-44fe-be6f-7ed237b208b1 method=GET path=/apps/pgweb/formations/91c5edec-8748-4d9d-9ef2-88a8fd24ce27 client_ip=76.103.109.137\r\nt=2016-02-10T19:48:12+0000 lvl=info msg=\"request started\" component=controller req_id=63ac42a3-02d4-41ca-af8a-ff4aee925db1 method=POST path=/apps/postgres/jobs client_ip=76.103.109.137\r\nt=2016-02-10T19:48:47+0000 lvl=info msg=\"request started\" component=controller req_id=f0e6f43c-4715-48b2-8e99-452e402189b6 method=GET path=/apps/controller/formations/50b41213-c35e-4133-8519-7fdf5830ccce client_ip=76.103.109.137\r\nt=2016-02-10T19:49:26+0000 lvl=info msg=\"request started\" req_id=7d7ce1ba-0f4d-4ee3-9630-2da274da9f87 component=controller method=GET path=/apps/controller/release client_ip=76.103.109.137\r\nt=2016-02-10T19:50:39+0000 lvl=info msg=\"request started\" component=controller req_id=c5023208-ddcf-44ad-8686-8669c83a7067 method=GET path=/apps/controller/release client_ip=76.103.109.137\r\nt=2016-02-10T19:51:45+0000 lvl=info msg=\"request started\" component=controller req_id=68819dea-32ab-423f-8bba-89cea01cca91 method=DELETE path=/apps/postgres/jobs/ip17231406-ebf2123b-6e69-43e0-9d75-cdac3e748125 client_ip=76.103.109.137\r\nt=2016-02-10T19:52:41+0000 lvl=info msg=\"request started\" component=controller req_id=980c3e0d-89f4-4899-89de-8b5ec63ee0a1 method=GET path=/apps/b5ccf56e-7e6c-426f-ad08-a1d325b2c3d3/release client_ip=76.103.109.137\r\nt=2016-02-10T19:53:04+0000 lvl=info msg=\"request started\" req_id=cffc8dec-5c69-439c-a5e3-e8186c5374fc component=controller method=GET path=/apps/b5ccf56e-7e6c-426f-ad08-a1d325b2c3d3/formations/cda81a6f-007c-4add-a139-24ac6d66007c client_ip=76.103.109.137\r\nt=2016-02-10T19:53:23+0000 lvl=info msg=\"request started\" component=controller req_id=2bf76488-b10d-4174-bc82-277c3defecfd method=GET path=/apps/postgres client_ip=76.103.109.137\r\nt=2016-02-10T19:53:48+0000 lvl=info msg=\"request started\" component=controller req_id=f6504216-9501-4f50-a908-a5098b104a26 method=GET path=/apps/postgres client_ip=76.103.109.137\r\nt=2016-02-10T19:54:06+0000 lvl=info msg=\"request started\" component=controller req_id=820a5179-5991-4328-9f60-06d21c7258ce method=GET path=/apps/postgres client_ip=76.103.109.137\r\nt=2016-02-10T19:56:37+0000 lvl=info msg=\"request started\" component=controller req_id=eb93cb80-039b-44dc-a7a2-435d7b8ce4ef method=GET path=/apps/postgres client_ip=76.103.109.137\r\nt=2016-02-10T19:56:49+0000 lvl=info msg=\"request started\" component=controller req_id=6d3104be-b38f-4061-998e-00ecb86a61b9 method=GET path=/apps/controller/jobs client_ip=76.103.109.137\r\nt=2016-02-10T19:56:55+0000 lvl=info msg=\"request started\" component=controller req_id=05e2058d-a0a7-4117-a5f5-1351ad32d11a method=GET path=/apps/production/release client_ip=76.103.109.137\r\nt=2016-02-10T20:18:49+0000 lvl=info msg=\"request started\" component=controller req_id=4d988303-9af3-41b7-9732-1bad042bd6c9 method=GET path=/apps/production/release client_ip=76.103.109.137\r\n```"},"comment":{"url":"https://api.github.com/repos/flynn/flynn/issues/comments/193342796","html_url":"https://github.com/flynn/flynn/issues/2439#issuecomment-193342796","issue_url":"https://api.github.com/repos/flynn/flynn/issues/2439","id":193342796,"user":{"login":"titanous","id":13026,"avatar_url":"https://avatars.githubusercontent.com/u/13026?v=3","gravatar_id":"","url":"https://api.github.com/users/titanous","html_url":"https://github.com/titanous","followers_url":"https://api.github.com/users/titanous/followers","following_url":"https://api.github.com/users/titanous/following{/other_user}","gists_url":"https://api.github.com/users/titanous/gists{/gist_id}","starred_url":"https://api.github.com/users/titanous/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/titanous/subscriptions","organizations_url":"https://api.github.com/users/titanous/orgs","repos_url":"https://api.github.com/users/titanous/repos","events_url":"https://api.github.com/users/titanous/events{/privacy}","received_events_url":"https://api.github.com/users/titanous/received_events","type":"User","site_admin":false},"created_at":"2016-03-07T16:54:03Z","updated_at":"2016-03-07T16:54:03Z","body":"@temujin9 saw this on one of their clusters. Here's a complete goroutine trace: https://gist.github.com/titanous/ccfd55b962c011789454"}}