{"action":"closed","issue":{"url":"https://api.github.com/repos/influxdata/influxdb/issues/5362","repository_url":"https://api.github.com/repos/influxdata/influxdb","labels_url":"https://api.github.com/repos/influxdata/influxdb/issues/5362/labels{/name}","comments_url":"https://api.github.com/repos/influxdata/influxdb/issues/5362/comments","events_url":"https://api.github.com/repos/influxdata/influxdb/issues/5362/events","html_url":"https://github.com/influxdata/influxdb/issues/5362","id":126848036,"number":5362,"title":"[0.10.0-nightly-8fc4cbe] failed to store statistics: error fetching meta data -> HTTP 500","user":{"login":"zstyblik","id":6183869,"avatar_url":"https://avatars.githubusercontent.com/u/6183869?v=3","gravatar_id":"","url":"https://api.github.com/users/zstyblik","html_url":"https://github.com/zstyblik","followers_url":"https://api.github.com/users/zstyblik/followers","following_url":"https://api.github.com/users/zstyblik/following{/other_user}","gists_url":"https://api.github.com/users/zstyblik/gists{/gist_id}","starred_url":"https://api.github.com/users/zstyblik/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/zstyblik/subscriptions","organizations_url":"https://api.github.com/users/zstyblik/orgs","repos_url":"https://api.github.com/users/zstyblik/repos","events_url":"https://api.github.com/users/zstyblik/events{/privacy}","received_events_url":"https://api.github.com/users/zstyblik/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":3,"created_at":"2016-01-15T10:35:57Z","updated_at":"2016-11-30T16:03:54Z","closed_at":"2016-11-30T16:03:54Z","body":"```\n2016/01/15 10:27:58 InfluxDB starting, version 0.10.0.n1452839274, branch master, commit db84a6ed76353905432ff8bd91527c68b3ea1be6, built 2016-01-15T06:28:38.989809\n2016/01/15 10:27:58 Go version go1.4.3, GOMAXPROCS set to 8\n2016/01/15 10:27:58 Using configuration at: /config/config.toml\n[store] 2016/01/15 10:28:01 Using data dir: /data/db\n[tsm1wal] 2016/01/15 10:28:01 tsm1 WAL starting with 10485760 segment size\n[tsm1wal] 2016/01/15 10:28:01 tsm1 WAL writing to /data/wal/_internal/monitor/1\n[filestore]2016/01/15 10:28:01 /data/db/_internal/monitor/1/000000001-000000001.tsm (#0) opened in 19.875211ms\n[cacheloader] 2016/01/15 10:28:01 reading file /data/wal/_internal/monitor/1/_00005.wal, size 0\n[tsm1wal] 2016/01/15 10:28:01 tsm1 WAL starting with 10485760 segment size\n[tsm1wal] 2016/01/15 10:28:01 tsm1 WAL writing to /data/wal/_internal/monitor/10\n[cacheloader] 2016/01/15 10:28:01 reading file /data/wal/_internal/monitor/10/_00001.wal, size 4729366\n[cacheloader] 2016/01/15 10:28:02 reading file /data/wal/_internal/monitor/10/_00002.wal, size 469637\n[cacheloader] 2016/01/15 10:28:02 reading file /data/wal/_internal/monitor/10/_00004.wal, size 0\n[tsm1wal] 2016/01/15 10:28:02 tsm1 WAL starting with 10485760 segment size\n[tsm1wal] 2016/01/15 10:28:02 tsm1 WAL writing to /data/wal/_internal/monitor/3\n[filestore]2016/01/15 10:28:02 /data/db/_internal/monitor/3/000000001-000000001.tsm (#0) opened in 1.805517ms\n[cacheloader] 2016/01/15 10:28:02 reading file /data/wal/_internal/monitor/3/_00005.wal, size 0\n[tsm1wal] 2016/01/15 10:28:02 tsm1 WAL starting with 10485760 segment size\n[tsm1wal] 2016/01/15 10:28:02 tsm1 WAL writing to /data/wal/_internal/monitor/4\n[filestore]2016/01/15 10:28:02 /data/db/_internal/monitor/4/000000001-000000001.tsm (#0) opened in 2.11536ms\n[cacheloader] 2016/01/15 10:28:02 reading file /data/wal/_internal/monitor/4/_00005.wal, size 0\n[tsm1wal] 2016/01/15 10:28:02 tsm1 WAL starting with 10485760 segment size\n[tsm1wal] 2016/01/15 10:28:02 tsm1 WAL writing to /data/wal/_internal/monitor/5\n[filestore]2016/01/15 10:28:02 /data/db/_internal/monitor/5/000000001-000000001.tsm (#0) opened in 7.513023ms\n[cacheloader] 2016/01/15 10:28:02 reading file /data/wal/_internal/monitor/5/_00005.wal, size 0\n[tsm1wal] 2016/01/15 10:28:02 tsm1 WAL starting with 10485760 segment size\n[tsm1wal] 2016/01/15 10:28:02 tsm1 WAL writing to /data/wal/_internal/monitor/7\n[filestore]2016/01/15 10:28:02 /data/db/_internal/monitor/7/000000001-000000001.tsm (#0) opened in 1.418967ms\n[cacheloader] 2016/01/15 10:28:02 reading file /data/wal/_internal/monitor/7/_00006.wal, size 0\n[tsm1wal] 2016/01/15 10:28:02 tsm1 WAL starting with 10485760 segment size\n[tsm1wal] 2016/01/15 10:28:02 tsm1 WAL writing to /data/wal/_internal/monitor/8\n[filestore]2016/01/15 10:28:02 /data/db/_internal/monitor/8/000000001-000000001.tsm (#0) opened in 1.772041ms\n[cacheloader] 2016/01/15 10:28:02 reading file /data/wal/_internal/monitor/8/_00006.wal, size 0\n[tsm1wal] 2016/01/15 10:28:02 tsm1 WAL starting with 10485760 segment size\n[tsm1wal] 2016/01/15 10:28:02 tsm1 WAL writing to /data/wal/_internal/monitor/9\n[filestore]2016/01/15 10:28:02 /data/db/_internal/monitor/9/000000001-000000001.tsm (#0) opened in 1.748456ms\n[cacheloader] 2016/01/15 10:28:02 reading file /data/wal/_internal/monitor/9/_00006.wal, size 0\n[tsm1wal] 2016/01/15 10:28:02 tsm1 WAL starting with 10485760 segment size\n[tsm1wal] 2016/01/15 10:28:02 tsm1 WAL writing to /data/wal/telegraf/default/2\n[filestore]2016/01/15 10:28:02 /data/db/telegraf/default/2/000000020-000000004.tsm (#0) opened in 10.274024ms\n[cacheloader] 2016/01/15 10:28:02 reading file /data/wal/telegraf/default/2/_00062.wal, size 0\n[tsm1wal] 2016/01/15 10:28:02 tsm1 WAL starting with 10485760 segment size\n[tsm1wal] 2016/01/15 10:28:02 tsm1 WAL writing to /data/wal/telegraf/default/6\n[filestore]2016/01/15 10:28:02 /data/db/telegraf/default/6/000000144-000000004.tsm (#1) opened in 1.866822ms\n[filestore]2016/01/15 10:28:02 /data/db/telegraf/default/6/000000128-000000006.tsm (#0) opened in 5.404788ms\n[filestore]2016/01/15 10:28:02 /data/db/telegraf/default/6/000000149-000000003.tsm (#2) opened in 23.429663ms\n[filestore]2016/01/15 10:28:02 /data/db/telegraf/default/6/000000151-000000002.tsm (#3) opened in 25.09351ms\n[cacheloader] 2016/01/15 10:28:02 reading file /data/wal/telegraf/default/6/_00569.wal, size 9845272\n[cacheloader] 2016/01/15 10:28:03 reading file /data/wal/telegraf/default/6/_00571.wal, size 0\n[handoff] 2016/01/15 10:28:04 Starting hinted handoff service\n[monitor] 2016/01/15 10:28:04 'hh' registered for diagnostics monitoring\n[handoff] 2016/01/15 10:28:04 Using data dir: /data/hh\n[subscriber] 2016/01/15 10:28:04 opened service\n[monitor] 2016/01/15 10:28:04 Starting monitor system\n[monitor] 2016/01/15 10:28:04 'build' registered for diagnostics monitoring\n[monitor] 2016/01/15 10:28:04 'runtime' registered for diagnostics monitoring\n[monitor] 2016/01/15 10:28:04 'network' registered for diagnostics monitoring\n[monitor] 2016/01/15 10:28:04 'system' registered for diagnostics monitoring\n[cluster] 2016/01/15 10:28:04 Starting cluster service\n[shard-precreation] 2016/01/15 10:28:04 Starting precreation service with check interval of 10m0s, advance period of 30m0s\n[snapshot] 2016/01/15 10:28:04 Starting snapshot service\n[copier] 2016/01/15 10:28:04 Starting copier service\n[admin] 2016/01/15 10:28:04 Starting admin service\n[monitor] 2016/01/15 10:28:04 Storing statistics in database '_internal' retention policy '', at interval 10s\n[admin] 2016/01/15 10:28:04 Listening on HTTP: [::]:8083\n[continuous_querier] 2016/01/15 10:28:04 Starting continuous query service\n[httpd] 2016/01/15 10:28:04 Starting HTTP service\n[httpd] 2016/01/15 10:28:04 Authentication enabled: false\n[httpd] 2016/01/15 10:28:04 Listening on HTTP: [::]:8086\n[retention] 2016/01/15 10:28:04 Starting retention policy enforcement service with check interval of 30m0s\n[run] 2016/01/15 10:28:04 Listening for signals\n[http] 2016/01/15 10:28:10 192.168.112.13 - - [15/Jan/2016:10:28:10 +0000] POST /write?consistency=&db=telegraf&precision=s&rp= HTTP/1.1 500 115 - InfluxDBClient acdc6c17-bb72-11e5-8023-000000000000 44.386274ms\n[http] 2016/01/15 10:28:10 192.168.112.13 - - [15/Jan/2016:10:28:10 +0000] POST /write?consistency=&db=telegraf&precision=s&rp= HTTP/1.1 500 115 - InfluxDBClient acdc5086-bb72-11e5-8022-000000000000 46.187545ms\n[http] 2016/01/15 10:28:10 192.168.112.20 - - [15/Jan/2016:10:28:10 +0000] POST /write?consistency=&db=telegraf&precision=s&rp= HTTP/1.1 500 115 - InfluxDBClient ac997c3f-bb72-11e5-800d-000000000000 554.019374ms\n[http] 2016/01/15 10:28:10 192.168.112.19 - - [15/Jan/2016:10:28:10 +0000] POST /write?consistency=&db=telegraf&precision=s&rp= HTTP/1.1 500 115 - InfluxDBClient ac997ae5-bb72-11e5-800c-000000000000 554.762258ms\n[...]\n[monitor] 2016/01/15 10:28:14 failed to store statistics: error fetching meta data: no leader detected during fetchMetaData\n[...]\n[monitor] 2016/01/15 10:28:25 failed to store statistics: error fetching meta data: rpc Error failed: no leader detected during proxyLeader\n[...]\n[monitor] 2016/01/15 10:28:35 failed to store statistics: error fetching meta data: rpc Error failed: no leader detected during proxyLeader\n[...]\n```\n\nNo recovery. Let me reference other issues here that might be related, resp. root-cause because of an effort to fix something and breaking stuff in the progress\n- https://github.com/influxdata/influxdb/issues/5277\n- https://github.com/influxdata/influxdb/issues/5332\n- https://github.com/influxdata/influxdb/issues/5327\n"}}
{"actor":{"display_login":"e-dard"}}