{"action":"created","issue":{"url":"https://api.github.com/repos/influxdata/influxdb/issues/5685","repository_url":"https://api.github.com/repos/influxdata/influxdb","labels_url":"https://api.github.com/repos/influxdata/influxdb/issues/5685/labels{/name}","comments_url":"https://api.github.com/repos/influxdata/influxdb/issues/5685/comments","events_url":"https://api.github.com/repos/influxdata/influxdb/issues/5685/events","html_url":"https://github.com/influxdata/influxdb/issues/5685","id":133514957,"number":5685,"title":"[0.10.0] Unbounded memory usage when inserting data","user":{"login":"SaganBolliger","id":6234732,"avatar_url":"https://avatars.githubusercontent.com/u/6234732?v=3","gravatar_id":"","url":"https://api.github.com/users/SaganBolliger","html_url":"https://github.com/SaganBolliger","followers_url":"https://api.github.com/users/SaganBolliger/followers","following_url":"https://api.github.com/users/SaganBolliger/following{/other_user}","gists_url":"https://api.github.com/users/SaganBolliger/gists{/gist_id}","starred_url":"https://api.github.com/users/SaganBolliger/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/SaganBolliger/subscriptions","organizations_url":"https://api.github.com/users/SaganBolliger/orgs","repos_url":"https://api.github.com/users/SaganBolliger/repos","events_url":"https://api.github.com/users/SaganBolliger/events{/privacy}","received_events_url":"https://api.github.com/users/SaganBolliger/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":2,"created_at":"2016-02-14T07:14:40Z","updated_at":"2016-02-14T20:43:06Z","closed_at":null,"body":"I recently upgraded from 0.9.0 to 0.10.0 and since then have been running into memory issues that I'm guessing are related to the new tsm engine. My dataset consists of 6 series, each with 4 fields, and about 75M records per series. I'm not using tags. I'm inserting this data into influxdb using the Python Pandas client in chronological order in chunks of approximately 4k records at a rate of about 6 chunks per second (one chunk per series per second). Previously when I tried doing this with 0.9.0 the memory usage would stay moderate never going over around 2 GB, but with 0.10.0  memory usage seems to increase linearly with the amount of data inserted. After around 1/3rd of the data, the memory usage hits 15GB, at which point I'm forced to kill the process. I've had this same issue running on OSX El Cap and Ubuntu 14.04. "},"comment":{"url":"https://api.github.com/repos/influxdata/influxdb/issues/comments/183973142","html_url":"https://github.com/influxdata/influxdb/issues/5685#issuecomment-183973142","issue_url":"https://api.github.com/repos/influxdata/influxdb/issues/5685","id":183973142,"user":{"login":"easyrasta","id":1186969,"avatar_url":"https://avatars.githubusercontent.com/u/1186969?v=3","gravatar_id":"","url":"https://api.github.com/users/easyrasta","html_url":"https://github.com/easyrasta","followers_url":"https://api.github.com/users/easyrasta/followers","following_url":"https://api.github.com/users/easyrasta/following{/other_user}","gists_url":"https://api.github.com/users/easyrasta/gists{/gist_id}","starred_url":"https://api.github.com/users/easyrasta/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/easyrasta/subscriptions","organizations_url":"https://api.github.com/users/easyrasta/orgs","repos_url":"https://api.github.com/users/easyrasta/repos","events_url":"https://api.github.com/users/easyrasta/events{/privacy}","received_events_url":"https://api.github.com/users/easyrasta/received_events","type":"User","site_admin":false},"created_at":"2016-02-14T20:43:06Z","updated_at":"2016-02-14T20:43:06Z","body":"I have same problem too. Before Influxdb run on 2 G, now I need 16g. I am only writing data. If I set less than 16 G I got 500 http code, and even restarting influxdb dosent fix it.\r\nOn you website, I look hardarware recommendation seem wrong with 0.10\r\n\r\nI think there is something wrong with 0.10\r\n\r\nI will try your recommendation tomorrow. But I would like to know if this is a bug or it's normal. There is a huge difference. "}}