{"action":"created","issue":{"url":"https://api.github.com/repos/influxdata/influxdb/issues/5440","repository_url":"https://api.github.com/repos/influxdata/influxdb","labels_url":"https://api.github.com/repos/influxdata/influxdb/issues/5440/labels{/name}","comments_url":"https://api.github.com/repos/influxdata/influxdb/issues/5440/comments","events_url":"https://api.github.com/repos/influxdata/influxdb/issues/5440/events","html_url":"https://github.com/influxdata/influxdb/issues/5440","id":128490745,"number":5440,"title":"High memory usage ","user":{"login":"tahmasebi","id":3611353,"avatar_url":"https://avatars.githubusercontent.com/u/3611353?v=3","gravatar_id":"","url":"https://api.github.com/users/tahmasebi","html_url":"https://github.com/tahmasebi","followers_url":"https://api.github.com/users/tahmasebi/followers","following_url":"https://api.github.com/users/tahmasebi/following{/other_user}","gists_url":"https://api.github.com/users/tahmasebi/gists{/gist_id}","starred_url":"https://api.github.com/users/tahmasebi/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/tahmasebi/subscriptions","organizations_url":"https://api.github.com/users/tahmasebi/orgs","repos_url":"https://api.github.com/users/tahmasebi/repos","events_url":"https://api.github.com/users/tahmasebi/events{/privacy}","received_events_url":"https://api.github.com/users/tahmasebi/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":26,"created_at":"2016-01-25T08:58:42Z","updated_at":"2016-07-18T05:30:16Z","closed_at":null,"body":"Hi,\r\nI install Influxdb on ubuntu server with 4G of memory and use python's requests module to write 10M points into db.\r\nThe python script inserts 20k points per second into db successfully but ubuntu's memory goes high until Influxdb use 97% of Ram.\r\nAfter that I can't query a simple request like \"select * from srcipm limit 1\".\r\nEven after write process is finished, Influxdb doesn't release memory. \r\n\r\nDetails:\r\n- Server: `64bit Ubuntu Server 15.10, 1 Core CPU, 4G RAM`\r\n- InfluxDB Version `0.9.6`\r\n\r\nWrite query in python: \r\n```\r\nrequests.post(\"http://192.168.1.104:8086/write?db=mydb\", \"srcipm,device_id=4,input_snmp=2,output_snmp=3,direction=1,ip=192.168.1.1 bytes=25478\")\r\n```\r\n\r\nWhere is the problem? should I config something or my query is wrong?"},"comment":{"url":"https://api.github.com/repos/influxdata/influxdb/issues/comments/233230997","html_url":"https://github.com/influxdata/influxdb/issues/5440#issuecomment-233230997","issue_url":"https://api.github.com/repos/influxdata/influxdb/issues/5440","id":233230997,"user":{"login":"jwilder","id":219935,"avatar_url":"https://avatars.githubusercontent.com/u/219935?v=3","gravatar_id":"","url":"https://api.github.com/users/jwilder","html_url":"https://github.com/jwilder","followers_url":"https://api.github.com/users/jwilder/followers","following_url":"https://api.github.com/users/jwilder/following{/other_user}","gists_url":"https://api.github.com/users/jwilder/gists{/gist_id}","starred_url":"https://api.github.com/users/jwilder/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jwilder/subscriptions","organizations_url":"https://api.github.com/users/jwilder/orgs","repos_url":"https://api.github.com/users/jwilder/repos","events_url":"https://api.github.com/users/jwilder/events{/privacy}","received_events_url":"https://api.github.com/users/jwilder/received_events","type":"User","site_admin":false},"created_at":"2016-07-18T05:30:16Z","updated_at":"2016-07-18T05:30:16Z","body":"@carbolymer It looks like you have sparse data (stock prices) which ends up creating hundreds of small shards.  In your docker sample, I'd recommend increasing the shard group duration on your `default` retention policy after creating the databases.\r\n\r\nFor example, running the following _before_ writing data:\r\n\r\n`alter retention policy default on no_memory shard group duration 520w` \r\n\r\nwill change the shard group duration to 10y which should reduce the number of shards from ~1500 to 4.  \r\n\r\nI would also suggest setting `cache-snapshot-write-cold-duration = \"10s\"`.  You should not need to  change `compact-full-write-cold-duration` or `cache-snapshot-memory-size` from the default values though."}}
{"actor":{"display_login":"jwilder"}}