{"action":"closed","issue":{"url":"https://api.github.com/repos/influxdata/influxdb/issues/6273","repository_url":"https://api.github.com/repos/influxdata/influxdb","labels_url":"https://api.github.com/repos/influxdata/influxdb/issues/6273/labels{/name}","comments_url":"https://api.github.com/repos/influxdata/influxdb/issues/6273/comments","events_url":"https://api.github.com/repos/influxdata/influxdb/issues/6273/events","html_url":"https://github.com/influxdata/influxdb/issues/6273","id":147051686,"number":6273,"title":"[0.10.1] CQ missing data depending on time frame","user":{"login":"linroics","id":7396022,"avatar_url":"https://avatars.githubusercontent.com/u/7396022?v=3","gravatar_id":"","url":"https://api.github.com/users/linroics","html_url":"https://github.com/linroics","followers_url":"https://api.github.com/users/linroics/followers","following_url":"https://api.github.com/users/linroics/following{/other_user}","gists_url":"https://api.github.com/users/linroics/gists{/gist_id}","starred_url":"https://api.github.com/users/linroics/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/linroics/subscriptions","organizations_url":"https://api.github.com/users/linroics/orgs","repos_url":"https://api.github.com/users/linroics/repos","events_url":"https://api.github.com/users/linroics/events{/privacy}","received_events_url":"https://api.github.com/users/linroics/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":4,"created_at":"2016-04-08T22:10:23Z","updated_at":"2016-09-19T19:59:14Z","closed_at":"2016-09-19T19:59:14Z","body":"I am using CQ's to down sample by site to get location averages. All of this works correctly but I am seeing an odd issue. After some time of running I notice that data that is requested for long time frames (> 3h) don't have any current data. However, when I change the query to the last three hours the missing data  shows up correctly. I checked using the following quires and the data is there for small times but not the long ones. I have tried restarting the influx service and it had no impact. Another thing to note is that this is also only happing on the CQ version of the data. The non downsampled data does not show this issue.\r\n\r\nI was not able to find anything similar in the open bugs or on the google group page.\r\n\r\nWhen running a Query for time > now() -4h the data is missing in alot of spots\r\n> SELECT mean(\"respTime\") FROM \"site_perf\" WHERE  time > now() - 4h GROUP BY time(5m)\r\nname: site_perf\r\n--------------------\r\ntime                    mean\r\n1459277400000000000     1.3061995469197798\r\n1459277700000000000     1.2545889816546227\r\n1459278000000000000     1.2958840825182398\r\n1459278300000000000     1.3005296896113339\r\n1459278600000000000     1.4994842241474975\r\n1459278900000000000     1.3306135521088178\r\n1459279200000000000     1.3286860573264112\r\n1459279500000000000     1.4275837201763675\r\n1459279800000000000     1.4117126874333947\r\n1459280100000000000     1.3656119937434639\r\n1459280400000000000     1.3755893642976111\r\n1459280700000000000     1.399226772671526\r\n1459281000000000000     1.3148504251594089\r\n1459281300000000000     1.3014612960411196\r\n1459281600000000000     1.311433302102438\r\n1459281900000000000     1.347239695118827\r\n1459282200000000000     1.3717685171844447\r\n1459282500000000000     1.5015644301052113\r\n1459282800000000000     1.5850378565473864\r\n1459283100000000000     0\r\n1459283400000000000     0.17374799393926477\r\n1459283700000000000     0\r\n1459284000000000000     0\r\n1459284300000000000     0.096\r\n1459284600000000000     0.014000000000000002\r\n1459284900000000000     0\r\n1459285200000000000     0\r\n1459285500000000000     2.492857142857143\r\n1459285800000000000     0.9516666666666667\r\n1459286100000000000     0\r\n1459286400000000000     2.0700000000000003\r\n1459286700000000000     3.4266666666666667\r\n1459287000000000000     3.5212499999999998\r\n1459287300000000000     0.016\r\n1459287600000000000     0\r\n1459287900000000000     0\r\n1459288200000000000     0\r\n1459288500000000000     0\r\n1459288800000000000     0.27010818592073305\r\n1459289100000000000     0.184\r\n1459289400000000000     0\r\n1459289700000000000     0\r\n1459290000000000000     0\r\n1459290300000000000\r\n1459290600000000000\r\n1459290900000000000\r\n1459291200000000000\r\n1459291500000000000    \r\n1459291800000000000\r\n\r\n\r\nWhen I run the same query with time > now() -3h the missing data from above is filled in. \r\n\r\n> SELECT mean(\"respTime\") FROM \"site_perf\" WHERE  time > now() - 3h GROUP BY time(5m)\r\nname: site_perf\r\n--------------------\r\ntime                    mean\r\n1459281000000000000     1.275318617604651\r\n1459281300000000000     1.30146129604112\r\n1459281600000000000     1.311433302102438\r\n1459281900000000000     1.3472396951188272\r\n1459282200000000000     1.3717685171844447\r\n1459282500000000000     1.5015644301052105\r\n1459282800000000000     1.5135420900790697\r\n1459283100000000000     1.4957340015054985\r\n1459283400000000000     1.43372543096075\r\n1459283700000000000     1.4071240175352513\r\n1459284000000000000     1.3783814203235474\r\n1459284300000000000     1.4117470407603143\r\n1459284600000000000     1.4458131225653117\r\n1459284900000000000     1.3450328505375468\r\n1459285200000000000     1.3572948187655949\r\n1459285500000000000     1.3220819130086399\r\n1459285800000000000     1.309561898727543\r\n1459286100000000000     1.3039778806049933\r\n1459286400000000000     1.4032298595633403\r\n1459286700000000000     1.3490015485617857\r\n1459287000000000000     1.3599768612453098\r\n1459287300000000000     1.2967420419837596\r\n1459287600000000000     1.3160391280229236\r\n1459287900000000000     1.3094432629125927\r\n1459288200000000000     1.3673983683312751\r\n1459288500000000000     1.5923603896514558\r\n1459288800000000000     1.6009743512228622\r\n1459289100000000000     1.4809644378331817\r\n1459289400000000000     1.2852435368653183\r\n1459289700000000000     1.3194637956798185\r\n1459290000000000000     1.2904080477000102\r\n1459290300000000000     1.2854642804823777\r\n1459290600000000000     1.283869079503355\r\n1459290900000000000     1.375089631257322\r\n1459291200000000000     1.4307575832844628\r\n1459291500000000000     1.4902668390143015\r\n1459291800000000000\r\n\r\n\r\nWhen I look at the data that feeds the CQ it has the data. Below its working for time > now() -4h.\r\n\r\n> SELECT mean(\"respTime\") FROM \"serverPerf\" WHERE  time > now() - 4h GROUP BY time(5m)\r\nname: respTime\r\n--------------------\r\ntime                    mean\r\n1459277400000000000     2.81403007363919\r\n1459277700000000000     2.769030150037585\r\n1459278000000000000     2.875411656063908\r\n1459278300000000000     2.938956235959644\r\n1459278600000000000     3.1438613902584938\r\n1459278900000000000     3.093386894610158\r\n1459279200000000000     3.1460658696141133\r\n1459279500000000000     3.142944734953221\r\n1459279800000000000     3.3945110604472206\r\n1459280100000000000     3.1054964714620636\r\n1459280400000000000     3.080622421048196\r\n1459280700000000000     3.2474383066596735\r\n1459281000000000000     3.0608304033090725\r\n1459281300000000000     2.984799693588042\r\n1459281600000000000     3.0164897841606755\r\n1459281900000000000     3.014098693520831\r\n1459282200000000000     3.1474121588493484\r\n1459282500000000000     3.355392116692471\r\n1459282800000000000     3.373986779031815\r\n1459283100000000000     3.580072823568203\r\n1459283400000000000     3.3698958784260085\r\n1459283700000000000     3.41120978200439\r\n1459284000000000000     3.299251425757843\r\n1459284300000000000     3.392203178113466\r\n1459284600000000000     3.359279251866105\r\n1459284900000000000     3.217150725169671\r\n1459285200000000000     3.383973145858318\r\n1459285500000000000     3.2520532857492794\r\n1459285800000000000     3.262755255409653\r\n1459286100000000000     3.1858383025648087\r\n1459286400000000000     3.303823576169274\r\n1459286700000000000     3.2602606388405437\r\n1459287000000000000     3.3168824234054584\r\n1459287300000000000     3.345516673528062\r\n1459287600000000000     3.3700380197046393\r\n1459287900000000000     3.334486536107518\r\n1459288200000000000     3.4712444197574546\r\n1459288500000000000     3.6871278549174007\r\n1459288800000000000     3.7832157623633167\r\n1459289100000000000     3.5756727853472796\r\n1459289400000000000     3.30877900903283\r\n1459289700000000000     3.4020033327159838\r\n1459290000000000000     3.318592838302125\r\n1459290300000000000     3.3159804856277812\r\n1459290600000000000     3.3512863592321307\r\n1459290900000000000     3.4235407971190663\r\n1459291200000000000     3.4895092049862066\r\n1459291500000000000     3.540926032463371\r\n1459291800000000000     3.601479414551974\r\n\r\n\r\nCQ:\r\n==============================================\r\nsiteRoleup CREATE CONTINUOUS QUERY siteRoleup ON serverPerf RESAMPLE EVERY 30s FOR 5m BEGIN SELECT mean(respTime) AS respTime INTO serverPerf.oneyear.site_perf FROM serverPerf.oneyear.respTime GROUP BY time(1m), serverGroup, site END\r\n\r\n\r\nInflux Info:\r\n==============================================\r\nname: build\r\n-----------\r\nBranch  Build Time                      Commit                                          Version\r\nHEAD    2016-02-18T20:44:27.807242      df902a4b077bb270984303b8e4f8a320e3954b40        0.10.1\r\n\r\nname: runtime\r\n-------------\r\nGOARCH  GOMAXPROCS      GOOS    version\r\namd64   16              linux   go1.4.3\r\n\r\nPrebuild package\r\n\r\n\r\nSystem Info:\r\n==============================================\r\nLinux 3.2.0-30-generic #48-Ubuntu SMP Fri Aug 24 16:52:48 UTC 2012 x86_64 x86_64 x86_64 GNU/Linux\r\n\r\nDistributor ID: Ubuntu\r\nDescription:    Ubuntu 12.04.2 LTS\r\nRelease:        12.04\r\nCodename:       precise\r\n\r\n48Gb ram \r\n2x Intel(R) Xeon(R) CPU E5620  @ 2.40GHz\r\n6 drive spinning disk software raid (Raid 10)\r\n\r\n\r\n\r\nInflux conf mostly default.\r\n===============================================\r\n[data]\r\n  enabled = true\r\n  dir = \"/data/influxdb/data\"\r\n  engine = \"tsm1\"\r\n  max-wal-size = 26214400 \r\n  wal-flush-interval = \"3m0s\"\r\n  wal-partition-flush-delay = \"2s\"\r\n  wal-dir = \"/data/influxdb/wal\"\r\n  wal-logging-enabled = true\r\n  wal-ready-series-size = 30720\r\n  wal-compaction-threshold = 0.5\r\n  wal-max-series-size = 1048576\r\n  wal-flush-cold-interval = \"5s\"\r\n  wal-partition-size-threshold = 52428800\r\n  query-log-enabled = true\r\n  cache-max-memory-size = 524288000\r\n  cache-snapshot-memory-size = 26214400\r\n  cache-snapshot-write-cold-duration = \"1h0m0s\"\r\n  compact-full-write-cold-duration = \"24h0m0s\"\r\n  max-points-per-block = 0\r\n  data-logging-enabled = true\r\n\r\n\r\nAny ideas on how to debug this or point out something dumb I am doing would be a huge help."}}
{"actor":{"display_login":"jsternberg"}}