{"action":"created","issue":{"url":"https://api.github.com/repos/prometheus/prometheus/issues/3799","repository_url":"https://api.github.com/repos/prometheus/prometheus","labels_url":"https://api.github.com/repos/prometheus/prometheus/issues/3799/labels{/name}","comments_url":"https://api.github.com/repos/prometheus/prometheus/issues/3799/comments","events_url":"https://api.github.com/repos/prometheus/prometheus/issues/3799/events","html_url":"https://github.com/prometheus/prometheus/issues/3799","id":294362544,"number":3799,"title":"Prometheus 2.x inconsistent results through the time","user":{"login":"onorua","id":407040,"avatar_url":"https://avatars2.githubusercontent.com/u/407040?v=4","gravatar_id":"","url":"https://api.github.com/users/onorua","html_url":"https://github.com/onorua","followers_url":"https://api.github.com/users/onorua/followers","following_url":"https://api.github.com/users/onorua/following{/other_user}","gists_url":"https://api.github.com/users/onorua/gists{/gist_id}","starred_url":"https://api.github.com/users/onorua/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/onorua/subscriptions","organizations_url":"https://api.github.com/users/onorua/orgs","repos_url":"https://api.github.com/users/onorua/repos","events_url":"https://api.github.com/users/onorua/events{/privacy}","received_events_url":"https://api.github.com/users/onorua/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":4,"created_at":"2018-02-05T11:37:37Z","updated_at":"2018-02-05T14:34:30Z","closed_at":"2018-02-05T14:34:30Z","author_association":"NONE","body":"**What did you do?**\r\nI do query:\r\n```\r\ncurl 'http://prometheus-nodes-ca-ovh.afdevops.com:9090/api/v1/query?query=packetsByRange&start=2018-01-31T00:48:48Z&end=2018-01-31T01:18:48Z&step=30m'\r\n```\r\n\r\n**What did you expect to see?**\r\nI expect result to be consistent, values should be either exists or does not exists all the time, because  `start` and `stop` times never changed in the query.\r\n\r\n**What did you see instead? Under which circumstances?**\r\nI've got following:\r\n```\r\nMBP13:ansible-prometheus onorua$ curl 'http://prometheus-nodes-ca-ovh.afdevops.com:9090/api/v1/01-31T01:18:48Z&step=30m'e&start=2018-01-31T00:48:48Z&end=2018-0\r\n{\"status\":\"success\",\"data\":{\"resultType\":\"vector\",\"result\":[]}}\r\nMBP13:ansible-prometheus onorua$ curl 'http://prometheus-nodes-ca-ovh.afdevops.com:9090/api/v1/01-31T01:18:48Z&step=30m'e&start=2018-01-31T00:48:48Z&end=2018-0\r\n{\"status\":\"success\",\"data\":{\"resultType\":\"vector\",\"result\":[]}}\r\nMBP13:ansible-prometheus onorua$ curl 'http://prometheus-nodes-ca-ovh.afdevops.com:9090/api/v1/01-31T01:18:48Z&step=30m'e&start=2018-01-31T00:48:48Z&end=2018-0\r\n{\"status\":\"success\",\"data\":{\"resultType\":\"vector\",\"result\":[]}}\r\nMBP13:ansible-prometheus onorua$ curl 'http://prometheus-nodes-ca-ovh.afdevops.com:9090/api/v1/01-31T01:18:48Z&step=30m'e&start=2018-01-31T00:48:48Z&end=2018-0\r\n{\"status\":\"success\",\"data\":{\"resultType\":\"vector\",\"result\":[{\"metric\":{\"__name__\":\"packetsByRange\",\"cluster\":\"checker-ny-1\",\"colo\":\"checker\",\"colo_type\":\"ny\",\"container_name\":\"node-exporter\",\"h\":\"23b6789\",\"host_name\":\"abhi-checker-ny-1\",\"host_type\":\"abhi-checker-ny\",\"instance\":\r\n ...\r\n```\r\nImportant thing is, this metric is not regular, there is some tool Im not aware of which has metrics for 5 minutes and then 5 minutes there is no metrics:\r\n<img width=\"1244\" alt=\"screen shot 2018-01-31 at 5 33 12 pm\" src=\"https://user-images.githubusercontent.com/407040/35802599-69f2d5b0-0a79-11e8-9616-ac51aa4f1975.png\">\r\n\r\n\r\n**Environment**\r\ndockerized Prometheus 2.1.0\r\n\r\n* System information:\r\n```\r\nroot@prometheus-nodes-ca-ovh:~# uname -srm\r\nLinux 4.8.0-42-generic x86_64\r\n```\r\n\r\n* Prometheus version:\r\n\r\n```\r\nprometheus, version 2.1.0 (branch: HEAD, revision: 85f23d82a045d103ea7f3c89a91fba4a93e6367a)\r\n  build user:       root@6e784304d3ff\r\n  build date:       20180119-12:01:23\r\n  go version:       go1.9.2\r\n```\r\n\r\n* Prometheus configuration file:\r\n```\r\n      - '--config.file=/etc/prometheus/prometheus.yml'\r\n      - '--storage.tsdb.path=/prometheus'\r\n      - '--storage.tsdb.retention=31d'\r\n      - '--web.enable-admin-api'\r\n      - '--storage.tsdb.max-block-duration=1d'\r\n      - '--storage.tsdb.min-block-duration=2h'\r\n```\r\n\r\nconfig:\r\n```\r\nglobal:\r\n  scrape_interval: 30s\r\n  scrape_timeout: 20s\r\n  evaluation_interval: 30s\r\n  external_labels:\r\n    prometheus: node\r\nalerting:\r\n  alertmanagers:\r\n  - consul_sd_configs:\r\n    - server: localhost:8500\r\n      tag_separator: ','\r\n      scheme: http\r\n      services:\r\n      - alertmanager\r\n    scheme: http\r\n    timeout: 10s\r\nrule_files:\r\n- /etc/prometheus/hss_recording.rules.yml\r\n- /etc/prometheus/hss_alert.rules.yml\r\n- /etc/prometheus/comscore_alert.rules.yml\r\n- /etc/prometheus/css_alert.rules.yml\r\n- /etc/prometheus/prometheus_alert.rules.yml\r\n- /etc/prometheus/satellite_alert.rules.yml\r\n- /etc/prometheus/efk_alert.rules.yml\r\n- /etc/prometheus/recording.rules.yml\r\n- /etc/prometheus/consul.rules.yml\r\n- /etc/prometheus/storage_alert.rules.yml\r\n- /etc/prometheus/bastion_alert.rules.yml\r\nscrape_configs:\r\n- job_name: efk-services\r\n  scrape_interval: 30s\r\n  scrape_timeout: 20s\r\n  metrics_path: /metrics\r\n  scheme: http\r\n  consul_sd_configs:\r\n  - server: localhost:8500\r\n    tag_separator: ','\r\n    scheme: http\r\n    services:\r\n    - node-exporter\r\n```\r\n\r\n* Logs:\r\nnothing related to this "},"comment":{"url":"https://api.github.com/repos/prometheus/prometheus/issues/comments/363101824","html_url":"https://github.com/prometheus/prometheus/issues/3799#issuecomment-363101824","issue_url":"https://api.github.com/repos/prometheus/prometheus/issues/3799","id":363101824,"user":{"login":"onorua","id":407040,"avatar_url":"https://avatars2.githubusercontent.com/u/407040?v=4","gravatar_id":"","url":"https://api.github.com/users/onorua","html_url":"https://github.com/onorua","followers_url":"https://api.github.com/users/onorua/followers","following_url":"https://api.github.com/users/onorua/following{/other_user}","gists_url":"https://api.github.com/users/onorua/gists{/gist_id}","starred_url":"https://api.github.com/users/onorua/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/onorua/subscriptions","organizations_url":"https://api.github.com/users/onorua/orgs","repos_url":"https://api.github.com/users/onorua/repos","events_url":"https://api.github.com/users/onorua/events{/privacy}","received_events_url":"https://api.github.com/users/onorua/received_events","type":"User","site_admin":false},"created_at":"2018-02-05T14:34:30Z","updated_at":"2018-02-05T14:34:30Z","author_association":"NONE","body":"Im really sorry to bother, it seems my colleague convinced me that the query is correct, while the proper one should be:\r\n```\r\nhttp://prometheus-nodes-ca-ovh.afdevops.com:9090/api/v1/query_range?query=packetsByRange&start=1517833500.684&end=1517840700.684&step=28\r\n```\r\n\r\nclosing as invalid. "}}
{"actor":{"display_login":"onorua"}}