{"action":"opened","issue":{"url":"https://api.github.com/repos/yandex/ClickHouse/issues/2621","repository_url":"https://api.github.com/repos/yandex/ClickHouse","labels_url":"https://api.github.com/repos/yandex/ClickHouse/issues/2621/labels{/name}","comments_url":"https://api.github.com/repos/yandex/ClickHouse/issues/2621/comments","events_url":"https://api.github.com/repos/yandex/ClickHouse/issues/2621/events","html_url":"https://github.com/yandex/ClickHouse/issues/2621","id":339747535,"node_id":"MDU6SXNzdWUzMzk3NDc1MzU=","number":2621,"title":"[MV] неполные данные","user":{"login":"urykhy","id":1411834,"node_id":"MDQ6VXNlcjE0MTE4MzQ=","avatar_url":"https://avatars1.githubusercontent.com/u/1411834?v=4","gravatar_id":"","url":"https://api.github.com/users/urykhy","html_url":"https://github.com/urykhy","followers_url":"https://api.github.com/users/urykhy/followers","following_url":"https://api.github.com/users/urykhy/following{/other_user}","gists_url":"https://api.github.com/users/urykhy/gists{/gist_id}","starred_url":"https://api.github.com/users/urykhy/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/urykhy/subscriptions","organizations_url":"https://api.github.com/users/urykhy/orgs","repos_url":"https://api.github.com/users/urykhy/repos","events_url":"https://api.github.com/users/urykhy/events{/privacy}","received_events_url":"https://api.github.com/users/urykhy/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2018-07-10T08:45:36Z","updated_at":"2018-07-10T08:45:36Z","closed_at":null,"author_association":"NONE","body":"версия: 1.1.54385\r\nZK: 3.5.2\r\n\r\nпосле обновления - появилось расхождение между таблицей и MV:\r\nпроверочный запрос:\r\n```sql\r\nSELECT date, h, shows1, shows2\r\nFROM\r\n  (SELECT date, toHour(timestamp) as h, sum(ev_type = 0) AS shows1\r\n   FROM events_local\r\n   WHERE date BETWEEN '2018-07-09' AND '2018-07-10'\r\n   GROUP BY date, h) \r\nANY LEFT JOIN\r\n  (SELECT date, toHour(timestamp) as h, sumIf(count, event_type = 0) AS shows2\r\n   FROM hour_banner_events_local\r\n   WHERE date BETWEEN '2018-07-09' AND '2018-07-10'\r\n   GROUP BY date, h)\r\nUSING date, h\r\nWHERE shows1 != shows2\r\norder by date, h asc\r\n```\r\ndate |h|shows1|shows2\r\n-------|--|------|------\r\n10/07/18 | 8 | 19,603,645 | 19,481,276 |\r\n* в основной таблице (events_local) - данные корректны\r\n* в MV (hour_banner_events_local) - отсутствует часть данных\r\n* расхождения есть не каждый час\r\n* программа заливающая данные периодически получает 500, после чего повторяет попытку загрузки данных.\r\n* в CH есть ошибки вида {{2018.07.10 08:22:35: ZooKeeper session has been expired.: while pushing to view hour_banner_events_local}}.\r\n* в графите сильно выросли ZooKeeperExceptions: ![image](https://user-images.githubusercontent.com/1411834/42498724-a25749b4-8435-11e8-96de-d863b06e5b6c.png)\r\n"}}
{"actor":{"display_login":"urykhy"}}