{"action":"opened","issue":{"url":"https://api.github.com/repos/druid-io/druid/issues/3564","repository_url":"https://api.github.com/repos/druid-io/druid","labels_url":"https://api.github.com/repos/druid-io/druid/issues/3564/labels{/name}","comments_url":"https://api.github.com/repos/druid-io/druid/issues/3564/comments","events_url":"https://api.github.com/repos/druid-io/druid/issues/3564/events","html_url":"https://github.com/druid-io/druid/issues/3564","id":182701869,"number":3564,"title":"kafka tasks keep running for a long time","user":{"login":"misslzyan","id":17558850,"avatar_url":"https://avatars.githubusercontent.com/u/17558850?v=3","gravatar_id":"","url":"https://api.github.com/users/misslzyan","html_url":"https://github.com/misslzyan","followers_url":"https://api.github.com/users/misslzyan/followers","following_url":"https://api.github.com/users/misslzyan/following{/other_user}","gists_url":"https://api.github.com/users/misslzyan/gists{/gist_id}","starred_url":"https://api.github.com/users/misslzyan/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/misslzyan/subscriptions","organizations_url":"https://api.github.com/users/misslzyan/orgs","repos_url":"https://api.github.com/users/misslzyan/repos","events_url":"https://api.github.com/users/misslzyan/events{/privacy}","received_events_url":"https://api.github.com/users/misslzyan/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2016-10-13T05:54:36Z","updated_at":"2016-10-13T05:54:36Z","closed_at":null,"body":"I use tranquility push kafka task to indexing service. the config is befor:\r\n \"granularitySpec\": {\r\n        \"type\": \"uniform\",\r\n        \"segmentGranularity\": \"minute\",\r\n        \"queryGranularity\": \"minute\"\r\n      }\r\n\r\n\r\n\"tuningConfig\": {\r\n          \"type\": \"realtime\", \r\n          \"maxRowsInMemory\": \"75000\", \r\n          \"intermediatePersistPeriod\": \"PT1M\", \r\n          \"windowPeriod\": \"PT1M\"\r\n        }\r\n\r\n\r\nbut the task keep running for more than two hours .\r\nthe log is before:\r\n\r\n\r\n2016-10-13T05:49:00,029 INFO [p4pData-overseer-0] io.druid.segment.realtime.plumber.RealtimePlumber - Starting merge and push.\r\n2016-10-13T05:49:00,029 INFO [p4pData-overseer-0] io.druid.segment.realtime.plumber.RealtimePlumber - Found [1] segments. Attempting to hand off segments that start before [1970-01-01T00:00:00.000Z].\r\n2016-10-13T05:49:00,029 INFO [p4pData-overseer-0] io.druid.segment.realtime.plumber.RealtimePlumber - Skipping persist and merge for entry [1476329760000=Sink{interval=2016-10-13T03:36:00.000Z/2016-10-13T03:37:00.000Z, schema=DataSchema{dataSource='p4pData', parser={type=map, parseSpec={format=json, timestampSpec={column=timestamp, format=millis, missingValue=null}, dimensionsSpec={dimensions=[userId, adPlanId, schedulingId, ideaId, costType, provCode, cityCode, os, diviceType, clientType], spatialDimensions=[]}}}, aggregators=[HyperUniquesAggregatorFactory{name='userIdCount', fieldName='userIdCount'}, LongSumAggregatorFactory{fieldName='count', name='count'}, LongSumAggregatorFactory{fieldName='costSum', name='costSum'}, LongSumAggregatorFactory{fieldName='showCount', name='showCount'}, LongSumAggregatorFactory{fieldName='clickCount', name='clickCount'}], granularitySpec=io.druid.segment.indexing.granularity.UniformGranularitySpec@35dd4fba}}] : Start time [2016-10-13T03:36:00.000Z] >= [1970-01-01T00:00:00.000Z] min timestamp required in this run. Segment will be picked up in a future run.\r\n2016-10-13T05:49:00,029 INFO [p4pData-overseer-0] io.druid.segment.realtime.plumber.RealtimePlumber - Found [0] sinks to persist and merge\r\n"}}
{"actor":{"display_login":"misslzyan"}}