{"action":"created","issue":{"url":"https://api.github.com/repos/e-mission/e-mission-docs/issues/289","repository_url":"https://api.github.com/repos/e-mission/e-mission-docs","labels_url":"https://api.github.com/repos/e-mission/e-mission-docs/issues/289/labels{/name}","comments_url":"https://api.github.com/repos/e-mission/e-mission-docs/issues/289/comments","events_url":"https://api.github.com/repos/e-mission/e-mission-docs/issues/289/events","html_url":"https://github.com/e-mission/e-mission-docs/issues/289","id":408958888,"node_id":"MDU6SXNzdWU0MDg5NTg4ODg=","number":289,"title":"Pipeline Stopped Working","user":{"login":"trevor-wu","id":35517530,"node_id":"MDQ6VXNlcjM1NTE3NTMw","avatar_url":"https://avatars1.githubusercontent.com/u/35517530?v=4","gravatar_id":"","url":"https://api.github.com/users/trevor-wu","html_url":"https://github.com/trevor-wu","followers_url":"https://api.github.com/users/trevor-wu/followers","following_url":"https://api.github.com/users/trevor-wu/following{/other_user}","gists_url":"https://api.github.com/users/trevor-wu/gists{/gist_id}","starred_url":"https://api.github.com/users/trevor-wu/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/trevor-wu/subscriptions","organizations_url":"https://api.github.com/users/trevor-wu/orgs","repos_url":"https://api.github.com/users/trevor-wu/repos","events_url":"https://api.github.com/users/trevor-wu/events{/privacy}","received_events_url":"https://api.github.com/users/trevor-wu/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":5,"created_at":"2019-01-18T06:27:27Z","updated_at":"2019-02-28T18:49:29Z","closed_at":null,"author_association":"NONE","body":"![screenshot_20190117-221735](https://user-images.githubusercontent.com/35517530/51368885-1c1bfb80-1aa6-11e9-8686-3f5d73a981f0.png)\r\nThe pipeline is not running on my version of the application. For example an entry from my .timeline dump is missing mode inferences.\r\nMy .timeline output for \"data\" looks like:\r\n`\"data\": {\r\n      \"name\": \"USERCACHE\",\r\n      \"ts\": 1547712006.598315,\r\n      \"reading\": 0.02276834473013878\r\n    }`\r\nwhile the .timeline output for someone else looks like:\r\n`\"data\": {\r\n      \"unknown\": false,\r\n      \"confidence\": 100,\r\n      \"local_dt\": {\r\n        \"minute\": 0,\r\n        \"hour\": 0,\r\n        \"second\": 20,\r\n        \"day\": 15,\r\n        \"weekday\": 1,\r\n        \"month\": 1,\r\n        \"timezone\": \"America/Los_Angeles\",\r\n        \"year\": 2019\r\n      },\r\n      \"automotive\": false,\r\n      \"cycling\": false,\r\n      \"stationary\": false,\r\n      \"running\": false,\r\n      \"type\": 9,\r\n      \"fmt_time\": \"2019-01-15T00:00:20.018576-08:00\",\r\n      \"confidence_level\": \"high\",\r\n      \"ts\": 1547539220.0185764,\r\n      \"walking\": false\r\n    }`\r\n\r\n"},"comment":{"url":"https://api.github.com/repos/e-mission/e-mission-docs/issues/comments/468390894","html_url":"https://github.com/e-mission/e-mission-docs/issues/289#issuecomment-468390894","issue_url":"https://api.github.com/repos/e-mission/e-mission-docs/issues/289","id":468390894,"node_id":"MDEyOklzc3VlQ29tbWVudDQ2ODM5MDg5NA==","user":{"login":"ecvick85","id":35542495,"node_id":"MDQ6VXNlcjM1NTQyNDk1","avatar_url":"https://avatars0.githubusercontent.com/u/35542495?v=4","gravatar_id":"","url":"https://api.github.com/users/ecvick85","html_url":"https://github.com/ecvick85","followers_url":"https://api.github.com/users/ecvick85/followers","following_url":"https://api.github.com/users/ecvick85/following{/other_user}","gists_url":"https://api.github.com/users/ecvick85/gists{/gist_id}","starred_url":"https://api.github.com/users/ecvick85/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ecvick85/subscriptions","organizations_url":"https://api.github.com/users/ecvick85/orgs","repos_url":"https://api.github.com/users/ecvick85/repos","events_url":"https://api.github.com/users/ecvick85/events{/privacy}","received_events_url":"https://api.github.com/users/ecvick85/received_events","type":"User","site_admin":false},"created_at":"2019-02-28T18:49:29Z","updated_at":"2019-02-28T18:49:29Z","author_association":"NONE","body":"Trevor sent me his logs from 1/31 - current date (all uncleaned trips). From\r\n[https://github.com/e-mission/e-mission-docs/blob/a7d650349583f0dd35bfd7edf55bca784491f413/docs/e-mission-phone/troubleshooting_tips_faq.md#L134](url)\r\nI was able to add date/time to his trips (but it didn't matter because none were cleaned).\r\n\r\nLooking at the prior bugs (#283), I looked into webserver.log for Trevor's trips. Here's a section of the logs with Trevor's UID (I replaced his UID with fe1ca... and deleted the token list)\r\n\r\n```\r\n2019-02-28 03:24:45,934:DEBUG:140373085918976:START POST /timeline/getTrips/2019-02-27\r\n2019-02-28 03:24:45,934:DEBUG:140373043955456:methodName = token_list, returning <class 'emission.net.auth.token_list.TokenListMethod'>\r\n2019-02-28 03:24:45,934:DEBUG:140373085918976:Called timeline.getTrips/2019-02-27\r\n2019-02-28 03:24:45,935:DEBUG:140373085918976:methodName = token_list, returning <class 'emission.net.auth.token_list.TokenListMethod'>\r\n2019-02-28 03:24:45,935:DEBUG:140373043955456:Using the TokenListMethod to verify id token ... of length 8 against list [...]...\r\n2019-02-28 03:24:45,935:DEBUG:140373043955456:Found match for token GjgJfa8p of length 8\r\n2019-02-28 03:24:45,935:DEBUG:140373085918976:Using the TokenListMethod to verify id token ... of length 8 against list ['...']...\r\n2019-02-28 03:24:45,936:DEBUG:140373085918976:Found match for token GjgJfa8p of length 8\r\n2019-02-28 03:24:45,936:DEBUG:140373043955456:retUUID = fe1ca...\r\n2019-02-28 03:24:45,937:DEBUG:140373085918976:retUUID = fe1ca...\r\n2019-02-28 03:24:45,937:DEBUG:140373085918976:user_uuid fe1ca...\r\n2019-02-28 03:24:45,937:DEBUG:140373085918976:Getting geojson for LocalDate({'year': 2019, 'month': 2, 'day': 27}) -> LocalDate({'year': 2019, 'month': 2, 'day': 27})\r\n2019-02-28 03:24:45,937:INFO:140373085918976:About to query for date components LocalDate({'year': 2019, 'month': 2, 'day': 27}) -> LocalDate({'year': 2019, 'month': 2, 'day': 27})\r\n2019-02-28 03:24:45,937:DEBUG:140373085918976:for user fe1ca..., returning timeseries <emission.storage.timeseries.builtin_timeseries.BuiltinTimeSeries object at 0x7fab0568aef0>\r\n2019-02-28 03:24:45,938:DEBUG:140373085918976:In get_range_query, returning query {'data.enter_local_dt.year': {'$gte': 2019, '$lte': 2019}, 'data.enter_local_dt.month': {'$gte': 2, '$lte': 2}, 'data.enter_local_dt.day': {'$gte': 27, '$lte': 27}}\r\n2019-02-28 03:24:45,938:DEBUG:140373085918976:curr_query = {'invalid': {'$exists': False}, 'user_id': UUID('fe1ca...'), '$or': [{'metadata.key': 'analysis/cleaned_place'}], 'data.enter_local_dt.year': {'$gte': 2019, '$lte': 2019}, 'data.enter_local_dt.month': {'$gte': 2, '$lte': 2}, 'data.enter_local_dt.day': {'$gte': 27, '$lte': 27}}, sort_key = data.enter_ts\r\n2019-02-28 03:24:45,938:DEBUG:140373085918976:orig_ts_db_keys = [], analysis_ts_db_keys = ['analysis/cleaned_place']\r\n2019-02-28 03:24:45,945:DEBUG:140373043955456:Returning complete_ts = None\r\n2019-02-28 03:24:45,945:DEBUG:140373043955456:END POST /pipeline/get_complete_ts fe1ca... 0.011472463607788086\r\n```\r\nComparing his trips to one from a user with a working pipeline, I noticed after his `START POST`\r\nhe doesn't have any calls to `/usercache/get` or '/usercache/put' like working pipeline users do (example of what working pipeline user's logs look like after `START POST` below). He only has calls to `/result/metrics/timestamp` and `/profile/update`. Could this be a problem?\r\n\r\n```\r\n2019-02-28 03:55:41,412:DEBUG:140373052348160:START POST /usercache/get\r\n2019-02-28 03:55:41,413:DEBUG:140373052348160:Called userCache.get\r\n...\r\n2019-02-28 03:50:01,470:DEBUG:140373077526272:START POST /usercache/put\r\n2019-02-28 03:50:01,470:DEBUG:140373077526272:Called userCache.put\r\n```\r\n\r\nAlso, from what I found (pattern matching with the rest of the groups trips), Trevor doesn't have any lines associated with his uid like these (example from a user, replaced UID with ---, with working pipeline logs)\r\n\r\n```\r\n2019-02-28 03:50:01,708:DEBUG:140373077526272:Updated result for user = ---, key = background/motion_activity, write_ts = 1550688571.7149563 = {'n': 1, 'nModified': 0, 'ok': 1.0, 'updatedExisting': True}\r\n...\r\n2019-02-28 03:50:01,590:DEBUG:140373077526272:Updated result for user = ---, key = background/battery, write_ts = 1551325798.4757938 = {'n': 1, 'nModified': 0, 'upserted': ObjectId('5c775a69a73047157069c6ca'), 'ok': 1.0, 'updatedExisting': False}\r\n```\r\n\r\nI think that these are just background data of points on trips (please correct me if I am incorrect) - interesting that Trevor doesn't seem to have any in the logs.\r\n\r\nLastly, I looked at the query for his inferred trips (which don't exist) - and can be seen as nonexistent in the code too.\r\n\r\n```\r\n2019-02-28 03:22:59,217:DEBUG:140373052348160:curr_query = {'invalid': {'$exists': False}, 'user_id': UUID('fe1ca...'), '$or': [{'metadata.key': 'analysis/inferred_section'}], 'data.start_ts': {'$lte': 1551225600, '$gte': 1550102400}}, sort_key = data.start_ts\r\n```\r\n\r\nIf you have any advice in log reading or anything stands out to you as being problematic that I missed - any help would be greatly appreciated.\r\n"}}
{"actor":{"display_login":"ecvick85"}}