{"action":"created","issue":{"url":"https://api.github.com/repos/google/simian/issues/36","repository_url":"https://api.github.com/repos/google/simian","labels_url":"https://api.github.com/repos/google/simian/issues/36/labels{/name}","comments_url":"https://api.github.com/repos/google/simian/issues/36/comments","events_url":"https://api.github.com/repos/google/simian/issues/36/events","html_url":"https://github.com/google/simian/issues/36","id":156504104,"number":36,"title":"Loading Apple Updates > Catalogue Admin stalls and returns an error","user":{"login":"Rumbles","id":8236882,"avatar_url":"https://avatars.githubusercontent.com/u/8236882?v=3","gravatar_id":"","url":"https://api.github.com/users/Rumbles","html_url":"https://github.com/Rumbles","followers_url":"https://api.github.com/users/Rumbles/followers","following_url":"https://api.github.com/users/Rumbles/following{/other_user}","gists_url":"https://api.github.com/users/Rumbles/gists{/gist_id}","starred_url":"https://api.github.com/users/Rumbles/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Rumbles/subscriptions","organizations_url":"https://api.github.com/users/Rumbles/orgs","repos_url":"https://api.github.com/users/Rumbles/repos","events_url":"https://api.github.com/users/Rumbles/events{/privacy}","received_events_url":"https://api.github.com/users/Rumbles/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":2,"created_at":"2016-05-24T13:15:04Z","updated_at":"2016-09-14T00:48:55Z","closed_at":null,"body":"I installed Simian last week to test it, today I was writing up documentation on how I set it up and the Apple Updates page wouldn't load. In the browser I get:\r\n\r\n```\r\nTraceback (most recent call last):\r\n  File \"/base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/runtime/wsgi.py\", line 267, in Handle\r\n    result = handler(dict(self._environ), self._StartResponse)\r\n  File \"/base/data/home/runtimes/python27/python27_lib/versions/third_party/webapp2-2.5.2/webapp2.py\", line 1529, in __call__\r\n    rv = self.router.dispatch(request, response)\r\n  File \"/base/data/home/runtimes/python27/python27_lib/versions/third_party/webapp2-2.5.2/webapp2.py\", line 1278, in default_dispatcher\r\n    return route.handler_adapter(request, response)\r\n  File \"/base/data/home/runtimes/python27/python27_lib/versions/third_party/webapp2-2.5.2/webapp2.py\", line 1102, in __call__\r\n    return handler.dispatch()\r\n  File \"/base/data/home/runtimes/python27/python27_lib/versions/third_party/webapp2-2.5.2/webapp2.py\", line 570, in dispatch\r\n    return method(*args, **kwargs)\r\n  File \"/base/data/home/apps/e~thefloow-simian/f8bfa254267e.393014033104675667/simian/mac/admin/applesus.py\", line 186, in get\r\n    self._DisplayMain()\r\n  File \"/base/data/home/apps/e~thefloow-simian/f8bfa254267e.393014033104675667/simian/mac/admin/applesus.py\", line 204, in _DisplayMain\r\n    p.testing_promote_date = applesus.GetAutoPromoteDate(common.TESTING, p)\r\n  File \"/base/data/home/apps/e~thefloow-simian/f8bfa254267e.393014033104675667/simian/mac/common/applesus.py\", line 306, in GetAutoPromoteDate\r\n    if not settings.APPLE_AUTO_PROMOTE_ENABLED:\r\n  File \"/base/data/home/apps/e~thefloow-simian/f8bfa254267e.393014033104675667/simian/settings.py\", line 382, in __getattr__\r\n    return self._Get(str(k).lower())\r\n  File \"/base/data/home/apps/e~thefloow-simian/f8bfa254267e.393014033104675667/simian/settings.py\", line 805, in _Get\r\n    item, unused_mtime = self._module.models.Settings.GetItem(k)\r\n  File \"/base/data/home/apps/e~thefloow-simian/f8bfa254267e.393014033104675667/simian/mac/models/settings.py\", line 274, in GetItem\r\n    value, mtime = cls.GetSerializedItem(name)\r\n  File \"/base/data/home/apps/e~thefloow-simian/f8bfa254267e.393014033104675667/simian/mac/models/base.py\", line 734, in GetSerializedItem\r\n    entity = cls.MemcacheWrappedGet(key)\r\n  File \"/base/data/home/apps/e~thefloow-simian/f8bfa254267e.393014033104675667/simian/mac/models/base.py\", line 141, in MemcacheWrappedGet\r\n    cached = memcache.get(memcache_key)\r\n  File \"/base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/api/memcache/__init__.py\", line 560, in get\r\n    results = rpc.get_result()\r\n  File \"/base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/api/apiproxy_stub_map.py\", line 613, in get_result\r\n    return self.__get_result_hook(self)\r\n  File \"/base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/api/memcache/__init__.py\", line 616, in __get_hook\r\n    rpc.check_success()\r\n  File \"/base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/api/apiproxy_stub_map.py\", line 584, in check_success\r\n    self.__stubmap.GetPostCallHooks().Call(self.__service, self.__method,\r\nDeadlineExceededError: The overall deadline for responding to the HTTP request was exceeded.\r\n```\r\n\r\nLooking at this in the AppEngine console, I get the following:\r\n\r\n```\r\nTraceback (most recent call last):\r\n  File \"/base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/runtime/wsgi.py\", line 267, in Handle\r\n    result = handler(dict(self._environ), self._StartResponse)\r\n  File \"/base/data/home/runtimes/python27/python27_lib/versions/third_party/webapp2-2.5.2/webapp2.py\", line 1529, in __call__\r\n    rv = self.router.dispatch(request, response)\r\n  File \"/base/data/home/runtimes/python27/python27_lib/versions/third_party/webapp2-2.5.2/webapp2.py\", line 1278, in default_dispatcher\r\n    return route.handler_adapter(request, response)\r\n  File \"/base/data/home/runtimes/python27/python27_lib/versions/third_party/webapp2-2.5.2/webapp2.py\", line 1102, in __call__\r\n    return handler.dispatch()\r\n  File \"/base/data/home/runtimes/python27/python27_lib/versions/third_party/webapp2-2.5.2/webapp2.py\", line 570, in dispatch\r\n    return method(*args, **kwargs)\r\n  File \"/base/data/home/apps/e~thefloow-simian/f8bfa254267e.393014033104675667/simian/mac/admin/applesus.py\", line 186, in get\r\n    self._DisplayMain()\r\n  File \"/base/data/home/apps/e~thefloow-simian/f8bfa254267e.393014033104675667/simian/mac/admin/applesus.py\", line 204, in _DisplayMain\r\n    p.testing_promote_date = applesus.GetAutoPromoteDate(common.TESTING, p)\r\n  File \"/base/data/home/apps/e~thefloow-simian/f8bfa254267e.393014033104675667/simian/mac/common/applesus.py\", line 306, in GetAutoPromoteDate\r\n    if not settings.APPLE_AUTO_PROMOTE_ENABLED:\r\n  File \"/base/data/home/apps/e~thefloow-simian/f8bfa254267e.393014033104675667/simian/settings.py\", line 382, in __getattr__\r\n    return self._Get(str(k).lower())\r\n  File \"/base/data/home/apps/e~thefloow-simian/f8bfa254267e.393014033104675667/simian/settings.py\", line 805, in _Get\r\n    item, unused_mtime = self._module.models.Settings.GetItem(k)\r\n  File \"/base/data/home/apps/e~thefloow-simian/f8bfa254267e.393014033104675667/simian/mac/models/settings.py\", line 274, in GetItem\r\n    value, mtime = cls.GetSerializedItem(name)\r\n  File \"/base/data/home/apps/e~thefloow-simian/f8bfa254267e.393014033104675667/simian/mac/models/base.py\", line 734, in GetSerializedItem\r\n    entity = cls.MemcacheWrappedGet(key)\r\n  File \"/base/data/home/apps/e~thefloow-simian/f8bfa254267e.393014033104675667/simian/mac/models/base.py\", line 141, in MemcacheWrappedGet\r\n    cached = memcache.get(memcache_key)\r\n  File \"/base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/api/memcache/__init__.py\", line 560, in get\r\n    results = rpc.get_result()\r\n  File \"/base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/api/apiproxy_stub_map.py\", line 613, in get_result\r\n    return self.__get_result_hook(self)\r\n  File \"/base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/api/memcache/__init__.py\", line 616, in __get_hook\r\n    rpc.check_success()\r\n  File \"/base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/api/apiproxy_stub_map.py\", line 577, in check_success\r\n    self.wait()\r\n  File \"/base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/api/apiproxy_stub_map.py\", line 556, in wait\r\n    assert self.__rpc.state == apiproxy_rpc.RPC.FINISHING, repr(self.state)\r\nDeadlineExceededError: The overall deadline for responding to the HTTP request was exceeded.\r\n```\r\n\r\nOn one of the errors I've managed to generate in AppEngine I got the following (none of the others I have seen reported this):\r\n\r\n```\r\nThis request caused a new process to be started for your application, and thus caused your application code to be loaded for the first time. This request may thus take longer and use more CPU than a typical request for your application.\r\n```\r\n\r\nI've waited over an hour for this code to finish running, but it still loads the same/similar error.\r\n\r\nWhen I first ran in to this issue, I did try running `make release` again just in case something was wrong with my deployment, but I get the same issue. I checked I was on the latest branch at the time."},"comment":{"url":"https://api.github.com/repos/google/simian/issues/comments/246872607","html_url":"https://github.com/google/simian/issues/36#issuecomment-246872607","issue_url":"https://api.github.com/repos/google/simian/issues/36","id":246872607,"user":{"login":"aryanet","id":384293,"avatar_url":"https://avatars.githubusercontent.com/u/384293?v=3","gravatar_id":"","url":"https://api.github.com/users/aryanet","html_url":"https://github.com/aryanet","followers_url":"https://api.github.com/users/aryanet/followers","following_url":"https://api.github.com/users/aryanet/following{/other_user}","gists_url":"https://api.github.com/users/aryanet/gists{/gist_id}","starred_url":"https://api.github.com/users/aryanet/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/aryanet/subscriptions","organizations_url":"https://api.github.com/users/aryanet/orgs","repos_url":"https://api.github.com/users/aryanet/repos","events_url":"https://api.github.com/users/aryanet/events{/privacy}","received_events_url":"https://api.github.com/users/aryanet/received_events","type":"User","site_admin":false},"created_at":"2016-09-14T00:48:54Z","updated_at":"2016-09-14T00:48:54Z","body":"I am having the same problem and I experience what Rumbles is saying. I also get the following stack trace during preflight --debug run:\r\n\r\nDEBUG:root:MunkiDownloadError getting Apple SUS catalog: HTTP result 404: not found\r\nTraceback (most recent call last):\r\n  File \"/usr/local/munki/simian/lib/python2.7/site-packages/simian-2.4-py2.7.egg/simian/mac/client/flight_common.py\", line 538, in GetAppleSUSCatalog\r\n    '%s/applesus/' % url, APPLE_SUS_CATALOG)\r\n  File \"/usr/local/munki/munkilib/updatecheck.py\", line 3519, in getResourceIfChangedAtomically\r\n    verify=verify)\r\n  File \"/usr/local/munki/munkilib/fetch.py\", line 300, in getResourceIfChangedAtomically\r\n    message=message, resume=resume, follow_redirects=follow_redirects)\r\n  File \"/usr/local/munki/munkilib/fetch.py\", line 413, in getHTTPfileIfChangedAtomically\r\n    raise GurlDownloadError(err)\r\nGurlDownloadError: HTTP result 404: not found"}}
{"actor":{"display_login":"aryanet"}}