{"action":"created","issue":{"url":"https://api.github.com/repos/thumbor/thumbor/issues/1102","repository_url":"https://api.github.com/repos/thumbor/thumbor","labels_url":"https://api.github.com/repos/thumbor/thumbor/issues/1102/labels{/name}","comments_url":"https://api.github.com/repos/thumbor/thumbor/issues/1102/comments","events_url":"https://api.github.com/repos/thumbor/thumbor/issues/1102/events","html_url":"https://github.com/thumbor/thumbor/issues/1102","id":346097245,"node_id":"MDU6SXNzdWUzNDYwOTcyNDU=","number":1102,"title":"Upgrading from 6.4.1 to 6.5.1 impacts response time and cpu usage","user":{"login":"marceloboeira","id":1898225,"node_id":"MDQ6VXNlcjE4OTgyMjU=","avatar_url":"https://avatars3.githubusercontent.com/u/1898225?v=4","gravatar_id":"","url":"https://api.github.com/users/marceloboeira","html_url":"https://github.com/marceloboeira","followers_url":"https://api.github.com/users/marceloboeira/followers","following_url":"https://api.github.com/users/marceloboeira/following{/other_user}","gists_url":"https://api.github.com/users/marceloboeira/gists{/gist_id}","starred_url":"https://api.github.com/users/marceloboeira/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/marceloboeira/subscriptions","organizations_url":"https://api.github.com/users/marceloboeira/orgs","repos_url":"https://api.github.com/users/marceloboeira/repos","events_url":"https://api.github.com/users/marceloboeira/events{/privacy}","received_events_url":"https://api.github.com/users/marceloboeira/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":2,"created_at":"2018-07-31T09:02:09Z","updated_at":"2018-08-01T07:12:58Z","closed_at":null,"author_association":"CONTRIBUTOR","body":"We have upgraded our docker image from thumbor `6.4.1` to `6.5.1` yesterday. Both CPU and response time are increasing considerably ever since, that's the only change that happened.\r\n\r\n### Expected behaviour\r\nNothing should dramatically change...\r\n\r\n### Actual behaviour\r\nBoth CPU usage and response-time went up considerably.\r\n\r\n<img width=\"621\" alt=\"screen shot 2018-07-31 at 11 00 11\" src=\"https://user-images.githubusercontent.com/1898225/43449527-f129c8f6-94b0-11e8-8736-e7fe053190ac.png\">\r\n\r\n* Orange - time to fetch \r\n* Blue - p95 of response time\r\n* Yellow dashed - Max response time \r\n* Red - deployment (first ones to upgrade, second one to downgrade)\r\n\r\nOnce I've downgraded back to 6.4.1 the response time went down again...\r\n\r\n<img width=\"628\" alt=\"screen shot 2018-07-31 at 10 19 44\" src=\"https://user-images.githubusercontent.com/1898225/43447715-5c625d72-94ac-11e8-9b49-b464fd5ac4e8.png\">\r\n\r\n* CPU Usage per pod after the deployments... \r\n\r\nThe spike matches the deployment time, the CPU usage went down over night because of the less intensive traffic but the response time was still higher (1.5x) the one before.  \r\n\r\n### Operating system\r\nUbuntu 16.04 on K8s\r\n\r\n### Your thumbor.conf\r\n```\r\n    import re\r\n\r\n    ALLOWED_SOURCES=[\r\n      # https://regexper.com/https://regexper.com/#^https:\\/\\/*(.+)?hey[.]car\\/*(.+)\r\n      re.compile(r'^https://*(.+)?hey[.]car/*(.+)'),\r\n    ]\r\n\r\n    MAX_SOURCE_SIZE = 500\r\n    SECURITY_KEY = \"REDACTED\"\r\n    MAX_WIDTH = 2000\r\n    MAX_HEIGHT = 2000\r\n\r\n    # Cache\r\n    MAX_AGE = 365 * 24 * 60 * 60\r\n    MAX_AGE_TEMP_IMAGE = 240\r\n\r\n    # Defaults\r\n    QUALITY = 100\r\n\r\n    # Engines\r\n    HTTP_LOADER_CURL_ASYNC_HTTP_CLIENT = True\r\n\r\n    # Metrics\r\n    METRICS = \"thumbor.metrics.statsd_metrics\"\r\n    STATSD_PORT = 8125\r\n    STATSD_HOST = \"datadog-statsd.kube-system\"\r\n    STATSD_PREFIX = \"image_proxy_service\"\r\n\r\n    # GC Options\r\n    GC_INTERVAL = 1800\r\n\r\n    # AutoWebp\r\n    AUTO_WEBP = True\r\n\r\n    # Sentry\r\n    ERROR_HANDLER_MODULE = \"thumbor.error_handlers.sentry\"\r\n    SENTRY_DSN = \"REDACTED\"\r\n```\r\n\r\nAny thoughts on what could've caused this? Is there any new config that I need to take into account when upgrading? I've been reading the changelog and haven't found anything clearly related to that."},"comment":{"url":"https://api.github.com/repos/thumbor/thumbor/issues/comments/409473869","html_url":"https://github.com/thumbor/thumbor/issues/1102#issuecomment-409473869","issue_url":"https://api.github.com/repos/thumbor/thumbor/issues/1102","id":409473869,"node_id":"MDEyOklzc3VlQ29tbWVudDQwOTQ3Mzg2OQ==","user":{"login":"marceloboeira","id":1898225,"node_id":"MDQ6VXNlcjE4OTgyMjU=","avatar_url":"https://avatars3.githubusercontent.com/u/1898225?v=4","gravatar_id":"","url":"https://api.github.com/users/marceloboeira","html_url":"https://github.com/marceloboeira","followers_url":"https://api.github.com/users/marceloboeira/followers","following_url":"https://api.github.com/users/marceloboeira/following{/other_user}","gists_url":"https://api.github.com/users/marceloboeira/gists{/gist_id}","starred_url":"https://api.github.com/users/marceloboeira/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/marceloboeira/subscriptions","organizations_url":"https://api.github.com/users/marceloboeira/orgs","repos_url":"https://api.github.com/users/marceloboeira/repos","events_url":"https://api.github.com/users/marceloboeira/events{/privacy}","received_events_url":"https://api.github.com/users/marceloboeira/received_events","type":"User","site_admin":false},"created_at":"2018-08-01T07:12:57Z","updated_at":"2018-08-01T07:12:57Z","author_association":"CONTRIBUTOR","body":"@caeugusmao thanks for looking at it. I have lots of metrics available here if you need.\r\n\r\n@kkopachev hmm, we serve mostly jpg so I didn't see any difference for a specific format. Let me show you:\r\n\r\n<img width=\"631\" alt=\"screen shot 2018-08-01 at 09 12 13\" src=\"https://user-images.githubusercontent.com/1898225/43506659-02d88bf4-956b-11e8-80eb-1d687abd9816.png\">\r\n\r\nThe bigger one is jpg, smaller is png.  "}}
{"actor":{"display_login":"marceloboeira"}}