{"action":"created","issue":{"url":"https://api.github.com/repos/zammad/zammad/issues/2222","repository_url":"https://api.github.com/repos/zammad/zammad","labels_url":"https://api.github.com/repos/zammad/zammad/issues/2222/labels{/name}","comments_url":"https://api.github.com/repos/zammad/zammad/issues/2222/comments","events_url":"https://api.github.com/repos/zammad/zammad/issues/2222/events","html_url":"https://github.com/zammad/zammad/issues/2222","id":356752658,"node_id":"MDU6SXNzdWUzNTY3NTI2NTg=","number":2222,"title":"OTRS-Import gets killed due to OOM","user":{"login":"pc-coholic","id":654548,"node_id":"MDQ6VXNlcjY1NDU0OA==","avatar_url":"https://avatars1.githubusercontent.com/u/654548?v=4","gravatar_id":"","url":"https://api.github.com/users/pc-coholic","html_url":"https://github.com/pc-coholic","followers_url":"https://api.github.com/users/pc-coholic/followers","following_url":"https://api.github.com/users/pc-coholic/following{/other_user}","gists_url":"https://api.github.com/users/pc-coholic/gists{/gist_id}","starred_url":"https://api.github.com/users/pc-coholic/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/pc-coholic/subscriptions","organizations_url":"https://api.github.com/users/pc-coholic/orgs","repos_url":"https://api.github.com/users/pc-coholic/repos","events_url":"https://api.github.com/users/pc-coholic/events{/privacy}","received_events_url":"https://api.github.com/users/pc-coholic/received_events","type":"User","site_admin":false},"labels":[{"id":2423267,"node_id":"MDU6TGFiZWwyNDIzMjY3","url":"https://api.github.com/repos/zammad/zammad/labels/enhancement","name":"enhancement","color":"84b6eb","default":true},{"id":465995264,"node_id":"MDU6TGFiZWw0NjU5OTUyNjQ=","url":"https://api.github.com/repos/zammad/zammad/labels/import","name":"import","color":"c5def5","default":false}],"state":"open","locked":false,"assignee":{"login":"thorsteneckel","id":3873515,"node_id":"MDQ6VXNlcjM4NzM1MTU=","avatar_url":"https://avatars2.githubusercontent.com/u/3873515?v=4","gravatar_id":"","url":"https://api.github.com/users/thorsteneckel","html_url":"https://github.com/thorsteneckel","followers_url":"https://api.github.com/users/thorsteneckel/followers","following_url":"https://api.github.com/users/thorsteneckel/following{/other_user}","gists_url":"https://api.github.com/users/thorsteneckel/gists{/gist_id}","starred_url":"https://api.github.com/users/thorsteneckel/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/thorsteneckel/subscriptions","organizations_url":"https://api.github.com/users/thorsteneckel/orgs","repos_url":"https://api.github.com/users/thorsteneckel/repos","events_url":"https://api.github.com/users/thorsteneckel/events{/privacy}","received_events_url":"https://api.github.com/users/thorsteneckel/received_events","type":"User","site_admin":false},"assignees":[{"login":"thorsteneckel","id":3873515,"node_id":"MDQ6VXNlcjM4NzM1MTU=","avatar_url":"https://avatars2.githubusercontent.com/u/3873515?v=4","gravatar_id":"","url":"https://api.github.com/users/thorsteneckel","html_url":"https://github.com/thorsteneckel","followers_url":"https://api.github.com/users/thorsteneckel/followers","following_url":"https://api.github.com/users/thorsteneckel/following{/other_user}","gists_url":"https://api.github.com/users/thorsteneckel/gists{/gist_id}","starred_url":"https://api.github.com/users/thorsteneckel/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/thorsteneckel/subscriptions","organizations_url":"https://api.github.com/users/thorsteneckel/orgs","repos_url":"https://api.github.com/users/thorsteneckel/repos","events_url":"https://api.github.com/users/thorsteneckel/events{/privacy}","received_events_url":"https://api.github.com/users/thorsteneckel/received_events","type":"User","site_admin":false}],"milestone":null,"comments":1,"created_at":"2018-09-04T10:43:06Z","updated_at":"2018-11-29T11:48:29Z","closed_at":null,"author_association":"NONE","body":"<!--\r\nHi there - thanks for filing an issue. Please ensure the following things before creating an issue - thank you! 🤓\r\n\r\nSince november 15th we handle all requests, except real bugs, at our community board.\r\nFull explanation: https://community.zammad.org/t/major-change-regarding-github-issues-community-board/21\r\n\r\nPlease post:\r\n- Feature requests\r\n- Development questions\r\n- Technical questions\r\n\r\non the board -> https://community.zammad.org !\r\n\r\n\r\nIf you think you hit a bug, please continue:\r\n- Search existing issues and the CHANGELOG.md for your issue - there might be a solution already\r\n- Make sure to use the latest version of Zammad if possible\r\n- Add the `log/production.log` file from your system. Attention: Make sure no confidential data is in it!\r\n- Please write the issue in english\r\n- Don't remove the template - otherwise we will close the issue without further comments\r\n- Ask questions about Zammad configuration and usage at our mailinglist. See: https://zammad.org/participate\r\n\r\nNote: We always do our best. Unfortunately, sometimes there are too many requests and we can't handle everything at once. If you want to prioritize/escalate your issue, you can do so by means of a support contract (see https://zammad.com/pricing#selfhosted).\r\n\r\n* The upper textblock will be removed automatically when you submit your issue *\r\n-->\r\n\r\n### Infos:\r\n\r\n* Used Zammad version: 2.6.x\r\n* Installation method (source, package, ..): DEB\r\n* Operating system: Ubuntu 16.ß4.1\r\n* Database + version: mySQL 5.7.23\r\n* Elasticsearch version: 5.6.11\r\n* Browser + version: Chrome 68.0.3440.106\r\n\r\n\r\n### Expected behavior:\r\n\r\n* Running the OTRS-Importer imports all the data without fail\r\n\r\n\r\n### Actual behavior:\r\n\r\n* The Importer gets killed by the Kernel due the being OOM\r\n\r\n\r\n### Steps to reproduce the behavior:\r\n\r\n* Start the import-process of a ~150.000 articles on a machine with just 8GB memory.\r\n\r\nYes I'm sure this is a bug and no feature request or a general question. :heavy_check_mark: \r\n\r\nI know, that OOM is more likely a \"enduser\" problem... But it is my understanding, that the OOM-situation occurs, as the memory-consumption of the ruby-process grows and grows and grows during the import - leading ultimately to the kernel killing everything.\r\n\r\nTo me, this looks like an issue with garbage-collection that is not done while the import is happening.\r\n\r\nTo be fair, I did not look into the workings of the importer in more detail - but my guess would be, that all the processed tickets (or at least the meta-data) is kept in memory/variables and not dumped once processed?\r\n\r\nI did not attach the production.log, as there is (really!) nothing to see there. The only thing that can be seen is a `Terminated!` if running the process in a `screen`. "},"comment":{"url":"https://api.github.com/repos/zammad/zammad/issues/comments/442805461","html_url":"https://github.com/zammad/zammad/issues/2222#issuecomment-442805461","issue_url":"https://api.github.com/repos/zammad/zammad/issues/2222","id":442805461,"node_id":"MDEyOklzc3VlQ29tbWVudDQ0MjgwNTQ2MQ==","user":{"login":"pouyana","id":2496169,"node_id":"MDQ6VXNlcjI0OTYxNjk=","avatar_url":"https://avatars0.githubusercontent.com/u/2496169?v=4","gravatar_id":"","url":"https://api.github.com/users/pouyana","html_url":"https://github.com/pouyana","followers_url":"https://api.github.com/users/pouyana/followers","following_url":"https://api.github.com/users/pouyana/following{/other_user}","gists_url":"https://api.github.com/users/pouyana/gists{/gist_id}","starred_url":"https://api.github.com/users/pouyana/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/pouyana/subscriptions","organizations_url":"https://api.github.com/users/pouyana/orgs","repos_url":"https://api.github.com/users/pouyana/repos","events_url":"https://api.github.com/users/pouyana/events{/privacy}","received_events_url":"https://api.github.com/users/pouyana/received_events","type":"User","site_admin":false},"created_at":"2018-11-29T11:48:29Z","updated_at":"2018-11-29T11:48:29Z","author_association":"NONE","body":"Maybe it could help:\r\n\r\nI tried to import 120,000 tickets twice: once with having the attachments written in the database, and once with them writing to the storage (files).\r\n\r\n1 )The first attempt with writing in the database crashed after some work as said above. (Memory Exhaustion)\r\n2) Writing attachments on the storage on the other hand, the import memory usage stays at most 1-3 GB which is reasonable. \r\n\r\nIt can be a workaround till the new solution is available."}}
{"actor":{"display_login":"pouyana"}}