{"action":"created","issue":{"url":"https://api.github.com/repos/medusa-project/cantaloupe/issues/198","repository_url":"https://api.github.com/repos/medusa-project/cantaloupe","labels_url":"https://api.github.com/repos/medusa-project/cantaloupe/issues/198/labels{/name}","comments_url":"https://api.github.com/repos/medusa-project/cantaloupe/issues/198/comments","events_url":"https://api.github.com/repos/medusa-project/cantaloupe/issues/198/events","html_url":"https://github.com/medusa-project/cantaloupe/issues/198","id":297129550,"number":198,"title":"PdfBox Processor memory issue","user":{"login":"FrancoisPaquette","id":19912180,"avatar_url":"https://avatars3.githubusercontent.com/u/19912180?v=4","gravatar_id":"","url":"https://api.github.com/users/FrancoisPaquette","html_url":"https://github.com/FrancoisPaquette","followers_url":"https://api.github.com/users/FrancoisPaquette/followers","following_url":"https://api.github.com/users/FrancoisPaquette/following{/other_user}","gists_url":"https://api.github.com/users/FrancoisPaquette/gists{/gist_id}","starred_url":"https://api.github.com/users/FrancoisPaquette/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/FrancoisPaquette/subscriptions","organizations_url":"https://api.github.com/users/FrancoisPaquette/orgs","repos_url":"https://api.github.com/users/FrancoisPaquette/repos","events_url":"https://api.github.com/users/FrancoisPaquette/events{/privacy}","received_events_url":"https://api.github.com/users/FrancoisPaquette/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":9,"created_at":"2018-02-14T15:08:11Z","updated_at":"2018-03-14T14:11:17Z","closed_at":null,"author_association":"NONE","body":"Hi,\r\n\r\nI’m having issues with some of our PDF using PdfBox. For reasons that I’m trying to figure out, they are taking quite a lot of memory, some directly from the server itself.  This has for effect that after multiple requests to Cantaloupe, I’m getting a ‘out of memory’. Either the OOM killer is triggered by the server or Cantaloupe just crash. The only way to release the memory to the server is to restart the application server.\r\n\r\nHere’s an example of a PDF very problematic.\r\n\r\nhttps://www.dropbox.com/s/er4oblu57bigzhk/97521.pdf?dl=0\r\n\r\nLooking closer what is going on memory wise, I’m seeing those PDF filled up the young generation. So I added more memory to the server, the JVM can use up to 30 G, which help but didn’t solve the problem. I then started tuning the garbage collector (the G1 seems to be the better choice for the situation), which also helped but the problem is still there. \r\n\r\nI was wondering if you have seen a similar problem before?\r\n\r\nThanks\r\n"},"comment":{"url":"https://api.github.com/repos/medusa-project/cantaloupe/issues/comments/373034324","html_url":"https://github.com/medusa-project/cantaloupe/issues/198#issuecomment-373034324","issue_url":"https://api.github.com/repos/medusa-project/cantaloupe/issues/198","id":373034324,"user":{"login":"FrancoisPaquette","id":19912180,"avatar_url":"https://avatars3.githubusercontent.com/u/19912180?v=4","gravatar_id":"","url":"https://api.github.com/users/FrancoisPaquette","html_url":"https://github.com/FrancoisPaquette","followers_url":"https://api.github.com/users/FrancoisPaquette/followers","following_url":"https://api.github.com/users/FrancoisPaquette/following{/other_user}","gists_url":"https://api.github.com/users/FrancoisPaquette/gists{/gist_id}","starred_url":"https://api.github.com/users/FrancoisPaquette/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/FrancoisPaquette/subscriptions","organizations_url":"https://api.github.com/users/FrancoisPaquette/orgs","repos_url":"https://api.github.com/users/FrancoisPaquette/repos","events_url":"https://api.github.com/users/FrancoisPaquette/events{/privacy}","received_events_url":"https://api.github.com/users/FrancoisPaquette/received_events","type":"User","site_admin":false},"created_at":"2018-03-14T14:11:17Z","updated_at":"2018-03-14T14:11:17Z","author_association":"NONE","body":"Hi,\r\n\r\nIn the zip file you will have 100 PDF, I could send you more if needed. But I think it should be enough if you do not turn on the cache and use them in a loop until to see the issue. I needed about 800 the last time.\r\n\r\nhttps://www.dropbox.com/s/f9ehokdakqt842o/PDF.rar?dl=0\r\n\r\nAlso, you will see the file ‘thumbnail.rb, which is the script that I have made to send the request to the server to generate the thumbnails (it was done using the version 2.4.2 of Ruby). Feel free to modify or improve as you wish but basically you will only have to change the name of my server by yours.\r\n\r\nI do not know if this script could be useful to other people but I would gladly share it if it is. If you think it could be, you could place it on your Github. It’s up to you.\r\n\r\nI also have a Jmeter test file that I created to test rapidly your hypothesis about the connection that I could send you.\r\n\r\nYou will also see the file ‘ids.txt’ which contains the IDs of all the PDF. The script will read those IDs and use them to send the request to the server.\r\n\r\nThat’s about it, let me know if you have any question.\r\n\r\nThanks!\r\n"}}
{"actor":{"display_login":"FrancoisPaquette"}}