{"action":"created","issue":{"url":"https://api.github.com/repos/daitss/core/issues/782","repository_url":"https://api.github.com/repos/daitss/core","labels_url":"https://api.github.com/repos/daitss/core/issues/782/labels{/name}","comments_url":"https://api.github.com/repos/daitss/core/issues/782/comments","events_url":"https://api.github.com/repos/daitss/core/issues/782/events","html_url":"https://github.com/daitss/core/issues/782","id":159452965,"number":782,"title":"Storage error for large package","user":{"login":"szanati","id":857143,"avatar_url":"https://avatars.githubusercontent.com/u/857143?v=3","gravatar_id":"","url":"https://api.github.com/users/szanati","html_url":"https://github.com/szanati","followers_url":"https://api.github.com/users/szanati/followers","following_url":"https://api.github.com/users/szanati/following{/other_user}","gists_url":"https://api.github.com/users/szanati/gists{/gist_id}","starred_url":"https://api.github.com/users/szanati/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/szanati/subscriptions","organizations_url":"https://api.github.com/users/szanati/orgs","repos_url":"https://api.github.com/users/szanati/repos","events_url":"https://api.github.com/users/szanati/events{/privacy}","received_events_url":"https://api.github.com/users/szanati/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":5,"created_at":"2016-06-09T16:32:20Z","updated_at":"2016-12-02T15:18:51Z","closed_at":null,"body":"I received the following error for a large package, AA00040592_00001 (EK17K3IRR_9EYDQW)  that is 98GB and only has 437 files:\n\n2016-06-08 14:31:53 -0400   \n\nbad status\nhttp://storage-master.fda.fcla.edu:70/packages/EK17K3IRR_9EYDQW.002: 500\n500 Internal Service Error - Store of package EK17K3IRR_9EYDQW.002 to http://silos.darchive.fcla.edu:70/create/EK17K3IRR_9EYDQW.002 failed with status 500 - Internal Server Error; response from server was: \n\nInternal Server Error\n\nThe server encountered an internal error or\nmisconfiguration and was unable to complete\nyour request.\n\nPlease contact the server administrator,\n root@localhost and inform them of the time the error occurred,\nand anything you might have done that may have\ncaused the error.\n\nMore information about this error may be available\nin the server error log.\n\nApache Server at silos.darchive.fcla.edu Port 70\n\nBefore it errored out xymon gave an alert about the /var/daitss/tmp: \n/var/daitss/tmp (90% used) has reached the PANIC level (90%)\n\nThe storage log from yesterday:\n\n2016 Jun  8 11:23:44 fclnx30 StorageMaster[32034]:  INFO storage-master.fda.fcla.edu: Request Received: 104964638720 192.168.36.60 - - \"PUT /packages/EK17K3IRR_9EYDQW.002 HTTP/1.1\"\n2016 Jun  8 14:10:34 fclnx30 SiloPool[32110]:  INFO silos.darchive.fcla.edu: Request Received: 104964638720 192.168.36.60 - - \"POST /create/EK17K3IRR_9EYDQW.002 HTTP/1.1\"\n2016 Jun  8 14:29:47 fclnx30 StorageMaster[32034]: ERROR storage-master.fda.fcla.edu: 500 Internal Service Error - Store of package EK17K3IRR_9EYDQW.002 to http://silos.darchive.fcla.edu:70/create/EK17K3IRR_9EYDQW.002 failed with status 500 - Internal Server Error; response from server was: <!DOCTYPE HTML PUBLIC \"-//IETF//DTD HTML 2.0//EN\">#012<html><head>#012<title>500 Internal Server Error</title>#012</head><body>#012<h1>Internal Server Error</h1>#012<p>The server encountered an internal error or#012misconfiguration and was unable to complete#012your request.</p>#012<p>Please contact the server administrator,#012 root@localhost and inform them of the time the error occurred,#012and anything you might have done that may have#012caused the error.</p>#012<p>More information about this error may be available#012in the server error log.</p>#012<hr>#012<address>Apache Server at silos.darchive.fcla.edu Port 70</address>#012</body></html>. 192.168.36.60 - - \"PUT /packages/EK17K3IRR_9EYDQW.002 HTTP/1.1\"\n2016 Jun  8 14:29:47 fclnx30 StorageMaster[32034]:  INFO storage-master.fda.fcla.edu: Rack: 192.168.36.60 - - [08/Jun/2016 14:29:47] \"PUT /packages/EK17K3IRR_9EYDQW.002 \" 500 814 11163.7796\n\nI reset it and it ran again but errored out with the same above message. It looks the same as a github issue https://github.com/daitss/core/issues/639 from 2012.  In that case the package was 200GB in size. \n\nI wonder if even a 98GB package is too big. We limit to 100GB. We usually do not get too many near that size. I have kept the original package incase for some reason I have to resubmit the package.\n"},"comment":{"url":"https://api.github.com/repos/daitss/core/issues/comments/264477851","html_url":"https://github.com/daitss/core/issues/782#issuecomment-264477851","issue_url":"https://api.github.com/repos/daitss/core/issues/782","id":264477851,"user":{"login":"szanati","id":857143,"avatar_url":"https://avatars.githubusercontent.com/u/857143?v=3","gravatar_id":"","url":"https://api.github.com/users/szanati","html_url":"https://github.com/szanati","followers_url":"https://api.github.com/users/szanati/followers","following_url":"https://api.github.com/users/szanati/following{/other_user}","gists_url":"https://api.github.com/users/szanati/gists{/gist_id}","starred_url":"https://api.github.com/users/szanati/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/szanati/subscriptions","organizations_url":"https://api.github.com/users/szanati/orgs","repos_url":"https://api.github.com/users/szanati/repos","events_url":"https://api.github.com/users/szanati/events{/privacy}","received_events_url":"https://api.github.com/users/szanati/received_events","type":"User","site_admin":false},"created_at":"2016-12-02T15:18:51Z","updated_at":"2016-12-02T15:18:51Z","body":"I was able to finally archive this package. It helped that Carol cleaned up /var/daitss/tmp. I will now close this case. "}}
{"actor":{"display_login":"szanati"}}