{"action":"created","issue":{"url":"https://api.github.com/repos/ukwa/webarchive-discovery/issues/165","repository_url":"https://api.github.com/repos/ukwa/webarchive-discovery","labels_url":"https://api.github.com/repos/ukwa/webarchive-discovery/issues/165/labels{/name}","comments_url":"https://api.github.com/repos/ukwa/webarchive-discovery/issues/165/comments","events_url":"https://api.github.com/repos/ukwa/webarchive-discovery/issues/165/events","html_url":"https://github.com/ukwa/webarchive-discovery/issues/165","id":318458563,"number":165,"title":"Infinite loop when the last record is corrupted","user":{"login":"bnfleb","id":29090103,"avatar_url":"https://avatars1.githubusercontent.com/u/29090103?v=4","gravatar_id":"","url":"https://api.github.com/users/bnfleb","html_url":"https://github.com/bnfleb","followers_url":"https://api.github.com/users/bnfleb/followers","following_url":"https://api.github.com/users/bnfleb/following{/other_user}","gists_url":"https://api.github.com/users/bnfleb/gists{/gist_id}","starred_url":"https://api.github.com/users/bnfleb/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/bnfleb/subscriptions","organizations_url":"https://api.github.com/users/bnfleb/orgs","repos_url":"https://api.github.com/users/bnfleb/repos","events_url":"https://api.github.com/users/bnfleb/events{/privacy}","received_events_url":"https://api.github.com/users/bnfleb/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2018-04-27T15:44:25Z","updated_at":"2018-05-29T11:34:16Z","closed_at":"2018-05-29T11:34:16Z","author_association":"CONTRIBUTOR","body":"For some w.arc there are corrupted record. Issue #127 dealed with it. But if it's the last record, we have an infinite loop throwing an error : \r\n`Feb 21, 2018 5:04:32 PM org.archive.io.ArchiveReader$ArchiveRecordIterator hasNext\r\nWARNING: Trying skip of failed record cleanup of /dta/02/arc/602/BNF-test5-1-256-956977328/BNF-test5-1-256-956977328.arc.gz: {ip-address=209.144.237.79, content-type=im, absolute-offset=11413741, subject-uri=http://www.workholding.com:80/zagblu5.jpg, origin=, length=7932, creation-date=20000429030234, version=null}: invalid distance too far back\r\njava.util.zip.ZipException: invalid distance too far back\r\n\tat org.archive.util.zip.OpenJDK7InflaterInputStream.read(OpenJDK7InflaterInputStream.java:168)\r\n\tat org.archive.util.zip.OpenJDK7GZIPInputStream.read(OpenJDK7GZIPInputStream.java:122)\r\n\tat org.archive.util.zip.GZIPMembersInputStream.read(GZIPMembersInputStream.java:113)\r\n\tat org.archive.io.ArchiveRecord.read(ArchiveRecord.java:204)\r\n\tat org.archive.io.arc.ARCRecord.read(ARCRecord.java:799)\r\n\tat org.archive.io.ArchiveRecord.skip(ArchiveRecord.java:262)\r\n\tat org.archive.io.ArchiveRecord.skip(ArchiveRecord.java:248)\r\n\tat org.archive.io.ArchiveRecord.close(ArchiveRecord.java:172)\r\n\tat org.archive.io.ArchiveReader.cleanupCurrentRecord(ArchiveReader.java:175)\r\n\tat org.archive.io.ArchiveReader$ArchiveRecordIterator.hasNext(ArchiveReader.java:449)\r\n\tat uk.bl.wa.indexer.WARCIndexerCommand.parseWarcFiles(WARCIndexerCommand.java:340)\r\n\tat uk.bl.wa.indexer.WARCIndexerCommand.main(WARCIndexerCommand.java:227)`\r\n\r\nError may vary but it's always because of the `hasNext`\r\n"},"comment":{"url":"https://api.github.com/repos/ukwa/webarchive-discovery/issues/comments/392744929","html_url":"https://github.com/ukwa/webarchive-discovery/issues/165#issuecomment-392744929","issue_url":"https://api.github.com/repos/ukwa/webarchive-discovery/issues/165","id":392744929,"user":{"login":"tokee","id":199454,"avatar_url":"https://avatars1.githubusercontent.com/u/199454?v=4","gravatar_id":"","url":"https://api.github.com/users/tokee","html_url":"https://github.com/tokee","followers_url":"https://api.github.com/users/tokee/followers","following_url":"https://api.github.com/users/tokee/following{/other_user}","gists_url":"https://api.github.com/users/tokee/gists{/gist_id}","starred_url":"https://api.github.com/users/tokee/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/tokee/subscriptions","organizations_url":"https://api.github.com/users/tokee/orgs","repos_url":"https://api.github.com/users/tokee/repos","events_url":"https://api.github.com/users/tokee/events{/privacy}","received_events_url":"https://api.github.com/users/tokee/received_events","type":"User","site_admin":false},"created_at":"2018-05-29T11:34:16Z","updated_at":"2018-05-29T11:34:16Z","author_association":"COLLABORATOR","body":"Closed as pull #166 fixes this."}}
{"actor":{"display_login":"tokee"}}