{"action":"opened","issue":{"url":"https://api.github.com/repos/wummel/linkchecker/issues/677","repository_url":"https://api.github.com/repos/wummel/linkchecker","labels_url":"https://api.github.com/repos/wummel/linkchecker/issues/677/labels{/name}","comments_url":"https://api.github.com/repos/wummel/linkchecker/issues/677/comments","events_url":"https://api.github.com/repos/wummel/linkchecker/issues/677/events","html_url":"https://github.com/wummel/linkchecker/issues/677","id":176153892,"number":677,"title":"\"out of dynamic memory in yy_scan_bytes()\"","user":{"login":"uogbuji","id":279982,"avatar_url":"https://avatars.githubusercontent.com/u/279982?v=3","gravatar_id":"","url":"https://api.github.com/users/uogbuji","html_url":"https://github.com/uogbuji","followers_url":"https://api.github.com/users/uogbuji/followers","following_url":"https://api.github.com/users/uogbuji/following{/other_user}","gists_url":"https://api.github.com/users/uogbuji/gists{/gist_id}","starred_url":"https://api.github.com/users/uogbuji/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/uogbuji/subscriptions","organizations_url":"https://api.github.com/users/uogbuji/orgs","repos_url":"https://api.github.com/users/uogbuji/repos","events_url":"https://api.github.com/users/uogbuji/events{/privacy}","received_events_url":"https://api.github.com/users/uogbuji/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2016-09-10T03:34:40Z","updated_at":"2016-09-10T03:34:40Z","closed_at":null,"body":"Command line to repro:\r\n\r\n```\r\nlinkchecker -F xml/report.xml http://halan.library.link/\r\n```\r\n\r\nNo other config. Also this:\r\n\r\n```\r\n$ linkchecker -Dall\r\nDEBUG 2016-09-09 21:33:38,580 MainThread Python 2.7.12 (default, Sep  9 2016, 09:17:26) \r\n[GCC 4.7.2] on linux2\r\nDEBUG 2016-09-09 21:33:38,582 MainThread reading configuration from ['/home/uche/.linkchecker/linkch\r\neckerrc']\r\nINFO 2016-09-09 21:33:38,625 MainThread Checking intern URLs only; use --check-extern to check exter\r\nn URLs.\r\nDEBUG 2016-09-09 21:33:38,636 MainThread configuration: [('aborttimeout', 300),\r\n ('allowedschemes', []),\r\n ('authentication', []),\r\n ('blacklist', {}),\r\n ('checkextern', False),\r\n ('cookiefile', None),\r\n ('csv', {}),\r\n ('debugmemory', False),\r\n ('dot', {}),\r\n ('enabledplugins', []),\r\n ('externlinks', []),\r\n ('fileoutput', []),\r\n ('gml', {}),\r\n ('gxml', {}),\r\n ('html', {}),\r\n ('ignorewarnings', []),\r\n ('internlinks', []),\r\n ('localwebroot', None),\r\n ('logger', 'TextLogger'),\r\n ('loginextrafields', {}),\r\n ('loginpasswordfield', 'password'),\r\n ('loginurl', None),\r\n ('loginuserfield', 'login'),\r\n ('maxfilesizedownload', 5242880),\r\n ('maxfilesizeparse', 1048576),\r\n ('maxhttpredirects', 10),\r\n ('maxnumurls', None),\r\n ('maxrequestspersecond', 10),\r\n ('maxrunseconds', None),\r\n ('nntpserver', None),\r\n ('none', {}),\r\n ('output', 'text'),\r\n ('pluginfolders', []),\r\n ('proxy', {}),\r\n ('quiet', False),\r\n ('recursionlevel', -1),\r\n ('sitemap', {}),\r\n ('sql', {}),\r\n ('sslverify', True),\r\n ('status', True),\r\n ('status_wait_seconds', 5),\r\n ('text', {}),\r\n ('threads', 10),\r\n ('timeout', 60),\r\n ('trace', False),\r\n ('useragent',\r\n  u'Mozilla/5.0 (compatible; LinkChecker/9.3; +http://wummel.github.io/linkchecker/)'),\r\n ('verbose', False),\r\n ('warnings', True),\r\n ('xml', {})]\r\nWARNING 2016-09-09 21:33:38,641 MainThread no files or URLs given\r\nLinkChecker 9.3              Copyright (C) 2000-2014 Bastian Kleineidam\r\nLinkChecker comes with ABSOLUTELY NO WARRANTY!\r\nThis is free software, and you are welcome to redistribute it\r\nunder certain conditions. Look at the file `LICENSE' within this\r\ndistribution.\r\nGet the newest version at http://wummel.github.io/linkchecker/\r\nWrite comments and bugs to https://github.com/wummel/linkchecker/issues\r\nSupport this project at http://wummel.github.io/linkchecker/donations.html\r\n\r\nStart checking at 2016-09-09 21:33:38-006\r\n\r\nStatistics:\r\nDownloaded: 0B.\r\nNo statistics available since no URLs were checked.\r\n\r\nThat's it. 0 links in 0 URLs checked. 0 warnings found. 0 errors found.\r\nStopped checking at 2016-09-09 21:33:38-006 (0.00 seconds)\r\n```\r\n\r\nFull error output:\r\n\r\n```\r\nWARNING 2016-09-09 13:28:56,976 CheckThread-http://halan.library.link/portal/Seducing-the-knight-Ger\r\nri-Russell/UF-h5ivfmUM/ internal error occurred\r\nWARNING 2016-09-09 13:28:56,991 CheckThread-http://halan.library.link/portal/Seducing-the-knight-Ger\r\nri-Russell/UF-h5ivfmUM/ internal error occurred\r\n\r\n\r\n********** Oops, I did it again. *************\r\n\r\nYou have found an internal error in LinkChecker. Please write a bug report\r\nat https://github.com/wummel/linkchecker/issues\r\nand include the following information:\r\n- the URL or file you are testing\r\n- the system information below\r\n\r\nWhen using the commandline client:\r\n- your commandline arguments and any custom configuration files.\r\n- the output of a debug run with option \"-Dall\"\r\n\r\nNot disclosing some of the information above due to privacy reasons is ok.\r\nI will try to help you nonetheless, but you have to give me something\r\nI can work with ;) .\r\n\r\nTraceback (most recent call last):\r\n  File \"/home/uche/.local/pyenv/py2/lib/python2.7/site-packages/linkcheck/director/checker.py\", line\r\n 104, in check_url\r\n    line: self.check_url_data(url_data)\r\n    locals:\r\n      self = <local> <Checker(CheckThread-http://halan.library.link/portal/Rift.--Rift-Andrea-Cremer\r\n-electronic/fw-pZE4-ISg/, started -1282073744)>\r\n      self.check_url_data = <local> <bound method Checker.check_url_data of <Checker(CheckThread-htt\r\np://halan.library.link/portal/Rift.--Rift-Andrea-Cremer-electronic/fw-pZE4-ISg/, started -1282073744\r\n)>>\r\n      url_data = <local> <http link, base_url=u'/portal/Rift.--Rift-Andrea-Cremer-electronic/fw-pZE4\r\n-ISg/', parent_url=u'http://halan.library.link/resource/gzeifx9LOVM/', base_ref=None, recursion_leve\r\nl=3, url_connection=None, line=1923, column=9, page=0, name=u'', anchor=u'', cache_url=http://halan.\r\nlibrary.link/portal/Ri...\r\n  File \"/home/uche/.local/pyenv/py2/lib/python2.7/site-packages/linkcheck/director/checker.py\", line\r\n 120, in check_url_data\r\n    line: check_url(url_data, self.logger)\r\n    locals:\r\n      check_url = <global> <function check_url at 0xb6a1280c>\r\n      url_data = <local> <http link, base_url=u'/portal/Rift.--Rift-Andrea-Cremer-electronic/fw-pZE4\r\n-ISg/', parent_url=u'http://halan.library.link/resource/gzeifx9LOVM/', base_ref=None, recursion_leve\r\nl=3, url_connection=None, line=1923, column=9, page=0, name=u'', anchor=u'', cache_url=http://halan.\r\nlibrary.link/portal/Ri...\r\n      self = <local> <Checker(CheckThread-http://halan.library.link/portal/Rift.--Rift-Andrea-Cremer\r\n-electronic/fw-pZE4-ISg/, started -1282073744)>\r\n      self.logger = <local> <linkcheck.director.logger.Logger object at 0xb696ae4c>\r\n  File \"/home/uche/.local/pyenv/py2/lib/python2.7/site-packages/linkcheck/director/checker.py\", line\r\n 64, in check_url\r\n    line: parser.parse_url(url_data)\r\n    locals:\r\n      parser = <global> <module 'linkcheck.parser' from '/home/uche/.local/pyenv/py2/lib/python2.7/s\r\nite-packages/linkcheck/parser/__init__.pyc'>\r\n      parser.parse_url = <global> <function parse_url at 0xb6a87df4>\r\n      url_data = <local> <http link, base_url=u'/portal/Rift.--Rift-Andrea-Cremer-electronic/fw-pZE4\r\n-ISg/', parent_url=u'http://halan.library.link/resource/gzeifx9LOVM/', base_ref=None, recursion_leve\r\nl=3, url_connection=None, line=1923, column=9, page=0, name=u'', anchor=u'', cache_url=http://halan.\r\nlibrary.link/portal/Ri...\r\n  File \"/home/uche/.local/pyenv/py2/lib/python2.7/site-packages/linkcheck/parser/__init__.py\", line \r\n39, in parse_url\r\n    line: globals()[funcname](url_data)\r\n    locals:\r\n      globals = <builtin> <built-in function globals>\r\n      funcname = <local> 'parse_html', len = 10\r\n      url_data = <local> <http link, base_url=u'/portal/Rift.--Rift-Andrea-Cremer-electronic/fw-pZE4\r\n-ISg/', parent_url=u'http://halan.library.link/resource/gzeifx9LOVM/', base_ref=None, recursion_leve\r\nl=3, url_connection=None, line=1923, column=9, page=0, name=u'', anchor=u'', cache_url=http://halan.\r\nlibrary.link/portal/Ri...\r\n  File \"/home/uche/.local/pyenv/py2/lib/python2.7/site-packages/linkcheck/parser/__init__.py\", line \r\n48, in parse_html\r\n    line: find_links(url_data, url_data.add_url, linkparse.LinkTags)\r\n    locals:\r\n      find_links = <global> <function find_links at 0xb6a1202c>\r\n      url_data = <local> <http link, base_url=u'/portal/Rift.--Rift-Andrea-Cremer-electronic/fw-pZE4\r\n-ISg/', parent_url=u'http://halan.library.link/resource/gzeifx9LOVM/', base_ref=None, recursion_leve\r\nl=3, url_connection=None, line=1923, column=9, page=0, name=u'', anchor=u'', cache_url=http://halan.\r\nlibrary.link/portal/Ri...\r\n      url_data.add_url = <local> <bound method HttpUrl.add_url of <http link, base_url=u'/portal/Rif\r\nt.--Rift-Andrea-Cremer-electronic/fw-pZE4-ISg/', parent_url=u'http://halan.library.link/resource/gze\r\nifx9LOVM/', base_ref=None, recursion_level=3, url_connection=None, line=1923, column=9, page=0, name\r\n=u'', anchor=u'', cache_url=ht...\r\n      linkparse = <global> <module 'linkcheck.htmlutil.linkparse' from '/home/uche/.local/pyenv/py2/\r\nlib/python2.7/site-packages/linkcheck/htmlutil/linkparse.pyc'>\r\n      linkparse.LinkTags = <global> {'meta': [u'content', u'href'], 'iframe': [u'src', u'longdesc'],\r\n 'frame': [u'src', u'longdesc'], 'xmp': [u'href'], 'del': [u'cite'], 'isindex': [u'action'], 'script\r\n': [u'src'], 'video': [u'src'], 'td': [u'background'], 'link': [u'href'], 'blockquote': [u'cite'], '\r\nilayer': [u'background'], 'table'..., len = 35\r\n  File \"/home/uche/.local/pyenv/py2/lib/python2.7/site-packages/linkcheck/parser/__init__.py\", line \r\n126, in find_links\r\n 9 threads active, 531384 links queued, out of dynamic memory in yy_scan_bytes()\r\n```"}}
{"actor":{"display_login":"uogbuji"}}