{"action":"created","issue":{"url":"https://api.github.com/repos/log2timeline/plaso/issues/1970","repository_url":"https://api.github.com/repos/log2timeline/plaso","labels_url":"https://api.github.com/repos/log2timeline/plaso/issues/1970/labels{/name}","comments_url":"https://api.github.com/repos/log2timeline/plaso/issues/1970/comments","events_url":"https://api.github.com/repos/log2timeline/plaso/issues/1970/events","html_url":"https://github.com/log2timeline/plaso/issues/1970","id":334760431,"node_id":"MDU6SXNzdWUzMzQ3NjA0MzE=","number":1970,"title":"OverflowError: Python int too large to convert to SQLite INTEGER","user":{"login":"Rolinh","id":1324157,"node_id":"MDQ6VXNlcjEzMjQxNTc=","avatar_url":"https://avatars3.githubusercontent.com/u/1324157?v=4","gravatar_id":"","url":"https://api.github.com/users/Rolinh","html_url":"https://github.com/Rolinh","followers_url":"https://api.github.com/users/Rolinh/followers","following_url":"https://api.github.com/users/Rolinh/following{/other_user}","gists_url":"https://api.github.com/users/Rolinh/gists{/gist_id}","starred_url":"https://api.github.com/users/Rolinh/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Rolinh/subscriptions","organizations_url":"https://api.github.com/users/Rolinh/orgs","repos_url":"https://api.github.com/users/Rolinh/repos","events_url":"https://api.github.com/users/Rolinh/events{/privacy}","received_events_url":"https://api.github.com/users/Rolinh/received_events","type":"User","site_admin":false},"labels":[{"id":127907854,"node_id":"MDU6TGFiZWwxMjc5MDc4NTQ=","url":"https://api.github.com/repos/log2timeline/plaso/labels/bug","name":"bug","color":"fc2929","default":true},{"id":267742093,"node_id":"MDU6TGFiZWwyNjc3NDIwOTM=","url":"https://api.github.com/repos/log2timeline/plaso/labels/storage","name":"storage","color":"fbca04","default":false}],"state":"open","locked":false,"assignee":{"login":"joachimmetz","id":3888750,"node_id":"MDQ6VXNlcjM4ODg3NTA=","avatar_url":"https://avatars2.githubusercontent.com/u/3888750?v=4","gravatar_id":"","url":"https://api.github.com/users/joachimmetz","html_url":"https://github.com/joachimmetz","followers_url":"https://api.github.com/users/joachimmetz/followers","following_url":"https://api.github.com/users/joachimmetz/following{/other_user}","gists_url":"https://api.github.com/users/joachimmetz/gists{/gist_id}","starred_url":"https://api.github.com/users/joachimmetz/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/joachimmetz/subscriptions","organizations_url":"https://api.github.com/users/joachimmetz/orgs","repos_url":"https://api.github.com/users/joachimmetz/repos","events_url":"https://api.github.com/users/joachimmetz/events{/privacy}","received_events_url":"https://api.github.com/users/joachimmetz/received_events","type":"User","site_admin":false},"assignees":[{"login":"joachimmetz","id":3888750,"node_id":"MDQ6VXNlcjM4ODg3NTA=","avatar_url":"https://avatars2.githubusercontent.com/u/3888750?v=4","gravatar_id":"","url":"https://api.github.com/users/joachimmetz","html_url":"https://github.com/joachimmetz","followers_url":"https://api.github.com/users/joachimmetz/followers","following_url":"https://api.github.com/users/joachimmetz/following{/other_user}","gists_url":"https://api.github.com/users/joachimmetz/gists{/gist_id}","starred_url":"https://api.github.com/users/joachimmetz/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/joachimmetz/subscriptions","organizations_url":"https://api.github.com/users/joachimmetz/orgs","repos_url":"https://api.github.com/users/joachimmetz/repos","events_url":"https://api.github.com/users/joachimmetz/events{/privacy}","received_events_url":"https://api.github.com/users/joachimmetz/received_events","type":"User","site_admin":false}],"milestone":{"url":"https://api.github.com/repos/log2timeline/plaso/milestones/12","html_url":"https://github.com/log2timeline/plaso/milestone/12","labels_url":"https://api.github.com/repos/log2timeline/plaso/milestones/12/labels","id":2954194,"node_id":"MDk6TWlsZXN0b25lMjk1NDE5NA==","number":12,"title":"2018 June release","description":"","creator":{"login":"joachimmetz","id":3888750,"node_id":"MDQ6VXNlcjM4ODg3NTA=","avatar_url":"https://avatars2.githubusercontent.com/u/3888750?v=4","gravatar_id":"","url":"https://api.github.com/users/joachimmetz","html_url":"https://github.com/joachimmetz","followers_url":"https://api.github.com/users/joachimmetz/followers","following_url":"https://api.github.com/users/joachimmetz/following{/other_user}","gists_url":"https://api.github.com/users/joachimmetz/gists{/gist_id}","starred_url":"https://api.github.com/users/joachimmetz/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/joachimmetz/subscriptions","organizations_url":"https://api.github.com/users/joachimmetz/orgs","repos_url":"https://api.github.com/users/joachimmetz/repos","events_url":"https://api.github.com/users/joachimmetz/events{/privacy}","received_events_url":"https://api.github.com/users/joachimmetz/received_events","type":"User","site_admin":false},"open_issues":1,"closed_issues":20,"state":"closed","created_at":"2017-12-03T18:06:29Z","updated_at":"2018-07-03T06:30:23Z","due_on":"2018-06-30T07:00:00Z","closed_at":"2018-07-03T03:51:51Z"},"comments":4,"created_at":"2018-06-22T06:26:01Z","updated_at":"2018-07-03T06:52:24Z","closed_at":null,"author_association":"NONE","body":"**Description of problem:**\r\n\r\n`log2timeline` crashes while analyzing a Firefox's `cookies.sqlite` file with Python exception `OverflowError: Python int too large to convert to SQLite INTEGER`.\r\n\r\n**Command line and arguments:**\r\n\r\n```\r\nlog2timeline --status_view linear /path/file.plaso cookies.sqlite\r\n```\r\n\r\n**Source data:**\r\n\r\nThis data is sensitive, I can't provide it unfortunately.\r\n\r\n**Plaso version:**\r\n\r\n20180524\r\n\r\n**Operating system Plaso is running on:**\r\n\r\nPlaso is running inside a Docker container based on an Ubuntu 16.04 image.\r\n\r\n**Installation method:**\r\n\r\nRelevant part of the Dockerfile:\r\n\r\n```\r\nRUN add-apt-repository -y \"deb http://ppa.launchpad.net/gift/stable/ubuntu xenial main\"\r\nRUN apt-get update && apt-get -y upgrade && apt-get -y dist-upgrade\r\nRUN apt-get -y install python-plaso plaso-tools\r\n```\r\n\r\n**Debug output/tracebacks:**\r\n\r\n```\r\n$ log2timeline -d --status_view linear  /path/file.plaso /path/cookies.sqlite\r\n2018-06-22 06:13:55,562 [WARNING] (MainProcess) PID:7 <tool_options> Appending to an already existing storage file.\r\n2018-06-22 06:13:55,749 [DEBUG] (MainProcess) PID:7 <log2timeline_tool> Starting extraction in single process mode.\r\n2018-06-22 06:13:55,768 [DEBUG] (MainProcess) PID:7 <extractors> Active parsers: amcache, android_app_usage, asl_log, bash, bencode, binary_cookies, bsm_log, chrome_cache, chrome_preferences, cups_ipp, custom_destinations, dockerjson, dpkg, esedb, filestat, firefox_cache, firefox_cache2, fsevents, gdrive_synclog, hachoir, java_idx, lnk, mac_appfirewall_log, mac_keychain, mac_securityd, mactime, macwifi, mcafee_protection, mft, msiecf, olecf, openxml, opera_global, opera_typed_history, pe, plist, pls_recall, popularity_contest, prefetch, recycle_bin, recycle_bin_info2, rplog, sccm, selinux, skydrive_log, skydrive_log_old, sophos_av, sqlite, symantec_scanlog, syslog, systemd_journal, trendmicro_vd, usnjrnl, utmp, utmpx, winevt, winevtx, winfirewall, winiis, winjob, winreg, xchatlog, xchatscrollback, zsh_extended_history\r\n2018-06-22 06:13:55,768 [DEBUG] (MainProcess) PID:7 <hashing_analyzer> Got hasher names: sha256\r\n2018-06-22 06:13:55,768 [DEBUG] (MainProcess) PID:7 <single_process> Processing started.\r\n2018-06-22 06:13:55,772 [DEBUG] (MainProcess) PID:7 <worker> [ProcessFileEntry] processing file entry: OS:/path/cookies.sqlite\r\n2018-06-22 06:13:55,772 [DEBUG] (MainProcess) PID:7 <worker> [ProcessFileEntryDataStream] processing data stream: \"\" of file entry: OS:/path/cookies.sqlite\r\n2018-06-22 06:13:55,772 [DEBUG] (MainProcess) PID:7 <worker> [AnalyzeDataStream] analyzing file: OS:/path/cookies.sqlite\r\n2018-06-22 06:13:55,778 [DEBUG] (MainProcess) PID:7 <hashing_analyzer> Processing results for hasher sha256\r\n2018-06-22 06:13:55,778 [DEBUG] (MainProcess) PID:7 <worker> [AnalyzeFileObject] attribute sha256_hash:379ac9073895c45ce81540d6e264666ef40918b52627bac169325b9d6b591f31 calculated for file: OS:/path/cookies.sqlite\r\n2018-06-22 06:13:55,778 [DEBUG] (MainProcess) PID:7 <worker> [AnalyzeDataStream] completed analyzing file: OS:/path/cookies.sqlite\r\n2018-06-22 06:13:55,778 [DEBUG] (MainProcess) PID:7 <worker> [ExtractMetadataFromFileEntry] processing file entry: OS:/path/cookies.sqlite\r\n2018-06-22 06:13:55,781 [DEBUG] (MainProcess) PID:7 <extractors> [ParseFileEntryWithParsers] parsing file: OS:/path/cookies.sqlite with parser: sqlite\r\n2018-06-22 06:13:57,935 [DEBUG] (MainProcess) PID:7 <worker> [ProcessFileEntry] done processing file entry: OS:/path/cookies.sqlite\r\nChecking availability and versions of dependencies.\r\n[OPTIONAL]      missing: lzma.\r\n[OK]\r\n\r\n\r\nSource path     : /path/cookies.sqlite\r\nSource type     : single file\r\nProcessing time : 00:00:00\r\n\r\nProcessing started.\r\nTraceback (most recent call last):\r\n  File \"/usr/bin/log2timeline.py\", line 68, in <module>\r\n    if not Main():\r\n  File \"/usr/bin/log2timeline.py\", line 54, in Main\r\n    tool.ExtractEventsFromSources()\r\n  File \"/usr/lib/python2.7/dist-packages/plaso/cli/log2timeline_tool.py\", line 433, in ExtractEventsFromSources\r\n    status_update_callback=status_update_callback)\r\n  File \"/usr/lib/python2.7/dist-packages/plaso/engine/single_process.py\", line 283, in ProcessSources\r\n    storage_writer.Close()\r\n  File \"/usr/lib/python2.7/dist-packages/plaso/storage/interface.py\", line 1308, in Close\r\n    self._storage_file.Close()\r\n  File \"/usr/lib/python2.7/dist-packages/plaso/storage/sqlite/sqlite_file.py\", line 665, in Close\r\n    self._WriteSerializedAttributeContainerList(self._CONTAINER_TYPE_EVENT)\r\n  File \"/usr/lib/python2.7/dist-packages/plaso/storage/sqlite/sqlite_file.py\", line 445, in _WriteSerializedAttributeContainerList\r\n    self._cursor.executemany(query, values_tuple_list)\r\nOverflowError: Python int too large to convert to SQLite INTEGER\r\n```\r\n"},"comment":{"url":"https://api.github.com/repos/log2timeline/plaso/issues/comments/402031946","html_url":"https://github.com/log2timeline/plaso/issues/1970#issuecomment-402031946","issue_url":"https://api.github.com/repos/log2timeline/plaso/issues/1970","id":402031946,"node_id":"MDEyOklzc3VlQ29tbWVudDQwMjAzMTk0Ng==","user":{"login":"joachimmetz","id":3888750,"node_id":"MDQ6VXNlcjM4ODg3NTA=","avatar_url":"https://avatars2.githubusercontent.com/u/3888750?v=4","gravatar_id":"","url":"https://api.github.com/users/joachimmetz","html_url":"https://github.com/joachimmetz","followers_url":"https://api.github.com/users/joachimmetz/followers","following_url":"https://api.github.com/users/joachimmetz/following{/other_user}","gists_url":"https://api.github.com/users/joachimmetz/gists{/gist_id}","starred_url":"https://api.github.com/users/joachimmetz/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/joachimmetz/subscriptions","organizations_url":"https://api.github.com/users/joachimmetz/orgs","repos_url":"https://api.github.com/users/joachimmetz/repos","events_url":"https://api.github.com/users/joachimmetz/events{/privacy}","received_events_url":"https://api.github.com/users/joachimmetz/received_events","type":"User","site_admin":false},"created_at":"2018-07-03T06:52:24Z","updated_at":"2018-07-03T06:52:24Z","author_association":"MEMBER","body":"Any chance you could share the data or debug print the values tuple list to determine what the large integer is and where this value originates."}}
{"actor":{"display_login":"joachimmetz"}}