{"action":"closed","issue":{"url":"https://api.github.com/repos/s3inlc/hashtopolis/issues/221","repository_url":"https://api.github.com/repos/s3inlc/hashtopolis","labels_url":"https://api.github.com/repos/s3inlc/hashtopolis/issues/221/labels{/name}","comments_url":"https://api.github.com/repos/s3inlc/hashtopolis/issues/221/comments","events_url":"https://api.github.com/repos/s3inlc/hashtopolis/issues/221/events","html_url":"https://github.com/s3inlc/hashtopolis/issues/221","id":239854420,"number":221,"title":"Hash cracked during benchmarking phase, never successfully completes.","user":{"login":"Console","id":699884,"avatar_url":"https://avatars2.githubusercontent.com/u/699884?v=4","gravatar_id":"","url":"https://api.github.com/users/Console","html_url":"https://github.com/Console","followers_url":"https://api.github.com/users/Console/followers","following_url":"https://api.github.com/users/Console/following{/other_user}","gists_url":"https://api.github.com/users/Console/gists{/gist_id}","starred_url":"https://api.github.com/users/Console/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Console/subscriptions","organizations_url":"https://api.github.com/users/Console/orgs","repos_url":"https://api.github.com/users/Console/repos","events_url":"https://api.github.com/users/Console/events{/privacy}","received_events_url":"https://api.github.com/users/Console/received_events","type":"User","site_admin":false},"labels":[{"id":803834575,"url":"https://api.github.com/repos/s3inlc/hashtopolis/labels/to%20check%20on%20new%20version","name":"to check on new version","color":"e2ca78","default":false}],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":5,"created_at":"2017-06-30T18:23:05Z","updated_at":"2018-03-19T09:49:38Z","closed_at":"2018-03-19T09:49:37Z","author_association":"NONE","body":"```\r\nYour current Server version: v0.3.2\r\nCurrent Client version: 0.43.13\r\nYour current Hashcat version v3.6.0\r\nTask Command: -a0 #HL# -r dive.rule rockyou.txt\r\n```\r\n\r\nCurrently testing an SPN hash (13100) with a standard rockyou.txt and dive tasking. The password is known to be: ` AsdfJkl;`\r\n\r\nThis works when calling hashcat manually using the details in the job.\r\n\r\n`./hashcat/hashcat64.bin -a0 ./hashlists/24 -r ./files/dive.rule ./files/rockyou.txt -m 13100`\r\n\r\nAnd successfully cracks the password in seconds, however a distributed job involving 1 to 6 hosts over the entire task fails to successful register a crack and i've re-run the task multiple times.\r\n\r\nCloser inspection suspecting something was up with the benchmarking process as it was completing incredibly fast, revealed that the benchmark command:\r\n\r\n`sudo /home/xxxx/xxxx-hashtopussy/hashcat/hashcat64.bin --force -w2 --hash-type=13100 -a0 \"/home/xxxx/xxxx-hashtopussy/hashlists/26\"  -r \"/home/xxxx/xxxx-hashtopussy/files/dive.rule\" \"/home/xxxx/xxxx-hashtopussy/files/rockyou.txt\" --runtime=30 --restore-disable --potfile-disable --session=hashtopussy --weak=0` *note I removed the --machine-readable.\r\n\r\nWas actually cracking the hash within the first second of the benchmark.\r\n\r\nhashcat (v3.6.0) starting...\r\n\r\nOpenCL Platform #1: Intel(R) Corporation\r\n========================================\r\n* Device #1: Intel(R) HD Graphics, 4095/12590 MB allocatable, 24MCU\r\n* Device #2: Intel(R) Core(TM) i7-5600U CPU @ 2.60GHz, skipped.\r\n\r\nHashes: 1 digests; 1 unique digests, 1 unique salts\r\nBitmaps: 16 bits, 65536 entries, 0x0000ffff mask, 262144 bytes, 5/13 rotates\r\nRules: 99086\r\n\r\nApplicable optimizers:\r\n* Zero-Byte\r\n* Not-Iterated\r\n* Single-Hash\r\n* Single-Salt\r\n\r\nWatchdog: Hardware monitoring interface not found on your system.\r\nWatchdog: Temperature abort trigger disabled.\r\nWatchdog: Temperature retain trigger disabled.\r\n\r\nDictionary cache hit:\r\n* Filename..: /home/xxxx/xxxx-hashtopussy/files/rockyou.txt\r\n* Passwords.: 7296170\r\n* Bytes.....: 70205997\r\n* Keyspace..: 722948300620\r\n\r\n$krb5tgs$23$*xxxx.xxxx$xxxx.xxxx$xxxx/xxxx_xxxx.xxxx.xxxx:1433*$0815c0f53786fc7d32d38bff0c5bc50a$db3c62d7a3d69...SNIP...2644351ab0171f5479cefa3:AsdfJkl;\r\n                                                          \r\nSession..........: hashtopussy\r\nStatus...........: Cracked\r\nHash.Type........: Kerberos 5 TGS-REP etype 23\r\nHash.Target......: $krb5tgs$23$*xxxx.xxxx$xxxx.xxxx$xxxx/xxxx...xxxx\r\nTime.Started.....: Fri Jun 30 09:48:35 2017 (1 sec)\r\nTime.Estimated...: Fri Jun 30 09:48:36 2017 (0 secs; Runtime limited: 29 secs)\r\nGuess.Base.......: File (/home/xxxx/xxxx-hashtopussy/files/rockyou.txt)\r\nGuess.Mod........: Rules (/home/xxxx/xxxx-hashtopussy/files/dive.rule)\r\nGuess.Queue......: 1/1 (100.00%)\r\nSpeed.Dev.#1.....:  2946.5 kH/s (7.27ms)\r\nRecovered........: 1/1 (100.00%) Digests, 1/1 (100.00%) Salts\r\nProgress.........: 2457600/722948300620 (0.00%)\r\nRejected.........: 0/2457600 (0.00%)\r\nRestore.Point....: 0/7296170 (0.00%)\r\nCandidates.#1....: 1234567 -> hORoScope\r\nHWMon.Dev.#1.....: N/A\r\n\r\nStarted: Fri Jun 30 09:48:33 2017\r\nStopped: Fri Jun 30 09:48:36 2017\r\n\r\nWhich meant the benchmark was completed within 1 second of starting, not lasting the full 30 seconds.\r\n\r\nI'm not sure if this is causing the issue but its certainly an odd behaviour.\r\n\r\nHere is some more debug output from hashtopussy earlier when trying to debug the task, as you can see it still runs the command just fine and appears to return a H/S figure and completes chunks. Just never registers a successful crack.\r\n\r\n```\r\n{\"action\":\"chunk\",\"response\":\"SUCCESS\",\"status\":\"OK\",\"chunk\":2000,\"skip\":2641287,\"length\":496}\r\n/home/xxxx/xxxx-hashtopussy/hashcat/hashcat64.bin  --force -w2 --hash-type=13100 -a0 \"/home/xxxx/xxxx-hashtopussy/hashlists/26\"   -r \"/home/xxxx/xxxx-hashtopussy/files/dive.rule\" \"/home/xxxx/xxxx-hashtopussy/files/rockyou.txt\" --outfile-check-dir=\"/home/xxxx/xxxx-hashtopussy/hashlists/zaps26\"  --potfile-disable --quiet --restore-disable --session=hashtopussy --status --machine-readable --status-timer=5 --outfile-check-timer=5 --remove --remove-timer=5 --separator=: -s 2641287 -l 496\r\nSTATUS\t2\tSPEED\t1557\t1\tEXEC_RUNTIME\t0.934115\tCURKU\t2641287\tPROGRESS\t261718785634\t261763710338\tRECHASH\t0\t1\tRECSALT\t0\t1\tTEMP\t-1\tREJECTED\t0\r\n{\"action\":\"solve\",\"token\":\"B2CsNwh36x\",\"chunk\":2000,\"keyspaceProgress\":2641287,\"progress\":261718785634,\"total\":261763710338,\"speed\":1557,\"state\":2,\"cracks\":[]}\r\n{\"action\":\"solve\",\"response\":\"SUCCESS\",\"cracked\":0,\"skipped\":0,\"zaps\":[]}\r\nProgress:  8.59% | Speed:1.56MH/s | Cracks:0    | Accepted:0    | Zapped:0    | Queue:1 \r\nSTATUS\t2\tSPEED\t1508\t1\tEXEC_RUNTIME\t0.936873\tCURKU\t2641287\tPROGRESS\t261725654242\t261763710338\tRECHASH\t0\t1\tRECSALT\t0\t1\tTEMP\t-1\tREJECTED\t0\r\n{\"action\":\"solve\",\"token\":\"B2CsNwh36x\",\"chunk\":2000,\"keyspaceProgress\":2641287,\"progress\":261725654242,\"total\":261763710338,\"speed\":1508,\"state\":2,\"cracks\":[]}\r\n{\"action\":\"solve\",\"response\":\"SUCCESS\",\"cracked\":0,\"skipped\":0,\"zaps\":[]}\r\nProgress: 22.57% | Speed:1.51MH/s | Cracks:0    | Accepted:0    | Zapped:0    | Queue:1 \r\nSTATUS\t2\tSPEED\t1493\t1\tEXEC_RUNTIME\t0.938272\tCURKU\t2641287\tPROGRESS\t261732673634\t261763710338\tRECHASH\t0\t1\tRECSALT\t0\t1\tTEMP\t-1\tREJECTED\t0\r\n{\"action\":\"solve\",\"token\":\"B2CsNwh36x\",\"chunk\":2000,\"keyspaceProgress\":2641287,\"progress\":261732673634,\"total\":261763710338,\"speed\":1493,\"state\":2,\"cracks\":[]}\r\n{\"action\":\"solve\",\"response\":\"SUCCESS\",\"cracked\":0,\"skipped\":0,\"zaps\":[]}\r\nProgress: 36.85% | Speed:1.49MH/s | Cracks:0    | Accepted:0    | Zapped:0    | Queue:1 \r\nSTATUS\t2\tSPEED\t1400\t1\tEXEC_RUNTIME\t0.946614\tCURKU\t2641287\tPROGRESS\t261739800162\t261763710338\tRECHASH\t0\t1\tRECSALT\t0\t1\tTEMP\t-1\tREJECTED\t0\r\n{\"action\":\"solve\",\"token\":\"B2CsNwh36x\",\"chunk\":2000,\"keyspaceProgress\":2641287,\"progress\":261739800162,\"total\":261763710338,\"speed\":1400,\"state\":2,\"cracks\":[]}\r\n{\"action\":\"solve\",\"response\":\"SUCCESS\",\"cracked\":0,\"skipped\":0,\"zaps\":[]}\r\nProgress: 51.35% | Speed:1.40MH/s | Cracks:0    | Accepted:0    | Zapped:0    | Queue:1 \r\nSTATUS\t2\tSPEED\t1514\t1\tEXEC_RUNTIME\t0.942368\tCURKU\t2641287\tPROGRESS\t261746658850\t261763710338\tRECHASH\t0\t1\tRECSALT\t0\t1\tTEMP\t-1\tREJECTED\t0\r\n{\"action\":\"solve\",\"token\":\"B2CsNwh36x\",\"chunk\":2000,\"keyspaceProgress\":2641287,\"progress\":261746658850,\"total\":261763710338,\"speed\":1514,\"state\":2,\"cracks\":[]}\r\n{\"action\":\"solve\",\"response\":\"SUCCESS\",\"cracked\":0,\"skipped\":0,\"zaps\":[]}\r\nProgress: 65.30% | Speed:1.51MH/s | Cracks:0    | Accepted:0    | Zapped:0    | Queue:1 \r\nSTATUS\t2\tSPEED\t1555\t1\tEXEC_RUNTIME\t0.935074\tCURKU\t2641287\tPROGRESS\t261753692130\t261763710338\tRECHASH\t0\t1\tRECSALT\t0\t1\tTEMP\t-1\tREJECTED\t0\r\n{\"action\":\"solve\",\"token\":\"B2CsNwh36x\",\"chunk\":2000,\"keyspaceProgress\":2641287,\"progress\":261753692130,\"total\":261763710338,\"speed\":1555,\"state\":2,\"cracks\":[]}\r\n{\"action\":\"solve\",\"response\":\"SUCCESS\",\"cracked\":0,\"skipped\":0,\"zaps\":[]}\r\nProgress: 79.62% | Speed:1.56MH/s | Cracks:0    | Accepted:0    | Zapped:0    | Queue:1 \r\nSTATUS\t2\tSPEED\t1559\t1\tEXEC_RUNTIME\t0.937950\tCURKU\t2641287\tPROGRESS\t261761128162\t261763710338\tRECHASH\t0\t1\tRECSALT\t0\t1\tTEMP\t-1\tREJECTED\t0\r\nSTATUS\t4\tSPEED\t1526\t1\tEXEC_RUNTIME\t0.930973\tCURKU\t2641783\tPROGRESS\t261763710338\t261763710338\tRECHASH\t0\t1\tRECSALT\t0\t1\tTEMP\t-1\tREJECTED\t0\r\n{\"action\":\"solve\",\"token\":\"B2CsNwh36x\",\"chunk\":2000,\"keyspaceProgress\":2641287,\"progress\":261761128162,\"total\":261763710338,\"speed\":1559,\"state\":2,\"cracks\":[]}\r\nAttack finished\r\n{\"action\":\"solve\",\"response\":\"SUCCESS\",\"cracked\":0,\"skipped\":0,\"zaps\":[]}\r\nProgress: 94.75% | Speed:1.56MH/s | Cracks:0    | Accepted:0    | Zapped:0    | Queue:2 \r\n{\"action\":\"solve\",\"token\":\"B2CsNwh36x\",\"chunk\":2000,\"keyspaceProgress\":2641783,\"progress\":261763710338,\"total\":261763710338,\"speed\":1526,\"state\":4,\"cracks\":[]}\r\n{\"action\":\"solve\",\"response\":\"SUCCESS\",\"cracked\":0,\"skipped\":0,\"zaps\":[]}\r\nProgress:100.00% | Speed:1.53MH/s | Cracks:0    | Accepted:0    | Zapped:0    | Queue:1 \r\nFinished processing chunk\r\nGetting chunk...\r\n\r\n```\r\n\r\nNB: Yes this is using my laptop, we're experiencing exactly the same behaviour on our GPU powered rigs."}}
{"actor":{"display_login":"s3inlc"}}