{"action":"created","issue":{"url":"https://api.github.com/repos/Arachni/arachni/issues/664","labels_url":"https://api.github.com/repos/Arachni/arachni/issues/664/labels{/name}","comments_url":"https://api.github.com/repos/Arachni/arachni/issues/664/comments","events_url":"https://api.github.com/repos/Arachni/arachni/issues/664/events","html_url":"https://github.com/Arachni/arachni/issues/664","id":128214429,"number":664,"title":"The crawler has been crawling the same URL","user":{"login":"arschlochnop","id":7948693,"avatar_url":"https://avatars.githubusercontent.com/u/7948693?v=3","gravatar_id":"","url":"https://api.github.com/users/arschlochnop","html_url":"https://github.com/arschlochnop","followers_url":"https://api.github.com/users/arschlochnop/followers","following_url":"https://api.github.com/users/arschlochnop/following{/other_user}","gists_url":"https://api.github.com/users/arschlochnop/gists{/gist_id}","starred_url":"https://api.github.com/users/arschlochnop/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/arschlochnop/subscriptions","organizations_url":"https://api.github.com/users/arschlochnop/orgs","repos_url":"https://api.github.com/users/arschlochnop/repos","events_url":"https://api.github.com/users/arschlochnop/events{/privacy}","received_events_url":"https://api.github.com/users/arschlochnop/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":2,"created_at":"2016-01-22T18:27:49Z","updated_at":"2016-01-22T18:53:54Z","closed_at":null,"body":"like title.\r\n![123](https://cloud.githubusercontent.com/assets/7948693/12519186/492c83cc-c178-11e5-9343-430cc5ee4b43.png)\r\n![456](https://cloud.githubusercontent.com/assets/7948693/12519266/c8040328-c178-11e5-9a90-78ab615c1e33.png)\r\n\r\n"},"comment":{"url":"https://api.github.com/repos/Arachni/arachni/issues/comments/174011107","html_url":"https://github.com/Arachni/arachni/issues/664#issuecomment-174011107","issue_url":"https://api.github.com/repos/Arachni/arachni/issues/664","id":174011107,"user":{"login":"Zapotek","id":375743,"avatar_url":"https://avatars.githubusercontent.com/u/375743?v=3","gravatar_id":"","url":"https://api.github.com/users/Zapotek","html_url":"https://github.com/Zapotek","followers_url":"https://api.github.com/users/Zapotek/followers","following_url":"https://api.github.com/users/Zapotek/following{/other_user}","gists_url":"https://api.github.com/users/Zapotek/gists{/gist_id}","starred_url":"https://api.github.com/users/Zapotek/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Zapotek/subscriptions","organizations_url":"https://api.github.com/users/Zapotek/orgs","repos_url":"https://api.github.com/users/Zapotek/repos","events_url":"https://api.github.com/users/Zapotek/events{/privacy}","received_events_url":"https://api.github.com/users/Zapotek/received_events","type":"User","site_admin":false},"created_at":"2016-01-22T18:53:53Z","updated_at":"2016-01-22T18:53:53Z","body":"It's not really that simple, the page state has changed so it needs to be processed again.\r\nIf there's JS in the page that keeps changing it significantly then this would be the result.\r\n\r\nYou can set scope redundancy rules to limit processing for certain URLs or try the nightlies, there have been some changes that might bypass the issue.\r\nAlternatively, I'd really like to see what's going on myself in case I can automate this for future versions.\r\n\r\nCheers"}}