{"push_id":2340377156,"size":1,"distinct_size":1,"ref":"refs/heads/Optimize_Spiders","head":"7a6dbfaf3ddec5dc994fcdd93f3c85753b68f0cc","before":"8bfcf717d2d8f979144c823b1089d80c36bc1fa9","commits":[{"sha":"7a6dbfaf3ddec5dc994fcdd93f3c85753b68f0cc","author":{"name":"Unknown","email":"f02dbe34c6930f7a37282ecc89a2c2c91b9a85b5@gmail.com"},"message":"Optimization Attempt, Ready for Testing\n\nFour primary changes:\n1. Split 'add_url' into 'add_to_queue' and 'process_url' functions. The former simply adds a url and domain to the database, while the latter is run once a url has proven valid, at which point it adds the rest of the url's data to the database.\n2. Rather than skipping untitled pages, simply add them with the title 'Unknown.'\n3. Use the variable page_title instead of creating a new_title variable.\n4. In the InvalidSchema error, rather than checking the existing schema, just add two new urls with http and https schemas.","distinct":true,"url":"https://api.github.com/repos/TorSpider/TorSpider/commits/7a6dbfaf3ddec5dc994fcdd93f3c85753b68f0cc"}]}
{"actor":{"display_login":"eloquentmess"}}