{"push_id":1212895080,"size":33,"distinct_size":33,"ref":"refs/heads/master","head":"8c72b0608c7a62ec046cc329a484fa940cd72e90","before":"63ae71a57e064030883e9f8c8b9d5476ba8510bd","commits":[{"sha":"76b73d917b60ad535d0059fda5fed329befa0756","author":{"name":"HenryLee","email":"1d8993594644f01f80b37fbb4d700eada808b287@foxmail.com"},"message":"修复web版长时间运行因丢失cookie而可能引发panic的问题","distinct":true,"url":"https://api.github.com/repos/poweryang1990/pholcus/commits/76b73d917b60ad535d0059fda5fed329befa0756"},{"sha":"46fe1ef0f38f442ee29e13c2fbd94325aca46789","author":{"name":"zhiping","email":"321f6ab9a1fc307cd8645836f3a4ea7ae8cbe539@uoko.com"},"message":"Merge branch 'master' of https://github.com/henrylee2cn/pholcus","distinct":true,"url":"https://api.github.com/repos/poweryang1990/pholcus/commits/46fe1ef0f38f442ee29e13c2fbd94325aca46789"},{"sha":"9dff86f8c24eeff2367cf8d17de4c908ae9b9b7d","author":{"name":"HenryLee","email":"1d8993594644f01f80b37fbb4d700eada808b287@foxmail.com"},"message":"降低内存占用及一些小优化：\n1. DateCell、FileCell、Context均增加Pool，进行重用；\n2. 每2分钟检查一次可重用内存，若大于50M，则手动释放一次内存；\n3. 直接下载文件时，log日志增加显示文件大小；\n4. 配置文件中 mysqlmaxallowedpacket -> mysqlmaxallowedpacketmb，单位为MB。","distinct":true,"url":"https://api.github.com/repos/poweryang1990/pholcus/commits/9dff86f8c24eeff2367cf8d17de4c908ae9b9b7d"},{"sha":"c89b9f1ba27bbacffcef605059293b6190b6a2b1","author":{"name":"HenryLee","email":"1d8993594644f01f80b37fbb4d700eada808b287@foxmail.com"},"message":"降低内存占用及一些小优化：\n1. DateCell、FileCell、Context均增加Pool，进行重用；\n2. 每2分钟检查一次可重用内存，若大于50M，则手动释放一次内存；\n3. 直接下载文件时，log日志增加显示文件大小；\n4. 配置文件中 mysqlmaxallowedpacket -> mysqlmaxallowedpacketmb，单位为MB。","distinct":true,"url":"https://api.github.com/repos/poweryang1990/pholcus/commits/c89b9f1ba27bbacffcef605059293b6190b6a2b1"},{"sha":"c7595f95cdeccba5b2abd9fcb4e63f4bb22724b6","author":{"name":"HenryLee","email":"1d8993594644f01f80b37fbb4d700eada808b287@foxmail.com"},"message":"修复输出文件的路径以\"\\\"分割时，目录创建失效的bug","distinct":true,"url":"https://api.github.com/repos/poweryang1990/pholcus/commits/c7595f95cdeccba5b2abd9fcb4e63f4bb22724b6"},{"sha":"cb74bdcb781716f0c893bbbf006621ee5a229bec","author":{"name":"HenryLee","email":"1d8993594644f01f80b37fbb4d700eada808b287@foxmail.com"},"message":"修复savefile","distinct":true,"url":"https://api.github.com/repos/poweryang1990/pholcus/commits/cb74bdcb781716f0c893bbbf006621ee5a229bec"},{"sha":"f19feaa43f2ce419c7d72f966945dd3708666a24","author":{"name":"HenryLee","email":"1d8993594644f01f80b37fbb4d700eada808b287@foxmail.com"},"message":"修复CrawlPool.Use()与CrawlPool.Free()的写竞争，修复log配置信息的自动纠错功能。","distinct":true,"url":"https://api.github.com/repos/poweryang1990/pholcus/commits/f19feaa43f2ce419c7d72f966945dd3708666a24"},{"sha":"c7e2d23e0eb70f1da5e8e0b0e0bd900ee94a8e55","author":{"name":"HenryLee","email":"1d8993594644f01f80b37fbb4d700eada808b287@foxmail.com"},"message":"修复解析多个动态规则时的闭包问题","distinct":true,"url":"https://api.github.com/repos/poweryang1990/pholcus/commits/c7e2d23e0eb70f1da5e8e0b0e0bd900ee94a8e55"},{"sha":"cdc3356a4640443f38b07cf7d5b127d124ba5e79","author":{"name":"HenryLee","email":"1d8993594644f01f80b37fbb4d700eada808b287@foxmail.com"},"message":"修复 issue #17","distinct":true,"url":"https://api.github.com/repos/poweryang1990/pholcus/commits/cdc3356a4640443f38b07cf7d5b127d124ba5e79"},{"sha":"c69ca7a7a51ef6adf16513f7ce0697d873509f44","author":{"name":"HenryLee","email":"1d8993594644f01f80b37fbb4d700eada808b287@foxmail.com"},"message":"增加对gzip的支持，修复csv和excel文件名的数字后缀","distinct":true,"url":"https://api.github.com/repos/poweryang1990/pholcus/commits/c69ca7a7a51ef6adf16513f7ce0697d873509f44"},{"sha":"5de1caf46e7f0b7bf295aaa139e22430af4338fb","author":{"name":"HenryLee","email":"1d8993594644f01f80b37fbb4d700eada808b287@foxmail.com"},"message":"修复动态规则中设置Header无效的bug","distinct":true,"url":"https://api.github.com/repos/poweryang1990/pholcus/commits/5de1caf46e7f0b7bf295aaa139e22430af4338fb"},{"sha":"4f104c8acdec6edcd517506e0cb92388a288a5f6","author":{"name":"HenryLee","email":"1d8993594644f01f80b37fbb4d700eada808b287@foxmail.com"},"message":"标记v1.0.0稳定版","distinct":true,"url":"https://api.github.com/repos/poweryang1990/pholcus/commits/4f104c8acdec6edcd517506e0cb92388a288a5f6"},{"sha":"724f2671ffec8370a9c731c991142cdb5c1dbe67","author":{"name":"HenryLee","email":"1d8993594644f01f80b37fbb4d700eada808b287@foxmail.com"},"message":"更新：\n1. 修复mysql中失败记录表创建失败的bug，避免记录重复的失败记录，提升失败记录更新效率；\n2. 优化Request.GetTemp()方法，增加Request.Unique()方法；\n3. 将HTTP状态码大于等于400的请求自动标记为下载失败；\n4. 移除文件输出目录的日期后缀；\n5. Spider.Register()方法改为接受Spider类型（之前为*Spider），从而使用 \"Var XXXSpider=Spider{}.Register()\" 的方式进行规则声明。","distinct":true,"url":"https://api.github.com/repos/poweryang1990/pholcus/commits/724f2671ffec8370a9c731c991142cdb5c1dbe67"},{"sha":"3ab7ef8f557d8957ff42e90ffd913a8f543ef5bc","author":{"name":"HenryLee","email":"1d8993594644f01f80b37fbb4d700eada808b287@foxmail.com"},"message":"优化任务停止条件，Spider.Root退出之前，任务不可终止","distinct":true,"url":"https://api.github.com/repos/poweryang1990/pholcus/commits/3ab7ef8f557d8957ff42e90ffd913a8f543ef5bc"},{"sha":"7f2bb76b11079a9733162ce511f8450fcc241deb","author":{"name":"HenryLee","email":"1d8993594644f01f80b37fbb4d700eada808b287@foxmail.com"},"message":"增加输出文件目录的配置项","distinct":true,"url":"https://api.github.com/repos/poweryang1990/pholcus/commits/7f2bb76b11079a9733162ce511f8450fcc241deb"},{"sha":"d38eb60b33a18cfb0bac68b58f5d2e62ad051109","author":{"name":"HenryLee","email":"1d8993594644f01f80b37fbb4d700eada808b287@foxmail.com"},"message":"更新配置文件","distinct":true,"url":"https://api.github.com/repos/poweryang1990/pholcus/commits/d38eb60b33a18cfb0bac68b58f5d2e62ad051109"},{"sha":"b8c5f7f5143e104c451252b0199b35dba4aed76b","author":{"name":"HenryLee","email":"1d8993594644f01f80b37fbb4d700eada808b287@foxmail.com"},"message":"增强自动转码功能\n当响应头未指定编码类型时，从请求头读取；\n都未指定编码类型或编码类型为utf8时，不做转码，节约内存","distinct":true,"url":"https://api.github.com/repos/poweryang1990/pholcus/commits/b8c5f7f5143e104c451252b0199b35dba4aed76b"},{"sha":"977b891282b812a2770fd2a19002ebb63dc7316c","author":{"name":"HenryLee","email":"1d8993594644f01f80b37fbb4d700eada808b287@foxmail.com"},"message":"增加支持自动解压缩deflate和zlib编码的响应流","distinct":true,"url":"https://api.github.com/repos/poweryang1990/pholcus/commits/977b891282b812a2770fd2a19002ebb63dc7316c"},{"sha":"271f019dad9276ff0e1aeacb985f9ee108e7178c","author":{"name":"HenryLee","email":"1d8993594644f01f80b37fbb4d700eada808b287@foxmail.com"},"message":"移除downloader.go中冗余代码","distinct":true,"url":"https://api.github.com/repos/poweryang1990/pholcus/commits/271f019dad9276ff0e1aeacb985f9ee108e7178c"},{"sha":"bc4bcecb55ec072477b98c4080dc1f06351e3ee6","author":{"name":"HenryLee","email":"1d8993594644f01f80b37fbb4d700eada808b287@foxmail.com"},"message":"格式化自动转码失败后的错误日志","distinct":true,"url":"https://api.github.com/repos/poweryang1990/pholcus/commits/bc4bcecb55ec072477b98c4080dc1f06351e3ee6"}]}
{"actor":{"display_login":"poweryang1990"}}