{"push_id":1101605877,"size":6,"distinct_size":1,"ref":"refs/heads/ssds_spark_vs_monotasks","head":"fde557dce4e2d912fe66785eec8501e2d82816d2","before":"0d4313fd17dd115ceeafc6222f56165122a6eb5a","commits":[{"sha":"7849e4d6826ed4deeb02e6a14d21e05308b5be35","author":{"email":"293fec30678232d02cab18e2c4abf03704f7c221@gmail.com","name":"Max Wolffe"},"message":"Add ideal compute time to parse_event_log script\n\nThis commit adds computing the ideal compute time to the parse\nevent logs script (so by default, the ideal time will be\nprinted out whenever parse_event_logs.py is run).","distinct":false,"url":"https://api.github.com/repos/christophercanel/monotasks-scripts/commits/7849e4d6826ed4deeb02e6a14d21e05308b5be35"},{"sha":"06fc26ead7ac6104b841ddf31be488682aa3d62b","author":{"email":"ee5683c622abc66b00bad517695b1d2485dfe7c2@icloud.com","name":"Christopher Canel"},"message":"Parse resource counters\n\nThis commit adds parsing for new GC, disk, and network transmit idle\ntime counters to the event log parsing scripts. After these counters\nhave been parsed, executor-level end-to-end metrics are calculated for\nstages and jobs.","distinct":false,"url":"https://api.github.com/repos/christophercanel/monotasks-scripts/commits/06fc26ead7ac6104b841ddf31be488682aa3d62b"},{"sha":"5cfd94bdf685d95857bf302df111355d6dfa8369","author":{"email":"ee5683c622abc66b00bad517695b1d2485dfe7c2@icloud.com","name":"Christopher Canel"},"message":"Fix parameter ordering bug\n\nThe elapsed time and number of tasks parameters were swapped when\ncalling the ExecutorResourceMetrics constructor. Also, this commit\nremoves an unnecessary import, fixes a variable naming irregularity, and\nadds the elapsed time to the metrics logs.","distinct":false,"url":"https://api.github.com/repos/christophercanel/monotasks-scripts/commits/5cfd94bdf685d95857bf302df111355d6dfa8369"},{"sha":"43045f9ddd51a8edab77af88c09a4e13487a2e75","author":{"email":"ee5683c622abc66b00bad517695b1d2485dfe7c2@icloud.com","name":"Christopher Canel"},"message":"Add throughputs to stage and job metrics\n\nModified the classes in metrics.py to calculate utilization and\neffective throughput. Added a new metrics class: CpuMetrics. We cannot\ncalculate the disk read and disk write throughputs separately because\nthe disk counters that track read/write access time are not updated\nlive; instead, they are only updated when an access completes, which\nleads to inaccuracies.","distinct":false,"url":"https://api.github.com/repos/christophercanel/monotasks-scripts/commits/43045f9ddd51a8edab77af88c09a4e13487a2e75"},{"sha":"0c6ebfaad73dc43c7baadcf199dae4e2023432f7","author":{"email":"ee5683c622abc66b00bad517695b1d2485dfe7c2@icloud.com","name":"Christopher Canel"},"message":"Add ideal time calculations\n\nAdded analysis code that calculates the ideal runtimes of a stage's CPU,\nnetwork, and disk tasks. These ideal times, along with the ideal job\ncompletion times (which are just the sum of the ideal runtimes of the\nbottleneck resource in each of a job's stages) are saved to a file.","distinct":false,"url":"https://api.github.com/repos/christophercanel/monotasks-scripts/commits/0c6ebfaad73dc43c7baadcf199dae4e2023432f7"},{"sha":"fde557dce4e2d912fe66785eec8501e2d82816d2","author":{"email":"ee5683c622abc66b00bad517695b1d2485dfe7c2@icloud.com","name":"Christopher Canel"},"message":"Add script to compare Spark and Monotasks with SSDs","distinct":true,"url":"https://api.github.com/repos/christophercanel/monotasks-scripts/commits/fde557dce4e2d912fe66785eec8501e2d82816d2"}]}