{"push_id":2968034387,"size":1,"distinct_size":1,"ref":"refs/heads/handle_errors_in_pub_loader_192","head":"51174285b0a9960d360f5d0a1e71d9154e4c7bc3","before":"03f25cc42d0cd2263f021396fd2d1f5cdb0842ef","commits":[{"sha":"51174285b0a9960d360f5d0a1e71d9154e4c7bc3","author":{"name":"Michael J. Giarlo","email":"f548840de6042f6ae364756bf33dde281cc996ba@stanford.edu"},"message":"Handle errors in publications executable\n\nFixes #192\n\nThis branch contains a number of changes intended to make harvesting and transforming publications more robust and less brittle. It also includes work to bring both the grants CLI and the publications CLI into alignment, increasing internal consistency in RIALTO-ETL. Specific changes include:\n\n* Add types to options (where missing) in grants CLI\n* List CLI options in a consistent order using the same args for each option\n* Rename `skip_existing` option to `force` with `-f` as an alias\n* Use global `options` object in CLI instead of passing them around as args\n* Halt extract/transform/load flow in publications CLI if extract or transform files do not exist\n* Use CLI classes in publications CLI instead of system calls\n* Add handling for throttled connections in WoS extractor, backing off and waiting when encountering these\n* Retry up to three times when connected is throttled\n* Handle firstname and lastname args in WoS extractor consistently as symbols\n* Encode outgoing GET params when hitting the entity resolver\n* Allow injection of output file path into Transformer so code is less reliant on stdout/CLI invocation","distinct":true,"url":"https://api.github.com/repos/sul-dlss-labs/rialto-etl/commits/51174285b0a9960d360f5d0a1e71d9154e4c7bc3"}]}
{"actor":{"display_login":"mjgiarlo"}}