{"push_id":1111716402,"size":13,"distinct_size":13,"ref":"refs/heads/log_basebackup","head":"98401da9ec6ba56885a0db01b482e1fa368478c2","before":"f5672cedb53bf74b10e2ba7a66926f45850bdc73","commits":[{"sha":"3461b5f04a07a2f2f287d7b231aef316f3b1f3c8","author":{"email":"999a3419d9959d3c39b11dcc67d79c7888b4b765@ohmu.fi","name":"Oskari Saarenmaa"},"message":"google: reset client on server errors\n\nCreate a new context manager for the object client which resets the client\non server errors as well as provides a convinient way to map 404 Not Found\nerrors into our own exception type.\n\nThis should hopefully fix endless loops of errors like this:\n\n    May 12 07:48:54 c5981 pghoard[37]: Compressor Thread-5 INFO: Compressed and encrypted 16777216 byte open file '/var/lib/pgsql/9.6/data/pg_xlog/00000001000000000000000A' to 790301 bytes (4%), took: 0.063s\n    May 12 07:48:54 c5981 pghoard[37]: TransferAgent Thread-11 ERROR: Problem in moving file: '/var/lib/pgsql/9.6/data/pg_xlog/00000001000000000000000A', need to retry\n    May 12 07:48:54 c5981 pghoard[37]: Traceback (most recent call last):\n    May 12 07:48:54 c5981 pghoard[37]: File \"/usr/lib/python3.4/site-packages/pghoard/transfer.py\", line 163, in handle_upload\n    May 12 07:48:54 c5981 pghoard[37]: metadata=file_to_transfer[\"metadata\"])\n    May 12 07:48:54 c5981 pghoard[37]: File \"/usr/lib/python3.4/site-packages/pghoard/rohmu/object_storage/google.py\", line 193, in store_file_from_memory\n    May 12 07:48:54 c5981 pghoard[37]: return self._upload(MediaIoBaseUpload, BytesIO(memstring), key, metadata, extra_props)\n    May 12 07:48:54 c5981 pghoard[37]: File \"/usr/lib/python3.4/site-packages/pghoard/rohmu/object_storage/google.py\", line 188, in _upload\n    May 12 07:48:54 c5981 pghoard[37]: status, response = request.next_chunk()\n    May 12 07:48:54 c5981 pghoard[37]: File \"/usr/lib/python3.4/site-packages/oauth2client/util.py\", line 135, in positional_wrapper\n    May 12 07:48:54 c5981 pghoard[37]: return wrapped(*args, **kwargs)\n    May 12 07:48:54 c5981 pghoard[37]: File \"/usr/lib/python3.4/site-packages/googleapiclient/http.py\", line 814, in next_chunk\n    May 12 07:48:54 c5981 pghoard[37]: raise ResumableUploadError(resp, content)\n    May 12 07:48:54 c5981 pghoard[37]: googleapiclient.errors.ResumableUploadError: <HttpError 500 \"Backend Error\">\n    May 12 07:48:55 c5981 pghoard[37]: TransferAgent Thread-11 INFO: 'UPLOAD' FAILED transfer of key: '5b7ce1cc-0a0a-46c8-afef-a455808d3ef2/726d5039-0e68-4f0c-98b3-39f8bff8b30b/xlog/00000001000000000000000A', size: 790301, took 0.547s","distinct":true,"url":"https://api.github.com/repos/Ormod/pghoard/commits/3461b5f04a07a2f2f287d7b231aef316f3b1f3c8"},{"sha":"887addea4ab4d816eb1b3f3f699d992f77298713","author":{"email":"999a3419d9959d3c39b11dcc67d79c7888b4b765@ohmu.fi","name":"Oskari Saarenmaa"},"message":"pgutil: split postgresql utils out of common.py into a new pgutil.py\n\nThe upstream for pgutil is now https://github.com/ohmu/ohmu_common_py but\nthe files from there are copied verbatim into this project.  The\nohmu_common_py repository may become a proper Python module at some point,\nor we may end up phasing it out, but splitting utilities out of common.py\nprobably makes sense anyway.","distinct":true,"url":"https://api.github.com/repos/Ormod/pghoard/commits/887addea4ab4d816eb1b3f3f699d992f77298713"},{"sha":"48b598dfe46a5cf1e241972fdda6e1f365f395a2","author":{"email":"999a3419d9959d3c39b11dcc67d79c7888b4b765@ohmu.fi","name":"Oskari Saarenmaa"},"message":"logutil: move logging bits to a new logutil module in ohmu_common_py","distinct":true,"url":"https://api.github.com/repos/Ormod/pghoard/commits/48b598dfe46a5cf1e241972fdda6e1f365f395a2"},{"sha":"f862d70283dd6c8f19553caba6b4b09302dfcd3e","author":{"email":"c478a5f3dd479548d50ca36c38df068e39587ff3@ohmu.fi","name":"Hannu Valtonen"},"message":"Merge pull request #114 from saaros/google-reset\n\ngoogle: reset client on server errors","distinct":true,"url":"https://api.github.com/repos/Ormod/pghoard/commits/f862d70283dd6c8f19553caba6b4b09302dfcd3e"},{"sha":"f30cadee57514123fd9b26ec0853cf8ca96a6344","author":{"email":"999a3419d9959d3c39b11dcc67d79c7888b4b765@ohmu.fi","name":"Oskari Saarenmaa"},"message":"startup_walk_for_missed_files: handle compressed and uncompressed files\n\nPreviously startup_walk_for_missed_files didn't consider compressed and\nuncompressed incoming files (ie files received by receivexlog) separately\nand tried to recompress already compressed files and left uncompressed files\nalone.","distinct":true,"url":"https://api.github.com/repos/Ormod/pghoard/commits/f30cadee57514123fd9b26ec0853cf8ca96a6344"},{"sha":"1caba0bc99d934f109cb0734053c4a9ef5d1c305","author":{"email":"c478a5f3dd479548d50ca36c38df068e39587ff3@ohmu.fi","name":"Hannu Valtonen"},"message":"Merge pull request #117 from saaros/startup-walk\n\nstartup_walk_for_missed_files: handle compressed and uncompressed files","distinct":true,"url":"https://api.github.com/repos/Ormod/pghoard/commits/1caba0bc99d934f109cb0734053c4a9ef5d1c305"},{"sha":"aa88ba6b8fe4879b1aca13fd8f3a6a34d2e6017a","author":{"email":"2f629c4d93e35c3d371f0463b040c6ef04a5c1e5@ohmu.fi","name":"Mika Eloranta"},"message":"Merge pull request #116 from saaros/ohmu_common_py\n\nMove logging and pg util bits out of common.py\r\n\r\nhttps://github.com/ohmu/pghoard/pull/116","distinct":true,"url":"https://api.github.com/repos/Ormod/pghoard/commits/aa88ba6b8fe4879b1aca13fd8f3a6a34d2e6017a"},{"sha":"a58e3176321fdea91708df27b7b7fa191cd21fe3","author":{"email":"999a3419d9959d3c39b11dcc67d79c7888b4b765@ohmu.fi","name":"Oskari Saarenmaa"},"message":"wal: add 9.6 beta1 wal magic number\n\nWe need to recognize the magic number from WAL to archive it.","distinct":true,"url":"https://api.github.com/repos/Ormod/pghoard/commits/a58e3176321fdea91708df27b7b7fa191cd21fe3"},{"sha":"94fd075e34c7faacc2c42428e81a19e4f36d48af","author":{"email":"c478a5f3dd479548d50ca36c38df068e39587ff3@ohmu.fi","name":"Hannu Valtonen"},"message":"Merge pull request #118 from saaros/pg96beta1\n\nwal: add 9.6 beta1 wal magic number","distinct":true,"url":"https://api.github.com/repos/Ormod/pghoard/commits/94fd075e34c7faacc2c42428e81a19e4f36d48af"},{"sha":"417a97347467e223874e116e818dcbde54ea2217","author":{"email":"2f629c4d93e35c3d371f0463b040c6ef04a5c1e5@ohmu.fi","name":"Mika Eloranta"},"message":"rohmu: enforce string keys and values in file metadata","distinct":true,"url":"https://api.github.com/repos/Ormod/pghoard/commits/417a97347467e223874e116e818dcbde54ea2217"},{"sha":"e40128443cfa6c1c2b455dd873f9c8a16c1d45ed","author":{"email":"999a3419d9959d3c39b11dcc67d79c7888b4b765@ohmu.fi","name":"Oskari Saarenmaa"},"message":"Merge remote-tracking branch 'melor/metadata_values'\n\n* melor/metadata_values:\n  rohmu: enforce string keys and values in file metadata\n\nhttps://github.com/ohmu/pghoard/pull/119","distinct":true,"url":"https://api.github.com/repos/Ormod/pghoard/commits/e40128443cfa6c1c2b455dd873f9c8a16c1d45ed"},{"sha":"6ca80a8c7b7587f707fb9a3c40003b47a7fa7e08","author":{"email":"c478a5f3dd479548d50ca36c38df068e39587ff3@ohmu.fi","name":"Hannu Valtonen"},"message":"basebackup: On PG 9.2 don't turn on --progress reporting for pg_basebackup\n\nThe progress reporting is incredibly noisy on PG 9.2. This was already\nfixed in 9.3 so lets just silence it for 9.2.","distinct":true,"url":"https://api.github.com/repos/Ormod/pghoard/commits/6ca80a8c7b7587f707fb9a3c40003b47a7fa7e08"},{"sha":"98401da9ec6ba56885a0db01b482e1fa368478c2","author":{"email":"c478a5f3dd479548d50ca36c38df068e39587ff3@ohmu.fi","name":"Hannu Valtonen"},"message":"basebackup: Store last 100 lines of logging from pg_basebackup\n\nAnd log them as ERROR logs in case pg_basebackup fails somehow.","distinct":true,"url":"https://api.github.com/repos/Ormod/pghoard/commits/98401da9ec6ba56885a0db01b482e1fa368478c2"}]}