{"action":"created","issue":{"url":"https://api.github.com/repos/wal-e/wal-e/issues/221","repository_url":"https://api.github.com/repos/wal-e/wal-e","labels_url":"https://api.github.com/repos/wal-e/wal-e/issues/221/labels{/name}","comments_url":"https://api.github.com/repos/wal-e/wal-e/issues/221/comments","events_url":"https://api.github.com/repos/wal-e/wal-e/issues/221/events","html_url":"https://github.com/wal-e/wal-e/issues/221","id":133312300,"number":221,"title":"Segfaults on CentOS 7","user":{"login":"bfrog","id":135839,"avatar_url":"https://avatars.githubusercontent.com/u/135839?v=3","gravatar_id":"","url":"https://api.github.com/users/bfrog","html_url":"https://github.com/bfrog","followers_url":"https://api.github.com/users/bfrog/followers","following_url":"https://api.github.com/users/bfrog/following{/other_user}","gists_url":"https://api.github.com/users/bfrog/gists{/gist_id}","starred_url":"https://api.github.com/users/bfrog/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/bfrog/subscriptions","organizations_url":"https://api.github.com/users/bfrog/orgs","repos_url":"https://api.github.com/users/bfrog/repos","events_url":"https://api.github.com/users/bfrog/events{/privacy}","received_events_url":"https://api.github.com/users/bfrog/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":2,"created_at":"2016-02-12T18:35:36Z","updated_at":"2016-02-17T20:44:14Z","closed_at":null,"body":"I've had bad luck running this lately on CentOS 7, I get a segfault!\r\n\r\nThe backtrace from the coredump I get...\r\n\r\nmakes it look like an ssl issue with boto's s3 module?\r\n\r\n```\r\nGNU gdb (GDB) Red Hat Enterprise Linux 7.6.1-80.el7\r\nCopyright (C) 2013 Free Software Foundation, Inc.\r\nLicense GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>\r\nThis is free software: you are free to change and redistribute it.\r\nThere is NO WARRANTY, to the extent permitted by law.  Type \"show copying\"\r\nand \"show warranty\" for details.\r\nThis GDB was configured as \"x86_64-redhat-linux-gnu\".\r\nFor bug reporting instructions, please see:\r\n<http://www.gnu.org/software/gdb/bugs/>...\r\nReading symbols from /usr/bin/python2.7...Reading symbols from /usr/lib/debug/usr/bin/python2.7.debug...done.\r\ndone.\r\n[New LWP 30918]\r\n[New LWP 31017]\r\n[Thread debugging using libthread_db enabled]\r\nUsing host libthread_db library \"/lib64/libthread_db.so.1\".\r\nCore was generated by `/usr/bin/python /bin/wal-e backup-push /var/lib/pgsql/9.5/data'.\r\nProgram terminated with signal 11, Segmentation fault.\r\n#0  0x00007f0e9ba49c4b in load_verify_locations_args (self=0x18a5f70, cafile=cafile@entry=0x17ba5f4, capath=capath@entry=0x0, cadata=<optimized out>, cadata@entry=0x0)\r\n    at /usr/src/debug/Python-2.7.5/Modules/_ssl.c:2901\r\n2901\t        if (PyString_Check(cafile)) {\r\n(gdb) #0  0x00007f0e9ba49c4b in load_verify_locations_args (self=0x18a5f70, cafile=cafile@entry=<unknown at remote 0x17ba5f4>, capath=capath@entry=0x0, cadata=<optimized out>, cadata@entry=0x0)\r\n    at /usr/src/debug/Python-2.7.5/Modules/_ssl.c:2901\r\n#1  0x00007f0e9ba4a435 in newPySSLObject (ciphers=<optimized out>, cacerts_file=<optimized out>, proto_version=<optimized out>, certreq=PY_SSL_CERT_REQUIRED, socket_type=PY_SSL_CLIENT, cert_file=0x0, \r\n    key_file=0x0, Sock=0x1883f00) at /usr/src/debug/Python-2.7.5/Modules/_ssl.c:560\r\n#2  PySSL_sslwrap (self=<optimized out>, args=<optimized out>) at /usr/src/debug/Python-2.7.5/Modules/_ssl.c:705\r\n#3  0x00007f0ea735aaa4 in call_function (oparg=<optimized out>, pp_stack=0x7fff9cd8ea90) at /usr/src/debug/Python-2.7.5/Python/ceval.c:4098\r\n#4  PyEval_EvalFrameEx (\r\n    f=f@entry=Frame 0x196ae30, for file /usr/lib64/python2.7/site-packages/gevent/_ssl2.py, line 91, in __init__ (self=<SSLSocket(_sock=<_socket.socket at remote 0x1883f00>, _write_event=<gevent.core.io at remote 0x18fa848>, hub=<Hub(_resolver=<Resolver(pool=<ThreadPool(hub=<...>, _lock=<thread.lock at remote 0x7f0ea77d4f30>, pid=30918, fork_watcher=<gevent.core.fork at remote 0x18e7738>, manager=None, task_queue=<Queue(unfinished_tasks=0, queue=<collections.deque at remote 0x1877440>, maxsize=0, all_tasks_done=<Condition(release=<built-in method release of thread.lock object at remote 0x7f0ea77d4f70>, _Condition__lock=<thread.lock at remote 0x7f0ea77d4f70>, acquire=<built-in method acquire of thread.lock object at remote 0x7f0ea77d4f70>, _Condition__waiters=[]) at remote 0x18f3f90>, mutex=<thread.lock at remote 0x7f0ea77d4f70>, not_full=<Condition(release=<built-in method release of thread.lock object at remote 0x7f0ea77d4f70>, _Condition__lock=<thread.lock at remote 0x7f0ea77d4f70>, acquire=<built-in method acquire of th...(truncated), \r\n    throwflag=throwflag@entry=0) at /usr/src/debug/Python-2.7.5/Python/ceval.c:2740\r\n#5  0x00007f0ea735c0bd in PyEval_EvalCodeEx (co=<optimized out>, globals=<optimized out>, locals=locals@entry=0x0, args=args@entry=0x189c218, argcount=2, kws=kws@entry=0x17c7900, kwcount=kwcount@entry=9, \r\n    defs=defs@entry=0x13a5268, defcount=defcount@entry=9, closure=0x0) at /usr/src/debug/Python-2.7.5/Python/ceval.c:3330\r\n#6  0x00007f0ea72e905d in function_call (func=<function at remote 0x13a15f0>, \r\n    arg=(<SSLSocket(_sock=<_socket.socket at remote 0x1883f00>, _write_event=<gevent.core.io at remote 0x18fa848>, hub=<Hub(_resolver=<Resolver(pool=<ThreadPool(hub=<...>, _lock=<thread.lock at remote 0x7f0ea77d4f30>, pid=30918, fork_watcher=<gevent.core.fork at remote 0x18e7738>, manager=None, task_queue=<Queue(unfinished_tasks=0, queue=<collections.deque at remote 0x1877440>, maxsize=0, all_tasks_done=<Condition(release=<built-in method release of thread.lock object at remote 0x7f0ea77d4f70>, _Condition__lock=<thread.lock at remote 0x7f0ea77d4f70>, acquire=<built-in method acquire of thread.lock object at remote 0x7f0ea77d4f70>, _Condition__waiters=[]) at remote 0x18f3f90>, mutex=<thread.lock at remote 0x7f0ea77d4f70>, not_full=<Condition(release=<built-in method release of thread.lock object at remote 0x7f0ea77d4f70>, _Condition__lock=<thread.lock at remote 0x7f0ea77d4f70>, acquire=<built-in method acquire of thread.lock object at remote 0x7f0ea77d4f70>, _Condition__waiters=[]) at remote 0x18f3f50>, not_empty=<Con...(truncated), \r\n    kw={'ciphers': 'HIGH:!aNULL:!SSLv2:!RC4:!3DES:!MD5', 'certfile': None, 'server_side': False, 'ssl_version': 2, 'do_handshake_on_connect': True, 'suppress_ragged_eofs': True, 'cert_reqs': 2, 'ca_certs': '/usr/lib/python2.7/site-packages/boto/cacerts/cacerts.txt', 'keyfile': None}) at /usr/src/debug/Python-2.7.5/Objects/funcobject.c:526\r\n#7  0x00007f0ea72c40b3 in PyObject_Call (func=func@entry=<function at remote 0x13a15f0>, \r\n    arg=arg@entry=(<SSLSocket(_sock=<_socket.socket at remote 0x1883f00>, _write_event=<gevent.core.io at remote 0x18fa848>, hub=<Hub(_resolver=<Resolver(pool=<ThreadPool(hub=<...>, _lock=<thread.lock at remote 0x7f0ea77d4f30>, pid=30918, fork_watcher=<gevent.core.fork at remote 0x18e7738>, manager=None, task_queue=<Queue(unfinished_tasks=0, queue=<collections.deque at remote 0x1877440>, maxsize=0, all_tasks_done=<Condition(release=<built-in method release of thread.lock object at remote 0x7f0ea77d4f70>, _Condition__lock=<thread.lock at remote 0x7f0ea77d4f70>, acquire=<built-in method acquire of thread.lock object at remote 0x7f0ea77d4f70>, _Condition__waiters=[]) at remote 0x18f3f90>, mutex=<thread.lock at remote 0x7f0ea77d4f70>, not_full=<Condition(release=<built-in method release of thread.lock object at remote 0x7f0ea77d4f70>, _Condition__lock=<thread.lock at remote 0x7f0ea77d4f70>, acquire=<built-in method acquire of thread.lock object at remote 0x7f0ea77d4f70>, _Condition__waiters=[]) at remote 0x18f3f50>, not_empty=<Con...(truncated), \r\n    kw=kw@entry={'ciphers': 'HIGH:!aNULL:!SSLv2:!RC4:!3DES:!MD5', 'certfile': None, 'server_side': False, 'ssl_version': 2, 'do_handshake_on_connect': True, 'suppress_ragged_eofs': True, 'cert_reqs': 2, 'ca_certs': '/usr/lib/python2.7/site-packages/boto/cacerts/cacerts.txt', 'keyfile': None}) at /usr/src/debug/Python-2.7.5/Objects/abstract.c:2529\r\n#8  0x00007f0ea72d30a5 in instancemethod_call (func=<function at remote 0x13a15f0>, \r\n    arg=(<SSLSocket(_sock=<_socket.socket at remote 0x1883f00>, _write_event=<gevent.core.io at remote 0x18fa848>, hub=<Hub(_resolver=<Resolver(pool=<ThreadPool(hub=<...>, _lock=<thread.lock at remote 0x7f0ea77d4f30>, pid=30918, fork_watcher=<gevent.core.fork at remote 0x18e7738>, manager=None, task_queue=<Queue(unfinished_tasks=0, queue=<collections.deque at remote 0x1877440>, maxsize=0, all_tasks_done=<Condition(release=<built-in method release of thread.lock object at remote 0x7f0ea77d4f70>, _Condition__lock=<thread.lock at remote 0x7f0ea77d4f70>, acquire=<built-in method acquire of thread.lock object at remote 0x7f0ea77d4f70>, _Condition__waiters=[]) at remote 0x18f3f90>, mutex=<thread.lock at remote 0x7f0ea77d4f70>, not_full=<Condition(release=<built-in method release of thread.lock object at remote 0x7f0ea77d4f70>, _Condition__lock=<thread.lock at remote 0x7f0ea77d4f70>, acquire=<built-in method acquire of thread.lock object at remote 0x7f0ea77d4f70>, _Condition__waiters=[]) at remote 0x18f3f50>, not_empty=<Con...(truncated), \r\n    kw={'ciphers': 'HIGH:!aNULL:!SSLv2:!RC4:!3DES:!MD5', 'certfile': None, 'server_side': False, 'ssl_version': 2, 'do_handshake_on_connect': True, 'suppress_ragged_eofs': True, 'cert_reqs': 2, 'ca_certs': '/usr/lib/python2.7/site-packages/boto/cacerts/cacerts.txt', 'keyfile': None}) at /usr/src/debug/Python-2.7.5/Objects/classobject.c:2602\r\n#9  0x00007f0ea72c40b3 in PyObject_Call (func=func@entry=<instancemethod at remote 0x1554320>, \r\n    arg=arg@entry=(<socket(_sock=<_socket.socket at remote 0x1883f00>, _write_event=<gevent.core.io at remote 0x18fa8c0>, hub=<Hub(_resolver=<Resolver(pool=<ThreadPool(hub=<...>, _lock=<thread.lock at remote 0x7f0ea77d4f30>, pid=30918, fork_watcher=<gevent.core.fork at remote 0x18e7738>, manager=None, task_queue=<Queue(unfinished_tasks=0, queue=<collections.deque at remote 0x1877440>, maxsize=0, all_tasks_done=<Condition(release=<built-in method release of thread.lock object at remote 0x7f0ea77d4f70>, _Condition__lock=<thread.lock at remote 0x7f0ea77d4f70>, acquire=<built-in method acquire of thread.lock object at remote 0x7f0ea77d4f70>, _Condition__waiters=[]) at remote 0x18f3f90>, mutex=<thread.lock at remote 0x7f0ea77d4f70>, not_full=<Condition(release=<built-in method release of thread.lock object at remote 0x7f0ea77d4f70>, _Condition__lock=<thread.lock at remote 0x7f0ea77d4f70>, acquire=<built-in method acquire of thread.lock object at remote 0x7f0ea77d4f70>, _Condition__waiters=[]) at remote 0x18f3f50>, not_empty=<Condit...(truncated), \r\n    kw=kw@entry={'ciphers': 'HIGH:!aNULL:!SSLv2:!RC4:!3DES:!MD5', 'certfile': None, 'server_side': False, 'ssl_version': 2, 'do_handshake_on_connect': True, 'suppress_ragged_eofs': True, 'cert_reqs': 2, 'ca_certs': '/usr/lib/python2.7/site-packages/boto/cacerts/cacerts.txt', 'keyfile': None}) at /usr/src/debug/Python-2.7.5/Objects/abstract.c:2529\r\n#10 0x00007f0ea731b057 in slot_tp_init (self=<optimized out>, \r\n    args=(<socket(_sock=<_socket.socket at remote 0x1883f00>, _write_event=<gevent.core.io at remote 0x18fa8c0>, hub=<Hub(_resolver=<Resolver(pool=<ThreadPool(hub=<...>, _lock=<thread.lock at remote 0x7f0ea77d4f30>, pid=30918, fork_watcher=<gevent.core.fork at remote 0x18e7738>, manager=None, task_queue=<Queue(unfinished_tasks=0, queue=<collections.deque at remote 0x1877440>, maxsize=0, all_tasks_done=<Condition(release=<built-in method release of thread.lock object at remote 0x7f0ea77d4f70>, _Condition__lock=<thread.lock at remote 0x7f0ea77d4f70>, acquire=<built-in method acquire of thread.lock object at remote 0x7f0ea77d4f70>, _Condition__waiters=[]) at remote 0x18f3f90>, mutex=<thread.lock at remote 0x7f0ea77d4f70>, not_full=<Condition(release=<built-in method release of thread.lock object at remote 0x7f0ea77d4f70>, _Condition__lock=<thread.lock at remote 0x7f0ea77d4f70>, acquire=<built-in method acquire of thread.lock object at remote 0x7f0ea77d4f70>, _Condition__waiters=[]) at remote 0x18f3f50>, not_empty=<Condit...(truncated), \r\n    kwds={'ciphers': 'HIGH:!aNULL:!SSLv2:!RC4:!3DES:!MD5', 'certfile': None, 'server_side': False, 'ssl_version': 2, 'do_handshake_on_connect': True, 'suppress_ragged_eofs': True, 'cert_reqs': 2, 'ca_certs': '/usr/lib/python2.7/site-packages/boto/cacerts/cacerts.txt', 'keyfile': None}) at /usr/src/debug/Python-2.7.5/Objects/typeobject.c:5692\r\n#11 0x00007f0ea7319d6f in type_call (type=<optimized out>, \r\n    args=(<socket(_sock=<_socket.socket at remote 0x1883f00>, _write_event=<gevent.core.io at remote 0x18fa8c0>, hub=<Hub(_resolver=<Resolver(pool=<ThreadPool(hub=<...>, _lock=<thread.lock at remote 0x7f0ea77d4f30>, pid=30918, fork_watcher=<gevent.core.fork at remote 0x18e7738>, manager=None, task_queue=<Queue(unfinished_tasks=0, queue=<collections.deque at remote 0x1877440>, maxsize=0, all_tasks_done=<Condition(release=<built-in method release of thread.lock object at remote 0x7f0ea77d4f70>, _Condition__lock=<thread.lock at remote 0x7f0ea77d4f70>, acquire=<built-in method acquire of thread.lock object at remote 0x7f0ea77d4f70>, _Condition__waiters=[]) at remote 0x18f3f90>, mutex=<thread.lock at remote 0x7f0ea77d4f70>, not_full=<Condition(release=<built-in method release of thread.lock object at remote 0x7f0ea77d4f70>, _Condition__lock=<thread.lock at remote 0x7f0ea77d4f70>, acquire=<built-in method acquire of thread.lock object at remote 0x7f0ea77d4f70>, _Condition__waiters=[]) at remote 0x18f3f50>, not_empty=<Condit...(truncated), \r\n    kwds={'ciphers': 'HIGH:!aNULL:!SSLv2:!RC4:!3DES:!MD5', 'certfile': None, 'server_side': False, 'ssl_version': 2, 'do_handshake_on_connect': True, 'suppress_ragged_eofs': True, 'cert_reqs': 2, 'ca_certs': '/usr/lib/python2.7/site-packages/boto/cacerts/cacerts.txt', 'keyfile': None}) at /usr/src/debug/Python-2.7.5/Objects/typeobject.c:745\r\n#12 0x00007f0ea72c40b3 in PyObject_Call (func=func@entry=<type at remote 0x13dca30>, \r\n    arg=arg@entry=(<socket(_sock=<_socket.socket at remote 0x1883f00>, _write_event=<gevent.core.io at remote 0x18fa8c0>, hub=<Hub(_resolver=<Resolver(pool=<ThreadPool(hub=<...>, _lock=<thread.lock at remote 0x7f0ea77d4f30>, pid=30918, fork_watcher=<gevent.core.fork at remote 0x18e7738>, manager=None, task_queue=<Queue(unfinished_tasks=0, queue=<collections.deque at remote 0x1877440>, maxsize=0, all_tasks_done=<Condition(release=<built-in method release of thread.lock object at remote 0x7f0ea77d4f70>, _Condition__lock=<thread.lock at remote 0x7f0ea77d4f70>, acquire=<built-in method acquire of thread.lock object at remote 0x7f0ea77d4f70>, _Condition__waiters=[]) at remote 0x18f3f90>, mutex=<thread.lock at remote 0x7f0ea77d4f70>, not_full=<Condition(release=<built-in method release of thread.lock object at remote 0x7f0ea77d4f70>, _Condition__lock=<thread.lock at remote 0x7f0ea77d4f70>, acquire=<built-in method acquire of thread.lock object at remote 0x7f0ea77d4f70>, _Condition__waiters=[]) at remote 0x18f3f50>, not_empty=<Condit...(truncated), \r\n    kw=kw@entry={'ciphers': 'HIGH:!aNULL:!SSLv2:!RC4:!3DES:!MD5', 'certfile': None, 'server_side': False, 'ssl_version': 2, 'do_handshake_on_connect': True, 'suppress_ragged_eofs': True, 'cert_reqs': 2, 'ca_certs': '/usr/lib/python2.7/site-packages/boto/cacerts/cacerts.txt', 'keyfile': None}) at /usr/src/debug/Python-2.7.5/Objects/abstract.c:2529\r\n#13 0x00007f0ea735825c in do_call (nk=<optimized out>, na=1, pp_stack=0x7fff9cd8f070, func=<type at remote 0x13dca30>) at /usr/src/debug/Python-2.7.5/Python/ceval.c:4316\r\n#14 call_function (oparg=<optimized out>, pp_stack=0x7fff9cd8f070) at /usr/src/debug/Python-2.7.5/Python/ceval.c:4121\r\n#15 PyEval_EvalFrameEx (\r\n    f=f@entry=Frame 0x196a880, for file /usr/lib64/python2.7/site-packages/gevent/_ssl2.py, line 410, in wrap_socket (sock=<socket(_sock=<_socket.socket at remote 0x1883f00>, _write_event=<gevent.core.io at remote 0x18fa8c0>, hub=<Hub(_resolver=<Resolver(pool=<ThreadPool(hub=<...>, _lock=<thread.lock at remote 0x7f0ea77d4f30>, pid=30918, fork_watcher=<gevent.core.fork at remote 0x18e7738>, manager=None, task_queue=<Queue(unfinished_tasks=0, queue=<collections.deque at remote 0x1877440>, maxsize=0, all_tasks_done=<Condition(release=<built-in method release of thread.lock object at remote 0x7f0ea77d4f70>, _Condition__lock=<thread.lock at remote 0x7f0ea77d4f70>, acquire=<built-in method acquire of thread.lock object at remote 0x7f0ea77d4f70>, _Condition__waiters=[]) at remote 0x18f3f90>, mutex=<thread.lock at remote 0x7f0ea77d4f70>, not_full=<Condition(release=<built-in method release of thread.lock object at remote 0x7f0ea77d4f70>, _Condition__lock=<thread.lock at remote 0x7f0ea77d4f70>, acquire=<built-in method acquire of t...(truncated), \r\n    throwflag=throwflag@entry=0) at /usr/src/debug/Python-2.7.5/Python/ceval.c:2740\r\n#16 0x00007f0ea735c0bd in PyEval_EvalCodeEx (co=<optimized out>, globals=<optimized out>, locals=locals@entry=0x0, args=args@entry=0x7f0ea76e5268, argcount=1, kws=kws@entry=0x18895b8, kwcount=kwcount@entry=5, \r\n    defs=defs@entry=0x13a52e8, defcount=defcount@entry=9, closure=0x0) at /usr/src/debug/Python-2.7.5/Python/ceval.c:3330\r\n#17 0x00007f0ea72e905d in function_call (func=<function at remote 0x13a6050>, \r\n    arg=(<socket(_sock=<_socket.socket at remote 0x1883f00>, _write_event=<gevent.core.io at remote 0x18fa8c0>, hub=<Hub(_resolver=<Resolver(pool=<ThreadPool(hub=<...>, _lock=<thread.lock at remote 0x7f0ea77d4f30>, pid=30918, fork_watcher=<gevent.core.fork at remote 0x18e7738>, manager=None, task_queue=<Queue(unfinished_tasks=0, queue=<collections.deque at remote 0x1877440>, maxsize=0, all_tasks_done=<Condition(release=<built-in method release of thread.lock object at remote 0x7f0ea77d4f70>, _Condition__lock=<thread.lock at remote 0x7f0ea77d4f70>, acquire=<built-in method acquire of thread.lock object at remote 0x7f0ea77d4f70>, _Condition__waiters=[]) at remote 0x18f3f90>, mutex=<thread.lock at remote 0x7f0ea77d4f70>, not_full=<Condition(release=<built-in method release of thread.lock object at remote 0x7f0ea77d4f70>, _Condition__lock=<thread.lock at remote 0x7f0ea77d4f70>, acquire=<built-in method acquire of thread.lock object at remote 0x7f0ea77d4f70>, _Condition__waiters=[]) at remote 0x18f3f50>, not_empty=<Condit...(truncated), \r\n    kw={'ca_certs': '/usr/lib/python2.7/site-packages/boto/cacerts/cacerts.txt', 'certfile': None, 'ciphers': 'HIGH:!aNULL:!SSLv2:!RC4:!3DES:!MD5', 'keyfile': None, 'cert_reqs': 2})\r\n    at /usr/src/debug/Python-2.7.5/Objects/funcobject.c:526\r\n#18 0x00007f0ea72c40b3 in PyObject_Call (func=func@entry=<function at remote 0x13a6050>, \r\n    arg=arg@entry=(<socket(_sock=<_socket.socket at remote 0x1883f00>, _write_event=<gevent.core.io at remote 0x18fa8c0>, hub=<Hub(_resolver=<Resolver(pool=<ThreadPool(hub=<...>, _lock=<thread.lock at remote 0x7f0ea77d4f30>, pid=30918, fork_watcher=<gevent.core.fork at remote 0x18e7738>, manager=None, task_queue=<Queue(unfinished_tasks=0, queue=<collections.deque at remote 0x1877440>, maxsize=0, all_tasks_done=<Condition(release=<built-in method release of thread.lock object at remote 0x7f0ea77d4f70>, _Condition__lock=<thread.lock at remote 0x7f0ea77d4f70>, acquire=<built-in method acquire of thread.lock object at remote 0x7f0ea77d4f70>, _Condition__waiters=[]) at remote 0x18f3f90>, mutex=<thread.lock at remote 0x7f0ea77d4f70>, not_full=<Condition(release=<built-in method release of thread.lock object at remote 0x7f0ea77d4f70>, _Condition__lock=<thread.lock at remote 0x7f0ea77d4f70>, acquire=<built-in method acquire of thread.lock object at remote 0x7f0ea77d4f70>, _Condition__waiters=[]) at remote 0x18f3f50>, not_empty=<Condit...(truncated), kw=kw@entry={'ca_certs': '/usr/lib/python2.7/site-packages/boto/cacerts/cacerts.txt', 'certfile': None, 'ciphers': 'HIGH:!aNULL:!SSLv2:!RC4:!3DES:!MD5', 'keyfile': None, 'cert_reqs': 2})\r\n    at /usr/src/debug/Python-2.7.5/Objects/abstract.c:2529\r\n#19 0x00007f0ea73572f7 in ext_do_call (nk=<optimized out>, na=<optimized out>, flags=<optimized out>, pp_stack=0x7fff9cd8f330, func=<function at remote 0x13a6050>)\r\n    at /usr/src/debug/Python-2.7.5/Python/ceval.c:4411\r\n#20 PyEval_EvalFrameEx (\r\n    f=f@entry=Frame 0x196a6a0, for file /usr/lib/python2.7/site-packages/wal_e/cmd.py, line 76, in wrap_socket_monkey (args=(<socket(_sock=<_socket.socket at remote 0x1883f00>, _write_event=<gevent.core.io at remote 0x18fa8c0>, hub=<Hub(_resolver=<Resolver(pool=<ThreadPool(hub=<...>, _lock=<thread.lock at remote 0x7f0ea77d4f30>, pid=30918, fork_watcher=<gevent.core.fork at remote 0x18e7738>, manager=None, task_queue=<Queue(unfinished_tasks=0, queue=<collections.deque at remote 0x1877440>, maxsize=0, all_tasks_done=<Condition(release=<built-in method release of thread.lock object at remote 0x7f0ea77d4f70>, _Condition__lock=<thread.lock at remote 0x7f0ea77d4f70>, acquire=<built-in method acquire of thread.lock object at remote 0x7f0ea77d4f70>, _Condition__waiters=[]) at remote 0x18f3f90>, mutex=<thread.lock at remote 0x7f0ea77d4f70>, not_full=<Condition(release=<built-in method release of thread.lock object at remote 0x7f0ea77d4f70>, _Condition__lock=<thread.lock at remote 0x7f0ea77d4f70>, acquire=<built-in method acquire of...(truncated), \r\n    throwflag=throwflag@entry=0) at /usr/src/debug/Python-2.7.5/Python/ceval.c:2779\r\n#21 0x00007f0ea735c0bd in PyEval_EvalCodeEx (co=<optimized out>, globals=<optimized out>, locals=locals@entry=0x0, args=<optimized out>, argcount=argcount@entry=1, kws=0x1965fc0, kwcount=4, defs=0x0, \r\n    defcount=0, closure=closure@entry=(<cell at remote 0x13a8980>,)) at /usr/src/debug/Python-2.7.5/Python/ceval.c:3330\r\n#22 0x00007f0ea735a76f in fast_function (nk=<optimized out>, na=1, n=9, pp_stack=0x7fff9cd8f530, func=<function at remote 0x13fc500>) at /usr/src/debug/Python-2.7.5/Python/ceval.c:4194\r\n#23 call_function (oparg=<optimized out>, pp_stack=0x7fff9cd8f530) at /usr/src/debug/Python-2.7.5/Python/ceval.c:4119\r\n#24 PyEval_EvalFrameEx (\r\n    f=f@entry=Frame 0x1965e10, for file /usr/lib/python2.7/site-packages/boto/https_connection.py, line 131, in connect (self=<CertValidatingHTTPSConnection(cert_file=None, _buffer=[], _HTTPConnection__state='Request-sent', _tunnel_headers={}, _tunnel_host=None, response_class=<classobj at remote 0x17bd050>, sock=None, port=443, host='commutestream-banner-wale.s3.amazonaws.com', _tunnel_port=None, timeout=5, ca_certs='/usr/lib/python2.7/site-packages/boto/cacerts/cacerts.txt', key_file=None, source_address=None, _HTTPConnection__response=None, _method='PUT') at remote 0x189c050>, sock=<socket(_sock=<_socket.socket at remote 0x1883f00>, _write_event=<gevent.core.io at remote 0x18fa8c0>, hub=<Hub(_resolver=<Resolver(pool=<ThreadPool(hub=<...>, _lock=<thread.lock at remote 0x7f0ea77d4f30>, pid=30918, fork_watcher=<gevent.core.fork at remote 0x18e7738>, manager=None, task_queue=<Queue(unfinished_tasks=0, queue=<collections.deque at remote 0x1877440>, maxsize=0, all_tasks_done=<Condition(release=<built-in method release of thre...(truncated), \r\n    throwflag=throwflag@entry=0) at /usr/src/debug/Python-2.7.5/Python/ceval.c:2740\r\n#25 0x00007f0ea735a860 in fast_function (nk=<optimized out>, na=1, n=1, pp_stack=0x7fff9cd8f690, func=<function at remote 0x17b3de8>) at /usr/src/debug/Python-2.7.5/Python/ceval.c:4184\r\n#26 call_function (oparg=<optimized out>, pp_stack=0x7fff9cd8f690) at /usr/src/debug/Python-2.7.5/Python/ceval.c:4119\r\n#27 PyEval_EvalFrameEx (\r\n    f=f@entry=Frame 0x1965c20, for file /usr/lib64/python2.7/httplib.py, line 797, in send (self=<CertValidatingHTTPSConnection(cert_file=None, _buffer=[], _HTTPConnection__state='Request-sent', _tunnel_headers={}, _tunnel_host=None, response_class=<classobj at remote 0x17bd050>, sock=None, port=443, host='commutestream-banner-wale.s3.amazonaws.com', _tunnel_port=None, timeout=5, ca_certs='/usr/lib/python2.7/site-packages/boto/cacerts/cacerts.txt', key_file=None, source_address=None, _HTTPConnection__response=None, _method='PUT') at remote 0x189c050>, data='PUT /basebackups_005/base_000000010000025F00000085_12803632/extended_version.txt HTTP/1.1\\r\\nHost: commutestream-banner-wale.s3.amazonaws.com\\r\\nAccept-Encoding: identity\\r\\nContent-MD5: CfBbFS1dNoaEMTQeFZ1yqw==\\r\\nContent-Length: 103\\r\\nExpect: 100-Continue\\r\\nDate: Mon, 25 Jan 2016 16:18:56 GMT\\r\\nx-amz-server-side-encryption: AES256\\r\\nContent-Type: text/plain\\r\\nAuthorization: AWS AKIAITPPOEGWC37HKNNQ:tNCGuDObB6B+GI68v5nva0FrbOI=\\r\\nUser-Agent: Boto/2.38.0 Python/2....(truncated), \r\n    throwflag=throwflag@entry=0) at /usr/src/debug/Python-2.7.5/Python/ceval.c:2740\r\n#28 0x00007f0ea735a860 in fast_function (nk=<optimized out>, na=2, n=2, pp_stack=0x7fff9cd8f7f0, func=<function at remote 0x13d6488>) at /usr/src/debug/Python-2.7.5/Python/ceval.c:4184\r\n#29 call_function (oparg=<optimized out>, pp_stack=0x7fff9cd8f7f0) at /usr/src/debug/Python-2.7.5/Python/ceval.c:4119\r\n#30 PyEval_EvalFrameEx (\r\n    f=f@entry=Frame 0x1965820, for file /usr/lib64/python2.7/httplib.py, line 835, in _send_output (self=<CertValidatingHTTPSConnection(cert_file=None, _buffer=[], _HTTPConnection__state='Request-sent', _tunnel_headers={}, _tunnel_host=None, response_class=<classobj at remote 0x17bd050>, sock=None, port=443, host='commutestream-banner-wale.s3.amazonaws.com', _tunnel_port=None, timeout=5, ca_certs='/usr/lib/python2.7/site-packages/boto/cacerts/cacerts.txt', key_file=None, source_address=None, _HTTPConnection__response=None, _method='PUT') at remote 0x189c050>, message_body=None, msg='PUT /basebackups_005/base_000000010000025F00000085_12803632/extended_version.txt HTTP/1.1\\r\\nHost: commutestream-banner-wale.s3.amazonaws.com\\r\\nAccept-Encoding: identity\\r\\nContent-MD5: CfBbFS1dNoaEMTQeFZ1yqw==\\r\\nContent-Length: 103\\r\\nExpect: 100-Continue\\r\\nDate: Mon, 25 Jan 2016 16:18:56 GMT\\r\\nx-amz-server-side-encryption: AES256\\r\\nContent-Type: text/plain\\r\\nAuthorization: AWS AKIAITPPOEGWC37HKNNQ:tNCGuDObB6B+GI68v5nva0FrbOI=\\r\\nUser-Ag...(truncated), \r\n    throwflag=throwflag@entry=0) at /usr/src/debug/Python-2.7.5/Python/ceval.c:2740\r\n#31 0x00007f0ea735c0bd in PyEval_EvalCodeEx (co=<optimized out>, globals=<optimized out>, locals=locals@entry=0x0, args=<optimized out>, argcount=argcount@entry=2, kws=0x19657e8, kwcount=0, defs=0x13adbe8, \r\n    defcount=1, closure=closure@entry=0x0) at /usr/src/debug/Python-2.7.5/Python/ceval.c:3330\r\n#32 0x00007f0ea735a76f in fast_function (nk=<optimized out>, na=2, n=2, pp_stack=0x7fff9cd8f9f0, func=<function at remote 0x13d6578>) at /usr/src/debug/Python-2.7.5/Python/ceval.c:4194\r\n#33 call_function (oparg=<optimized out>, pp_stack=0x7fff9cd8f9f0) at /usr/src/debug/Python-2.7.5/Python/ceval.c:4119\r\n#34 PyEval_EvalFrameEx (\r\n    f=f@entry=Frame 0x1965650, for file /usr/lib64/python2.7/httplib.py, line 975, in endheaders (self=<CertValidatingHTTPSConnection(cert_file=None, _buffer=[], _HTTPConnection__state='Request-sent', _tunnel_headers={}, _tunnel_host=None, response_class=<classobj at remote 0x17bd050>, sock=None, port=443, host='commutestream-banner-wale.s3.amazonaws.com', _tunnel_port=None, timeout=5, ca_certs='/usr/lib/python2.7/site-packages/boto/cacerts/cacerts.txt', key_file=None, source_address=None, _HTTPConnection__response=None, _method='PUT') at remote 0x189c050>, message_body=None), throwflag=throwflag@entry=0)\r\n    at /usr/src/debug/Python-2.7.5/Python/ceval.c:2740\r\n#35 0x00007f0ea735c0bd in PyEval_EvalCodeEx (co=<optimized out>, globals=<optimized out>, locals=locals@entry=0x0, args=<optimized out>, argcount=argcount@entry=1, kws=0x1964e08, kwcount=0, defs=0x13c9d28, \r\n    defcount=1, closure=closure@entry=0x0) at /usr/src/debug/Python-2.7.5/Python/ceval.c:3330\r\n#36 0x00007f0ea735a76f in fast_function (nk=<optimized out>, na=1, n=1, pp_stack=0x7fff9cd8fbf0, func=<function at remote 0x13d66e0>) at /usr/src/debug/Python-2.7.5/Python/ceval.c:4194\r\n#37 call_function (oparg=<optimized out>, pp_stack=0x7fff9cd8fbf0) at /usr/src/debug/Python-2.7.5/Python/ceval.c:4119\r\n#38 PyEval_EvalFrameEx (\r\n    f=f@entry=Frame 0x1964bb0, for file /usr/lib/python2.7/site-packages/boto/s3/key.py, line 791, in sender (http_conn=<CertValidatingHTTPSConnection(cert_file=None, _buffer=[], _HTTPConnection__state='Request-sent', _tunnel_headers={}, _tunnel_host=None, response_class=<classobj at remote 0x17bd050>, sock=None, port=443, host='commutestream-banner-wale.s3.amazonaws.com', _tunnel_port=None, timeout=5, ca_certs='/usr/lib/python2.7/site-packages/boto/cacerts/cacerts.txt', key_file=None, source_address=None, _HTTPConnection__response=None, _method='PUT') at remote 0x189c050>, method='PUT', path='/basebackups_005/base_000000010000025F00000085_12803632/extended_version.txt', data='', headers={'Content-MD5': 'CfBbFS1dNoaEMTQeFZ1yqw==', 'Content-Length': '103', 'Expect': '100-Continue', 'Date': 'Mon, 25 Jan 2016 16:18:56 GMT', 'x-amz-server-side-encryption': 'AES256', 'Content-Type': 'text/plain', 'Authorization': u'AWS AKIAITPPOEGWC37HKNNQ:tNCGuDObB6B+GI68v5nva0FrbOI=', 'User-Agent': 'Boto/2.38.0 Python/2.7.5 Linux/4.1.0-x86_64...(truncated), \r\n    throwflag=throwflag@entry=0) at /usr/src/debug/Python-2.7.5/Python/ceval.c:2740\r\n#39 0x00007f0ea735c0bd in PyEval_EvalCodeEx (co=<optimized out>, globals=<optimized out>, locals=locals@entry=0x0, args=<optimized out>, argcount=argcount@entry=5, kws=0x195bcc8, kwcount=0, defs=0x0, \r\n    defcount=0, \r\n    closure=closure@entry=(<cell at remote 0x1658de0>, <cell at remote 0x18931d8>, <cell at remote 0x1893d00>, <cell at remote 0x1893b40>, <cell at remote 0x1893c20>, <cell at remote 0x1893b78>, <cell at remote 0x1893be8>, <cell at remote 0x1893c58>, <cell at remote 0x1893c90>)) at /usr/src/debug/Python-2.7.5/Python/ceval.c:3330\r\n#40 0x00007f0ea735a76f in fast_function (nk=<optimized out>, na=5, n=5, pp_stack=0x7fff9cd8fdf0, func=<function at remote 0x1899668>) at /usr/src/debug/Python-2.7.5/Python/ceval.c:4194\r\n#41 call_function (oparg=<optimized out>, pp_stack=0x7fff9cd8fdf0) at /usr/src/debug/Python-2.7.5/Python/ceval.c:4119\r\n#42 PyEval_EvalFrameEx (\r\n    f=f@entry=Frame 0x195ba70, for file /usr/lib/python2.7/site-packages/boto/connection.py, line 940, in _mexe (self=<S3Connection(request_hook=None, num_retries=6, ca_certificates_file='/usr/lib/python2.7/site-packages/boto/cacerts/cacerts.txt', http_unretryable_exceptions=[<type at remote 0x17e5b80>], https_connection_factory=None, is_secure=True, protocol='https', port=443, _connection=('s3.amazonaws.com', 443, True), _auth_handler=<HmacAuthV1Handler(_hmac_256=None, host='s3.amazonaws.com', _hmac=<HMAC(digest_cons=<built-in function openssl_sha1>, outer=<_hashlib.HASH at remote 0x18ec990>, inner=<_hashlib.HASH at remote 0x18ec9e0>, digest_size=20L) at remote 0x18ebfc8>, _provider=<Provider(acl_header='x-amz-acl', server_side_encryption_header='x-amz-server-side-encryption', copy_source_version_id='x-amz-copy-source-version-id', profile_name=None, mfa_header='x-amz-mfa', security_token_header='x-amz-security-token', date_header='x-amz-date', port=None, shared_credentials=<Config(_optcre=<_sre.SRE_Pattern at remote 0x127...(truncated), \r\n    throwflag=throwflag@entry=0) at /usr/src/debug/Python-2.7.5/Python/ceval.c:2740\r\n#43 0x00007f0ea735c0bd in PyEval_EvalCodeEx (co=<optimized out>, globals=<optimized out>, locals=locals@entry=0x0, args=<optimized out>, argcount=argcount@entry=4, kws=0x195b078, kwcount=1, defs=0x17b56a8, \r\n    defcount=3, closure=closure@entry=0x0) at /usr/src/debug/Python-2.7.5/Python/ceval.c:3330\r\n#44 0x00007f0ea735a76f in fast_function (nk=<optimized out>, na=4, n=6, pp_stack=0x7fff9cd8fff0, func=<function at remote 0x17be398>) at /usr/src/debug/Python-2.7.5/Python/ceval.c:4194\r\n#45 call_function (oparg=<optimized out>, pp_stack=0x7fff9cd8fff0) at /usr/src/debug/Python-2.7.5/Python/ceval.c:4119\r\n#46 PyEval_EvalFrameEx (\r\n    f=f@entry=Frame 0x195ae80, for file /usr/lib/python2.7/site-packages/boto/connection.py, line 1071, in make_request (self=<S3Connection(request_hook=None, num_retries=6, ca_certificates_file='/usr/lib/python2.7/site-packages/boto/cacerts/cacerts.txt', http_unretryable_exceptions=[<type at remote 0x17e5b80>], https_connection_factory=None, is_secure=True, protocol='https', port=443, _connection=('s3.amazonaws.com', 443, True), _auth_handler=<HmacAuthV1Handler(_hmac_256=None, host='s3.amazonaws.com', _hmac=<HMAC(digest_cons=<built-in function openssl_sha1>, outer=<_hashlib.HASH at remote 0x18ec990>, inner=<_hashlib.HASH at remote 0x18ec9e0>, digest_size=20L) at remote 0x18ebfc8>, _provider=<Provider(acl_header='x-amz-acl', server_side_encryption_header='x-amz-server-side-encryption', copy_source_version_id='x-amz-copy-source-version-id', profile_name=None, mfa_header='x-amz-mfa', security_token_header='x-amz-security-token', date_header='x-amz-date', port=None, shared_credentials=<Config(_optcre=<_sre.SRE_Pattern at remo...(truncated), \r\n    throwflag=throwflag@entry=0) at /usr/src/debug/Python-2.7.5/Python/ceval.c:2740\r\n#47 0x00007f0ea735c0bd in PyEval_EvalCodeEx (co=<optimized out>, globals=<optimized out>, locals=locals@entry=0x0, args=<optimized out>, argcount=argcount@entry=8, kws=0x1953a90, kwcount=2, defs=0x17be518, \r\n    defcount=8, closure=closure@entry=0x0) at /usr/src/debug/Python-2.7.5/Python/ceval.c:3330\r\n#48 0x00007f0ea735a76f in fast_function (nk=<optimized out>, na=8, n=12, pp_stack=0x7fff9cd901f0, func=<function at remote 0x17be488>) at /usr/src/debug/Python-2.7.5/Python/ceval.c:4194\r\n#49 call_function (oparg=<optimized out>, pp_stack=0x7fff9cd901f0) at /usr/src/debug/Python-2.7.5/Python/ceval.c:4119\r\n#50 PyEval_EvalFrameEx (\r\n    f=f@entry=Frame 0x1953870, for file /usr/lib/python2.7/site-packages/boto/s3/connection.py, line 664, in make_request (self=<S3Connection(request_hook=None, num_retries=6, ca_certificates_file='/usr/lib/python2.7/site-packages/boto/cacerts/cacerts.txt', http_unretryable_exceptions=[<type at remote 0x17e5b80>], https_connection_factory=None, is_secure=True, protocol='https', port=443, _connection=('s3.amazonaws.com', 443, True), _auth_handler=<HmacAuthV1Handler(_hmac_256=None, host='s3.amazonaws.com', _hmac=<HMAC(digest_cons=<built-in function openssl_sha1>, outer=<_hashlib.HASH at remote 0x18ec990>, inner=<_hashlib.HASH at remote 0x18ec9e0>, digest_size=20L) at remote 0x18ebfc8>, _provider=<Provider(acl_header='x-amz-acl', server_side_encryption_header='x-amz-server-side-encryption', copy_source_version_id='x-amz-copy-source-version-id', profile_name=None, mfa_header='x-amz-mfa', security_token_header='x-amz-security-token', date_header='x-amz-date', port=None, shared_credentials=<Config(_optcre=<_sre.SRE_Pattern at re...(truncated), \r\n    throwflag=throwflag@entry=0) at /usr/src/debug/Python-2.7.5/Python/ceval.c:2740\r\n#51 0x00007f0ea735c0bd in PyEval_EvalCodeEx (co=<optimized out>, globals=<optimized out>, locals=locals@entry=0x0, args=<optimized out>, argcount=argcount@entry=5, kws=0x1953090, kwcount=2, defs=0x184cab8, \r\n    defcount=8, closure=closure@entry=0x0) at /usr/src/debug/Python-2.7.5/Python/ceval.c:3330\r\n#52 0x00007f0ea735a76f in fast_function (nk=<optimized out>, na=5, n=9, pp_stack=0x7fff9cd903f0, func=<function at remote 0x184ca28>) at /usr/src/debug/Python-2.7.5/Python/ceval.c:4194\r\n#53 call_function (oparg=<optimized out>, pp_stack=0x7fff9cd903f0) at /usr/src/debug/Python-2.7.5/Python/ceval.c:4119\r\n#54 PyEval_EvalFrameEx (\r\n    f=f@entry=Frame 0x1952e30, for file /usr/lib/python2.7/site-packages/boto/s3/key.py, line 951, in _send_file_internal (self=<Key(encrypted=None, resp=None, ongoing_restore=None, source_version_id=None, content_language=None, _storage_class=None, owner=None, filename=None, size=103, delete_marker=False, etag=None, content_encoding=None, content_disposition=None, cache_control=None, metadata={}, version_id=None, last_modified=None, content_type='text/plain', path=None, is_latest=False, local_hashes={'md5': '\\t\\xf0[\\x15-]6\\x86\\x8414\\x1e\\x15\\x9dr\\xab'}, name='/basebackups_005/base_000000010000025F00000085_12803632/extended_version.txt', bucket=<Bucket(key_class=<type at remote 0x1807b70>, connection=<S3Connection(request_hook=None, num_retries=6, ca_certificates_file='/usr/lib/python2.7/site-packages/boto/cacerts/cacerts.txt', http_unretryable_exceptions=[<type at remote 0x17e5b80>], https_connection_factory=None, is_secure=True, protocol='https', port=443, _connection=('s3.amazonaws.com', 443, True), _auth_handler=<HmacAu...(truncated), \r\n    throwflag=throwflag@entry=0) at /usr/src/debug/Python-2.7.5/Python/ceval.c:2740\r\n#55 0x00007f0ea735c0bd in PyEval_EvalCodeEx (co=<optimized out>, globals=<optimized out>, locals=locals@entry=0x0, args=<optimized out>, argcount=argcount@entry=2, kws=0x1912ce8, kwcount=6, defs=0x17cf7d8, \r\n    defcount=7, closure=closure@entry=0x0) at /usr/src/debug/Python-2.7.5/Python/ceval.c:3330\r\n#56 0x00007f0ea735a76f in fast_function (nk=<optimized out>, na=2, n=14, pp_stack=0x7fff9cd905f0, func=<function at remote 0x1820c80>) at /usr/src/debug/Python-2.7.5/Python/ceval.c:4194\r\n#57 call_function (oparg=<optimized out>, pp_stack=0x7fff9cd905f0) at /usr/src/debug/Python-2.7.5/Python/ceval.c:4119\r\n#58 PyEval_EvalFrameEx (\r\n    f=f@entry=Frame 0x1912b20, for file /usr/lib/python2.7/site-packages/boto/s3/key.py, line 750, in send_file (self=<Key(encrypted=None, resp=None, ongoing_restore=None, source_version_id=None, content_language=None, _storage_class=None, owner=None, filename=None, size=103, delete_marker=False, etag=None, content_encoding=None, content_disposition=None, cache_control=None, metadata={}, version_id=None, last_modified=None, content_type='text/plain', path=None, is_latest=False, local_hashes={'md5': '\\t\\xf0[\\x15-]6\\x86\\x8414\\x1e\\x15\\x9dr\\xab'}, name='/basebackups_005/base_000000010000025F00000085_12803632/extended_version.txt', bucket=<Bucket(key_class=<type at remote 0x1807b70>, connection=<S3Connection(request_hook=None, num_retries=6, ca_certificates_file='/usr/lib/python2.7/site-packages/boto/cacerts/cacerts.txt', http_unretryable_exceptions=[<type at remote 0x17e5b80>], https_connection_factory=None, is_secure=True, protocol='https', port=443, _connection=('s3.amazonaws.com', 443, True), _auth_handler=<HmacAuthV1Handle...(truncated), \r\n    throwflag=throwflag@entry=0) at /usr/src/debug/Python-2.7.5/Python/ceval.c:2740\r\n#59 0x00007f0ea735c0bd in PyEval_EvalCodeEx (co=<optimized out>, globals=<optimized out>, locals=locals@entry=0x0, args=<optimized out>, argcount=argcount@entry=2, kws=0x1910ed8, kwcount=6, defs=0x181d1a0, \r\n    defcount=6, closure=closure@entry=0x0) at /usr/src/debug/Python-2.7.5/Python/ceval.c:3330\r\n#60 0x00007f0ea735a76f in fast_function (nk=<optimized out>, na=2, n=14, pp_stack=0x7fff9cd907f0, func=<function at remote 0x1820c08>) at /usr/src/debug/Python-2.7.5/Python/ceval.c:4194\r\n#61 call_function (oparg=<optimized out>, pp_stack=0x7fff9cd907f0) at /usr/src/debug/Python-2.7.5/Python/ceval.c:4119\r\n#62 PyEval_EvalFrameEx (\r\n    f=f@entry=Frame 0x1910cc0, for file /usr/lib/python2.7/site-packages/boto/s3/key.py, line 1293, in set_contents_from_file (self=<Key(encrypted=None, resp=None, ongoing_restore=None, source_version_id=None, content_language=None, _storage_class=None, owner=None, filename=None, size=103, delete_marker=False, etag=None, content_encoding=None, content_disposition=None, cache_control=None, metadata={}, version_id=None, last_modified=None, content_type='text/plain', path=None, is_latest=False, local_hashes={'md5': '\\t\\xf0[\\x15-]6\\x86\\x8414\\x1e\\x15\\x9dr\\xab'}, name='/basebackups_005/base_000000010000025F00000085_12803632/extended_version.txt', bucket=<Bucket(key_class=<type at remote 0x1807b70>, connection=<S3Connection(request_hook=None, num_retries=6, ca_certificates_file='/usr/lib/python2.7/site-packages/boto/cacerts/cacerts.txt', http_unretryable_exceptions=[<type at remote 0x17e5b80>], https_connection_factory=None, is_secure=True, protocol='https', port=443, _connection=('s3.amazonaws.com', 443, True), _auth_handler=<Hm...(truncated), \r\n    throwflag=throwflag@entry=0) at /usr/src/debug/Python-2.7.5/Python/ceval.c:2740\r\n#63 0x00007f0ea735c0bd in PyEval_EvalCodeEx (co=<optimized out>, globals=<optimized out>, locals=locals@entry=0x0, args=<optimized out>, argcount=argcount@entry=2, kws=0x176c3b8, kwcount=1, defs=0x17c9ba8, \r\n    defcount=11, closure=closure@entry=0x0) at /usr/src/debug/Python-2.7.5/Python/ceval.c:3330\r\n#64 0x00007f0ea735a76f in fast_function (nk=<optimized out>, na=2, n=4, pp_stack=0x7fff9cd909f0, func=<function at remote 0x1820ed8>) at /usr/src/debug/Python-2.7.5/Python/ceval.c:4194\r\n#65 call_function (oparg=<optimized out>, pp_stack=0x7fff9cd909f0) at /usr/src/debug/Python-2.7.5/Python/ceval.c:4119\r\n#66 PyEval_EvalFrameEx (\r\n    f=f@entry=Frame 0x176c200, for file /usr/lib/python2.7/site-packages/wal_e/blobstore/s3/s3_util.py, line 55, in uri_put_file (creds=<Provider(acl_header='x-amz-acl', server_side_encryption_header='x-amz-server-side-encryption', copy_source_version_id='x-amz-copy-source-version-id', profile_name=None, mfa_header='x-amz-mfa', security_token_header='x-amz-security-token', date_header='x-amz-date', port=None, shared_credentials=<Config(_optcre=<_sre.SRE_Pattern at remote 0x127aa90>, _defaults=<OrderedDict(_OrderedDict__root=[[[[...], [...], 'debug'], [...], 'working_dir'], [...], None], _OrderedDict__map={'debug': [...], 'working_dir': [...]}) at remote 0x18b3680>, _sections=<OrderedDict(_OrderedDict__root=[[...], [...], None], _OrderedDict__map={}) at remote 0x18b14b0>, _dict=<type at remote 0x1012e40>) at remote 0x17356c8>, storage_response_error=<type at remote 0x16639b0>, delete_marker='x-amz-delete-marker', _credential_expiry_time=None, metadata_directive_header='x-amz-metadata-directive', storage_data_error=<type at ...(truncated), \r\n    throwflag=throwflag@entry=0) at /usr/src/debug/Python-2.7.5/Python/ceval.c:2740\r\n#67 0x00007f0ea735c0bd in PyEval_EvalCodeEx (co=<optimized out>, globals=<optimized out>, locals=locals@entry=0x0, args=<optimized out>, argcount=argcount@entry=3, kws=0x176bf90, kwcount=1, defs=0x1735728, \r\n    defcount=2, closure=closure@entry=0x0) at /usr/src/debug/Python-2.7.5/Python/ceval.c:3330\r\n#68 0x00007f0ea735a76f in fast_function (nk=<optimized out>, na=3, n=5, pp_stack=0x7fff9cd90bf0, func=<function at remote 0x184cd70>) at /usr/src/debug/Python-2.7.5/Python/ceval.c:4194\r\n#69 call_function (oparg=<optimized out>, pp_stack=0x7fff9cd90bf0) at /usr/src/debug/Python-2.7.5/Python/ceval.c:4119\r\n#70 PyEval_EvalFrameEx (\r\n    f=f@entry=Frame 0x176bdd0, for file /usr/lib/python2.7/site-packages/wal_e/worker/worker_util.py, line 13, in uri_put_file (creds=<Provider(acl_header='x-amz-acl', server_side_encryption_header='x-amz-server-side-encryption', copy_source_version_id='x-amz-copy-source-version-id', profile_name=None, mfa_header='x-amz-mfa', security_token_header='x-amz-security-token', date_header='x-amz-date', port=None, shared_credentials=<Config(_optcre=<_sre.SRE_Pattern at remote 0x127aa90>, _defaults=<OrderedDict(_OrderedDict__root=[[[[...], [...], 'debug'], [...], 'working_dir'], [...], None], _OrderedDict__map={'debug': [...], 'working_dir': [...]}) at remote 0x18b3680>, _sections=<OrderedDict(_OrderedDict__root=[[...], [...], None], _OrderedDict__map={}) at remote 0x18b14b0>, _dict=<type at remote 0x1012e40>) at remote 0x17356c8>, storage_response_error=<type at remote 0x16639b0>, delete_marker='x-amz-delete-marker', _credential_expiry_time=None, metadata_directive_header='x-amz-metadata-directive', storage_data_error=<type at re...(truncated), \r\n    throwflag=throwflag@entry=0) at /usr/src/debug/Python-2.7.5/Python/ceval.c:2740\r\n#71 0x00007f0ea735c0bd in PyEval_EvalCodeEx (co=<optimized out>, globals=<optimized out>, locals=locals@entry=0x0, args=<optimized out>, argcount=argcount@entry=3, kws=0x176b3d0, kwcount=1, defs=0x1650768, \r\n    defcount=1, closure=closure@entry=0x0) at /usr/src/debug/Python-2.7.5/Python/ceval.c:3330\r\n#72 0x00007f0ea735a76f in fast_function (nk=<optimized out>, na=3, n=5, pp_stack=0x7fff9cd90df0, func=<function at remote 0x1654140>) at /usr/src/debug/Python-2.7.5/Python/ceval.c:4194\r\n#73 call_function (oparg=<optimized out>, pp_stack=0x7fff9cd90df0) at /usr/src/debug/Python-2.7.5/Python/ceval.c:4119\r\n#74 PyEval_EvalFrameEx (\r\n    f=f@entry=Frame 0x176b1c0, for file /usr/lib/python2.7/site-packages/wal_e/operator/backup.py, line 487, in _upload_pg_cluster_dir (self=<S3Backup(layout=<StorageLayout(is_swift=False, is_s3=True, _api_prefix='s3://commutestream-banner-wale/', _url_tup=<ParseResult at remote 0x16dd8c0>, is_wabs=False, VERSION='005', _api_path_prefix='') at remote 0x16df0d0>, worker=<module at remote 0x18939f0>, cinfo=<CallingInfo(calling_format=<type at remote 0x1777750>, region=None, bucket_name='commutestream-banner-wale', ordinary_endpoint=None) at remote 0x1894190>, creds=<Provider(acl_header='x-amz-acl', server_side_encryption_header='x-amz-server-side-encryption', copy_source_version_id='x-amz-copy-source-version-id', profile_name=None, mfa_header='x-amz-mfa', security_token_header='x-amz-security-token', date_header='x-amz-date', port=None, shared_credentials=<Config(_optcre=<_sre.SRE_Pattern at remote 0x127aa90>, _defaults=<OrderedDict(_OrderedDict__root=[[[[...], [...], 'debug'], [...], 'working_dir'], [...], None], _OrderedDi...(truncated), \r\n    throwflag=throwflag@entry=0) at /usr/src/debug/Python-2.7.5/Python/ceval.c:2740\r\n#75 0x00007f0ea735c0bd in PyEval_EvalCodeEx (co=<optimized out>, globals=<optimized out>, locals=locals@entry=0x0, args=args@entry=0x18901a8, argcount=3, kws=kws@entry=0x1885d68, kwcount=kwcount@entry=3, \r\n    defs=defs@entry=0x184d128, defcount=defcount@entry=1, closure=0x0) at /usr/src/debug/Python-2.7.5/Python/ceval.c:3330\r\n#76 0x00007f0ea72e905d in function_call (func=<function at remote 0x188f140>, \r\n    arg=(<S3Backup(layout=<StorageLayout(is_swift=False, is_s3=True, _api_prefix='s3://commutestream-banner-wale/', _url_tup=<ParseResult at remote 0x16dd8c0>, is_wabs=False, VERSION='005', _api_path_prefix='') at remote 0x16df0d0>, worker=<module at remote 0x18939f0>, cinfo=<CallingInfo(calling_format=<type at remote 0x1777750>, region=None, bucket_name='commutestream-banner-wale', ordinary_endpoint=None) at remote 0x1894190>, creds=<Provider(acl_header='x-amz-acl', server_side_encryption_header='x-amz-server-side-encryption', copy_source_version_id='x-amz-copy-source-version-id', profile_name=None, mfa_header='x-amz-mfa', security_token_header='x-amz-security-token', date_header='x-amz-date', port=None, shared_credentials=<Config(_optcre=<_sre.SRE_Pattern at remote 0x127aa90>, _defaults=<OrderedDict(_OrderedDict__root=[[[[...], [...], 'debug'], [...], 'working_dir'], [...], None], _OrderedDict__map={'debug': [...], 'working_dir': [...]}) at remote 0x18b3680>, _sections=<OrderedDict(_OrderedDict__root=[[...], [...],...(truncated), \r\n    kw={'version': 'PostgreSQL 9.5.0 on x86_64-pc-linux-gnu, compiled by gcc (GCC) 4.8.5 20150623 (Red Hat 4.8.5-4), 64-bit', 'rate_limit': None, 'pool_size': 4})\r\n    at /usr/src/debug/Python-2.7.5/Objects/funcobject.c:526\r\n#77 0x00007f0ea72c40b3 in PyObject_Call (func=func@entry=<function at remote 0x188f140>, \r\n    arg=arg@entry=(<S3Backup(layout=<StorageLayout(is_swift=False, is_s3=True, _api_prefix='s3://commutestream-banner-wale/', _url_tup=<ParseResult at remote 0x16dd8c0>, is_wabs=False, VERSION='005', _api_path_prefix='') at remote 0x16df0d0>, worker=<module at remote 0x18939f0>, cinfo=<CallingInfo(calling_format=<type at remote 0x1777750>, region=None, bucket_name='commutestream-banner-wale', ordinary_endpoint=None) at remote 0x1894190>, creds=<Provider(acl_header='x-amz-acl', server_side_encryption_header='x-amz-server-side-encryption', copy_source_version_id='x-amz-copy-source-version-id', profile_name=None, mfa_header='x-amz-mfa', security_token_header='x-amz-security-token', date_header='x-amz-date', port=None, shared_credentials=<Config(_optcre=<_sre.SRE_Pattern at remote 0x127aa90>, _defaults=<OrderedDict(_OrderedDict__root=[[[[...], [...], 'debug'], [...], 'working_dir'], [...], None], _OrderedDict__map={'debug': [...], 'working_dir': [...]}) at remote 0x18b3680>, _sections=<OrderedDict(_OrderedDict__root=[[...], [...],...(truncated), kw=kw@entry={'version': 'PostgreSQL 9.5.0 on x86_64-pc-linux-gnu, compiled by gcc (GCC) 4.8.5 20150623 (Red Hat 4.8.5-4), 64-bit', 'rate_limit': None, 'pool_size': 4})\r\n    at /usr/src/debug/Python-2.7.5/Objects/abstract.c:2529\r\n#78 0x00007f0ea73572f7 in ext_do_call (nk=<optimized out>, na=<optimized out>, flags=<optimized out>, pp_stack=0x7fff9cd910b0, func=<function at remote 0x188f140>)\r\n    at /usr/src/debug/Python-2.7.5/Python/ceval.c:4411\r\n#79 PyEval_EvalFrameEx (\r\n    f=f@entry=Frame 0x1770790, for file /usr/lib/python2.7/site-packages/wal_e/operator/backup.py, line 197, in database_backup (self=<S3Backup(layout=<StorageLayout(is_swift=False, is_s3=True, _api_prefix='s3://commutestream-banner-wale/', _url_tup=<ParseResult at remote 0x16dd8c0>, is_wabs=False, VERSION='005', _api_path_prefix='') at remote 0x16df0d0>, worker=<module at remote 0x18939f0>, cinfo=<CallingInfo(calling_format=<type at remote 0x1777750>, region=None, bucket_name='commutestream-banner-wale', ordinary_endpoint=None) at remote 0x1894190>, creds=<Provider(acl_header='x-amz-acl', server_side_encryption_header='x-amz-server-side-encryption', copy_source_version_id='x-amz-copy-source-version-id', profile_name=None, mfa_header='x-amz-mfa', security_token_header='x-amz-security-token', date_header='x-amz-date', port=None, shared_credentials=<Config(_optcre=<_sre.SRE_Pattern at remote 0x127aa90>, _defaults=<OrderedDict(_OrderedDict__root=[[[[...], [...], 'debug'], [...], 'working_dir'], [...], None], _OrderedDict__map...(truncated), \r\n    throwflag=throwflag@entry=0) at /usr/src/debug/Python-2.7.5/Python/ceval.c:2779\r\n#80 0x00007f0ea735c0bd in PyEval_EvalCodeEx (co=<optimized out>, globals=<optimized out>, locals=locals@entry=0x0, args=<optimized out>, argcount=argcount@entry=2, kws=0x137b688, kwcount=3, defs=0x0, \r\n    defcount=0, closure=closure@entry=0x0) at /usr/src/debug/Python-2.7.5/Python/ceval.c:3330\r\n#81 0x00007f0ea735a76f in fast_function (nk=<optimized out>, na=2, n=8, pp_stack=0x7fff9cd912b0, func=<function at remote 0x188ec80>) at /usr/src/debug/Python-2.7.5/Python/ceval.c:4194\r\n#82 call_function (oparg=<optimized out>, pp_stack=0x7fff9cd912b0) at /usr/src/debug/Python-2.7.5/Python/ceval.c:4119\r\n#83 PyEval_EvalFrameEx (\r\n    f=f@entry=Frame 0x137b480, for file /usr/lib/python2.7/site-packages/wal_e/cmd.py, line 572, in main (parser=<ArgumentParser(_negative_number_matcher=<_sre.SRE_Pattern at remote 0x16987f0>, _option_string_actions={'-a': <_StoreAction(const=None, help='Account name of Windows Azure Blob Service account. Can also be defined in an environmentvariable. If both are defined, the one definedin the programs arguments takes precedence.', option_strings=['-a', '--wabs-account-name'], dest='wabs_account_name', required=False, nargs=None, choices=None, default=None, container=<_ArgumentGroup(_mutually_exclusive_groups=[<_MutuallyExclusiveGroup(_mutually_exclusive_groups=[...], _negative_number_matcher=<_sre.SRE_Pattern at remote 0x16987f0>, required=False, description=None, _option_string_actions={...}, title=None, _has_negative_number_optionals=[], _defaults={}, prefix_chars='-', argument_default=None, _registries={'action': {'store_false': <type at remote 0x1447cc0>, 'store_const': <type at remote 0x1446f30>, 'append_const': <ty...(truncated), \r\n    throwflag=throwflag@entry=0) at /usr/src/debug/Python-2.7.5/Python/ceval.c:2740\r\n#84 0x00007f0ea735a860 in fast_function (nk=<optimized out>, na=0, n=0, pp_stack=0x7fff9cd91410, func=<function at remote 0x16dd5f0>) at /usr/src/debug/Python-2.7.5/Python/ceval.c:4184\r\n#85 call_function (oparg=<optimized out>, pp_stack=0x7fff9cd91410) at /usr/src/debug/Python-2.7.5/Python/ceval.c:4119\r\n#86 PyEval_EvalFrameEx (f=f@entry=Frame 0xf4cf30, for file /bin/wal-e, line 9, in <module> (), throwflag=throwflag@entry=0) at /usr/src/debug/Python-2.7.5/Python/ceval.c:2740\r\n#87 0x00007f0ea735c0bd in PyEval_EvalCodeEx (co=co@entry=0x7f0ea7796a30, \r\n    globals=globals@entry={'__builtins__': <module at remote 0x7f0ea7813b08>, '__file__': '/bin/wal-e', '__package__': None, 'sys': <module at remote 0x7f0ea7813bb0>, '__requires__': 'wal-e==0.8.1', 'load_entry_point': <function at remote 0x7f0ea76d3500>, '__name__': '__main__', '__doc__': None}, \r\n    locals=locals@entry={'__builtins__': <module at remote 0x7f0ea7813b08>, '__file__': '/bin/wal-e', '__package__': None, 'sys': <module at remote 0x7f0ea7813bb0>, '__requires__': 'wal-e==0.8.1', 'load_entry_point': <function at remote 0x7f0ea76d3500>, '__name__': '__main__', '__doc__': None}, args=args@entry=0x0, argcount=argcount@entry=0, kws=kws@entry=0x0, kwcount=kwcount@entry=0, defs=defs@entry=0x0, \r\n    defcount=defcount@entry=0, closure=closure@entry=0x0) at /usr/src/debug/Python-2.7.5/Python/ceval.c:3330\r\n#88 0x00007f0ea735c1c2 in PyEval_EvalCode (co=co@entry=0x7f0ea7796a30, \r\n    globals=globals@entry={'__builtins__': <module at remote 0x7f0ea7813b08>, '__file__': '/bin/wal-e', '__package__': None, 'sys': <module at remote 0x7f0ea7813bb0>, '__requires__': 'wal-e==0.8.1', 'load_entry_point': <function at remote 0x7f0ea76d3500>, '__name__': '__main__', '__doc__': None}, \r\n    locals=locals@entry={'__builtins__': <module at remote 0x7f0ea7813b08>, '__file__': '/bin/wal-e', '__package__': None, 'sys': <module at remote 0x7f0ea7813bb0>, '__requires__': 'wal-e==0.8.1', 'load_entry_point': <function at remote 0x7f0ea76d3500>, '__name__': '__main__', '__doc__': None}) at /usr/src/debug/Python-2.7.5/Python/ceval.c:689\r\n#89 0x00007f0ea73755ff in run_mod (mod=<optimized out>, filename=filename@entry=0x7fff9cd92813 \"/bin/wal-e\", \r\n    globals=globals@entry={'__builtins__': <module at remote 0x7f0ea7813b08>, '__file__': '/bin/wal-e', '__package__': None, 'sys': <module at remote 0x7f0ea7813bb0>, '__requires__': 'wal-e==0.8.1', 'load_entry_point': <function at remote 0x7f0ea76d3500>, '__name__': '__main__', '__doc__': None}, \r\n    locals=locals@entry={'__builtins__': <module at remote 0x7f0ea7813b08>, '__file__': '/bin/wal-e', '__package__': None, 'sys': <module at remote 0x7f0ea7813bb0>, '__requires__': 'wal-e==0.8.1', 'load_entry_point': <function at remote 0x7f0ea76d3500>, '__name__': '__main__', '__doc__': None}, flags=flags@entry=0x7fff9cd91670, arena=arena@entry=0xf97380) at /usr/src/debug/Python-2.7.5/Python/pythonrun.c:1374\r\n#90 0x00007f0ea73767be in PyRun_FileExFlags (fp=fp@entry=0xfc9d40, filename=filename@entry=0x7fff9cd92813 \"/bin/wal-e\", start=start@entry=257, \r\n    globals=globals@entry={'__builtins__': <module at remote 0x7f0ea7813b08>, '__file__': '/bin/wal-e', '__package__': None, 'sys': <module at remote 0x7f0ea7813bb0>, '__requires__': 'wal-e==0.8.1', 'load_entry_point': <function at remote 0x7f0ea76d3500>, '__name__': '__main__', '__doc__': None}, \r\n    locals=locals@entry={'__builtins__': <module at remote 0x7f0ea7813b08>, '__file__': '/bin/wal-e', '__package__': None, 'sys': <module at remote 0x7f0ea7813bb0>, '__requires__': 'wal-e==0.8.1', 'load_entry_point': <function at remote 0x7f0ea76d3500>, '__name__': '__main__', '__doc__': None}, closeit=closeit@entry=1, flags=flags@entry=0x7fff9cd91670) at /usr/src/debug/Python-2.7.5/Python/pythonrun.c:1360\r\n#91 0x00007f0ea7377a49 in PyRun_SimpleFileExFlags (fp=fp@entry=0xfc9d40, filename=filename@entry=0x7fff9cd92813 \"/bin/wal-e\", closeit=closeit@entry=1, flags=flags@entry=0x7fff9cd91670)\r\n    at /usr/src/debug/Python-2.7.5/Python/pythonrun.c:952\r\n#92 0x00007f0ea7377f63 in PyRun_AnyFileExFlags (fp=fp@entry=0xfc9d40, filename=filename@entry=0x7fff9cd92813 \"/bin/wal-e\", closeit=closeit@entry=1, flags=flags@entry=0x7fff9cd91670)\r\n    at /usr/src/debug/Python-2.7.5/Python/pythonrun.c:756\r\n#93 0x00007f0ea7388b9f in Py_Main (argc=<optimized out>, argv=<optimized out>) at /usr/src/debug/Python-2.7.5/Modules/main.c:640\r\n#94 0x00007f0ea65b5b15 in __libc_start_main (main=0x4006f0 <main>, argc=4, ubp_av=0x7fff9cd91838, init=<optimized out>, fini=<optimized out>, rtld_fini=<optimized out>, stack_end=0x7fff9cd91828)\r\n    at libc-start.c:274\r\n#95 0x0000000000400721 in _start ()\r\n(gdb) %                                         \r\n```"},"comment":{"url":"https://api.github.com/repos/wal-e/wal-e/issues/comments/185395659","html_url":"https://github.com/wal-e/wal-e/issues/221#issuecomment-185395659","issue_url":"https://api.github.com/repos/wal-e/wal-e/issues/221","id":185395659,"user":{"login":"bfrog","id":135839,"avatar_url":"https://avatars.githubusercontent.com/u/135839?v=3","gravatar_id":"","url":"https://api.github.com/users/bfrog","html_url":"https://github.com/bfrog","followers_url":"https://api.github.com/users/bfrog/followers","following_url":"https://api.github.com/users/bfrog/following{/other_user}","gists_url":"https://api.github.com/users/bfrog/gists{/gist_id}","starred_url":"https://api.github.com/users/bfrog/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/bfrog/subscriptions","organizations_url":"https://api.github.com/users/bfrog/orgs","repos_url":"https://api.github.com/users/bfrog/repos","events_url":"https://api.github.com/users/bfrog/events{/privacy}","received_events_url":"https://api.github.com/users/bfrog/received_events","type":"User","site_admin":false},"created_at":"2016-02-17T20:44:14Z","updated_at":"2016-02-17T20:44:14Z","body":"This does indeed seem to be the problem, thank you"}}