{"action":"opened","issue":{"url":"https://api.github.com/repos/GoogleCloudPlatform/PerfKitBenchmarker/issues/841","repository_url":"https://api.github.com/repos/GoogleCloudPlatform/PerfKitBenchmarker","labels_url":"https://api.github.com/repos/GoogleCloudPlatform/PerfKitBenchmarker/issues/841/labels{/name}","comments_url":"https://api.github.com/repos/GoogleCloudPlatform/PerfKitBenchmarker/issues/841/comments","events_url":"https://api.github.com/repos/GoogleCloudPlatform/PerfKitBenchmarker/issues/841/events","html_url":"https://github.com/GoogleCloudPlatform/PerfKitBenchmarker/issues/841","id":132582217,"number":841,"title":"Error during fio job","user":{"login":"jntkflow","id":5816365,"avatar_url":"https://avatars.githubusercontent.com/u/5816365?v=3","gravatar_id":"","url":"https://api.github.com/users/jntkflow","html_url":"https://github.com/jntkflow","followers_url":"https://api.github.com/users/jntkflow/followers","following_url":"https://api.github.com/users/jntkflow/following{/other_user}","gists_url":"https://api.github.com/users/jntkflow/gists{/gist_id}","starred_url":"https://api.github.com/users/jntkflow/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jntkflow/subscriptions","organizations_url":"https://api.github.com/users/jntkflow/orgs","repos_url":"https://api.github.com/users/jntkflow/repos","events_url":"https://api.github.com/users/jntkflow/events{/privacy}","received_events_url":"https://api.github.com/users/jntkflow/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":0,"created_at":"2016-02-10T01:08:56Z","updated_at":"2016-02-10T01:08:56Z","closed_at":null,"body":"I'm not really sure what's happening but here's the most relevant output IMO:\r\n```\r\n2016-02-09 10:40:14,531 8dfe8095 MainThread fio(1/1) INFO     Running: ssh -A -p 22 ubuntu@52.34.238.33 -2 -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o IdentitiesOnly=yes -o PreferredAuthentications=publickey -o PasswordAuthentication=no -o ConnectTimeout=5 -o GSSAPIAuthentication=no -o ServerAliveInterval=30 -o ServerAliveCountMax=10 -i /var/folders/1n/619vv5jj2sv9cd8hgnr72md40000gn/T/perfkitbenchmarker/run_8dfe8095/perfkitbenchmarker_keyfile nohup python /tmp/pkb/execute_command.py --stdout /tmp/pkb/cmd3632414d-742b-4448-b99e-9c814f65ecc0.stdout --stderr /tmp/pkb/cmd3632414d-742b-4448-b99e-9c814f65ecc0.stderr --status /tmp/pkb/cmd3632414d-742b-4448-b99e-9c814f65ecc0.status --command 'sudo /tmp/pkb/fio/fio --output-format=json --directory=/scratch /tmp/pkb/fio.job' 1> /tmp/pkb/cmd3632414d-742b-4448-b99e-9c814f65ecc0.log 2>&1 &\r\n2016-02-09 10:40:15,394 8dfe8095 MainThread fio(1/1) INFO     Running: ssh -A -p 22 ubuntu@52.34.238.33 -2 -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o IdentitiesOnly=yes -o PreferredAuthentications=publickey -o PasswordAuthentication=no -o ConnectTimeout=5 -o GSSAPIAuthentication=no -o ServerAliveInterval=30 -o ServerAliveCountMax=10 -i /var/folders/1n/619vv5jj2sv9cd8hgnr72md40000gn/T/perfkitbenchmarker/run_8dfe8095/perfkitbenchmarker_keyfile python /tmp/pkb/wait_for_command.py --stdout /tmp/pkb/cmd3632414d-742b-4448-b99e-9c814f65ecc0.stdout --stderr /tmp/pkb/cmd3632414d-742b-4448-b99e-9c814f65ecc0.stderr --status /tmp/pkb/cmd3632414d-742b-4448-b99e-9c814f65ecc0.status --delete\r\n2016-02-09 10:53:11,852 8dfe8095 MainThread fio(1/1) INFO     Ran ssh -A -p 22 ubuntu@52.34.238.33 -2 -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o IdentitiesOnly=yes -o PreferredAuthentications=publickey -o PasswordAuthentication=no -o ConnectTimeout=5 -o GSSAPIAuthentication=no -o ServerAliveInterval=30 -o ServerAliveCountMax=10 -i /var/folders/1n/619vv5jj2sv9cd8hgnr72md40000gn/T/perfkitbenchmarker/run_8dfe8095/perfkitbenchmarker_keyfile python /tmp/pkb/wait_for_command.py --stdout /tmp/pkb/cmd3632414d-742b-4448-b99e-9c814f65ecc0.stdout --stderr /tmp/pkb/cmd3632414d-742b-4448-b99e-9c814f65ecc0.stderr --status /tmp/pkb/cmd3632414d-742b-4448-b99e-9c814f65ecc0.status --delete. Got return code (6).\r\n\r\nSTDERR: Warning: Permanently added '52.34.238.33' (RSA) to the list of known hosts.\r\nfio: pid=0, err=2/file:filesetup.c:87, func=open, error=No such file or directory\r\nfio: pid=0, err=2/file:filesetup.c:87, func=open, error=No such file or directory\r\nfio: pid=0, err=2/file:filesetup.c:87, func=open, error=No such file or directory\r\nfio: pid=0, err=2/file:filesetup.c:87, func=open, error=No such file or directory\r\nfio: pid=0, err=2/file:filesetup.c:87, func=open, error=No such file or directory\r\nfio: pid=0, err=2/file:filesetup.c:87, func=open, error=No such file or directory\r\n\r\n2016-02-09 10:53:11,856 8dfe8095 MainThread fio(1/1) INFO     Running: ssh -A -p 22 ubuntu@52.34.238.33 -2 -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o IdentitiesOnly=yes -o PreferredAuthentications=publickey -o PasswordAuthentication=no -o ConnectTimeout=5 -o GSSAPIAuthentication=no -o ServerAliveInterval=30 -o ServerAliveCountMax=10 -i /var/folders/1n/619vv5jj2sv9cd8hgnr72md40000gn/T/perfkitbenchmarker/run_8dfe8095/perfkitbenchmarker_keyfile cat /tmp/pkb/cmd3632414d-742b-4448-b99e-9c814f65ecc0.log\r\n2016-02-09 10:53:12,845 8dfe8095 MainThread fio(1/1) WARNING  Exception during RobustRemoteCommand. Wrapper script log:\r\nINFO:root:Acquiring lock on /tmp/pkb/cmd3632414d-742b-4448-b99e-9c814f65ecc0.status\r\nINFO:root:Started pid 10159: sudo /tmp/pkb/fio/fio --output-format=json --directory=/scratch /tmp/pkb/fio.job\r\nINFO:root:Waiting on PID 10159\r\nINFO:root:Return code: 6\r\n\r\n2016-02-09 10:53:12,846 8dfe8095 MainThread fio(1/1) ERROR    Error during benchmark fio\r\nTraceback (most recent call last):\r\n  File \"/Users/dhyon/PerfKitBenchmarker/perfkitbenchmarker/pkb.py\", line 376, in RunBenchmark\r\n    detailed_timer)\r\n  File \"/Users/dhyon/PerfKitBenchmarker/perfkitbenchmarker/pkb.py\", line 260, in DoRunPhase\r\n    samples = benchmark.Run(spec)\r\n  File \"/Users/dhyon/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/fio_benchmark.py\", line 475, in Run\r\n    RunIt()\r\n  File \"/Users/dhyon/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/fio_benchmark.py\", line 455, in RunIt\r\n    stdout, stderr = vm.RobustRemoteCommand(fio_command, should_log=True)\r\n  File \"/Users/dhyon/PerfKitBenchmarker/perfkitbenchmarker/linux_virtual_machine.py\", line 156, in RobustRemoteCommand\r\n    return self.RemoteCommand(' '.join(wait_command), should_log=should_log)\r\n  File \"/Users/dhyon/PerfKitBenchmarker/perfkitbenchmarker/linux_virtual_machine.py\", line 313, in RemoteCommand\r\n    suppress_warning, timeout)\r\n  File \"/Users/dhyon/PerfKitBenchmarker/perfkitbenchmarker/linux_virtual_machine.py\", line 374, in RemoteHostCommand\r\n    raise errors.VirtualMachine.RemoteCommandError(error_text)\r\nRemoteCommandError: Got non-zero return code (6) executing python /tmp/pkb/wait_for_command.py --stdout /tmp/pkb/cmd3632414d-742b-4448-b99e-9c814f65ecc0.stdout --stderr /tmp/pkb/cmd3632414d-742b-4448-b99e-9c814f65ecc0.stderr --status /tmp/pkb/cmd3632414d-742b-4448-b99e-9c814f65ecc0.status --delete\r\nFull command: ssh -A -p 22 ubuntu@52.34.238.33 -2 -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o IdentitiesOnly=yes -o PreferredAuthentications=publickey -o PasswordAuthentication=no -o ConnectTimeout=5 -o GSSAPIAuthentication=no -o ServerAliveInterval=30 -o ServerAliveCountMax=10 -i /var/folders/1n/619vv5jj2sv9cd8hgnr72md40000gn/T/perfkitbenchmarker/run_8dfe8095/perfkitbenchmarker_keyfile python /tmp/pkb/wait_for_command.py --stdout /tmp/pkb/cmd3632414d-742b-4448-b99e-9c814f65ecc0.stdout --stderr /tmp/pkb/cmd3632414d-742b-4448-b99e-9c814f65ecc0.stderr --status /tmp/pkb/cmd3632414d-742b-4448-b99e-9c814f65ecc0.status --delete\r\n```\r\nThis is happening consistently while other tests such as unixbench are working fine."}}