{"action":"created","issue":{"url":"https://api.github.com/repos/Azure/acs-engine/issues/3933","repository_url":"https://api.github.com/repos/Azure/acs-engine","labels_url":"https://api.github.com/repos/Azure/acs-engine/issues/3933/labels{/name}","comments_url":"https://api.github.com/repos/Azure/acs-engine/issues/3933/comments","events_url":"https://api.github.com/repos/Azure/acs-engine/issues/3933/events","html_url":"https://github.com/Azure/acs-engine/issues/3933","id":365856181,"node_id":"MDU6SXNzdWUzNjU4NTYxODE=","number":3933,"title":"Cluster provisioning fails due to invalid nvidia keys, during apt-get update in the cse for agents and master","user":{"login":"nikolajbrinch","id":6940117,"node_id":"MDQ6VXNlcjY5NDAxMTc=","avatar_url":"https://avatars3.githubusercontent.com/u/6940117?v=4","gravatar_id":"","url":"https://api.github.com/users/nikolajbrinch","html_url":"https://github.com/nikolajbrinch","followers_url":"https://api.github.com/users/nikolajbrinch/followers","following_url":"https://api.github.com/users/nikolajbrinch/following{/other_user}","gists_url":"https://api.github.com/users/nikolajbrinch/gists{/gist_id}","starred_url":"https://api.github.com/users/nikolajbrinch/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/nikolajbrinch/subscriptions","organizations_url":"https://api.github.com/users/nikolajbrinch/orgs","repos_url":"https://api.github.com/users/nikolajbrinch/repos","events_url":"https://api.github.com/users/nikolajbrinch/events{/privacy}","received_events_url":"https://api.github.com/users/nikolajbrinch/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":{"login":"CecileRobertMichon","id":8650424,"node_id":"MDQ6VXNlcjg2NTA0MjQ=","avatar_url":"https://avatars2.githubusercontent.com/u/8650424?v=4","gravatar_id":"","url":"https://api.github.com/users/CecileRobertMichon","html_url":"https://github.com/CecileRobertMichon","followers_url":"https://api.github.com/users/CecileRobertMichon/followers","following_url":"https://api.github.com/users/CecileRobertMichon/following{/other_user}","gists_url":"https://api.github.com/users/CecileRobertMichon/gists{/gist_id}","starred_url":"https://api.github.com/users/CecileRobertMichon/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/CecileRobertMichon/subscriptions","organizations_url":"https://api.github.com/users/CecileRobertMichon/orgs","repos_url":"https://api.github.com/users/CecileRobertMichon/repos","events_url":"https://api.github.com/users/CecileRobertMichon/events{/privacy}","received_events_url":"https://api.github.com/users/CecileRobertMichon/received_events","type":"User","site_admin":false},"assignees":[{"login":"CecileRobertMichon","id":8650424,"node_id":"MDQ6VXNlcjg2NTA0MjQ=","avatar_url":"https://avatars2.githubusercontent.com/u/8650424?v=4","gravatar_id":"","url":"https://api.github.com/users/CecileRobertMichon","html_url":"https://github.com/CecileRobertMichon","followers_url":"https://api.github.com/users/CecileRobertMichon/followers","following_url":"https://api.github.com/users/CecileRobertMichon/following{/other_user}","gists_url":"https://api.github.com/users/CecileRobertMichon/gists{/gist_id}","starred_url":"https://api.github.com/users/CecileRobertMichon/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/CecileRobertMichon/subscriptions","organizations_url":"https://api.github.com/users/CecileRobertMichon/orgs","repos_url":"https://api.github.com/users/CecileRobertMichon/repos","events_url":"https://api.github.com/users/CecileRobertMichon/events{/privacy}","received_events_url":"https://api.github.com/users/CecileRobertMichon/received_events","type":"User","site_admin":false}],"milestone":null,"comments":8,"created_at":"2018-10-02T11:35:27Z","updated_at":"2018-10-02T18:37:53Z","closed_at":"2018-10-02T17:58:13Z","author_association":"NONE","body":"<!-- Thanks for filing an issue! Before hitting the button, please answer these questions. It's helpful to search the existing GitHub issues first. It's likely that another user has already reported the issue you're facing, or it's a known issue that we're already aware of-->\r\n\r\n**Is this a request for help?**:\r\nyes\r\n---\r\n\r\n**Is this an ISSUE or FEATURE REQUEST?** (choose one):\r\nISSUE\r\n---\r\n\r\n**What version of acs-engine?**:\r\n0.22.2\r\n---\r\nkubernetes.json\r\n```\r\n{\r\n  \"apiVersion\": \"vlabs\",\r\n  \"properties\": {\r\n    \"orchestratorProfile\": {\r\n      \"orchestratorType\": \"Kubernetes\",\r\n      \"orchestratorRelease\": \"1.11\",\r\n      \"orchestratorVersion\": \"1.11.2\",\r\n      \"kubernetesConfig\": {\r\n        \"enableRbac\": true,\r\n        \"dockerEngineVersion\": \"17.05.*\",\r\n        \"etcdDiskSizeGB\": \"256\"\r\n      }\r\n    },\r\n    \"masterProfile\": {\r\n      \"count\": 1,\r\n      \"dnsPrefix\": \"...\",\r\n      \"vmSize\": \"Standard_DS1_v2\",\r\n      \"storageProfile\": \"ManagedDisks\"\r\n    },\r\n    \"agentPoolProfiles\": [\r\n      {\r\n        \"name\": \"agentpool1\",\r\n        \"count\": 3,\r\n        \"vmSize\": \"Standard_DS1_v2\",\r\n        \"availabilityProfile\": \"AvailabilitySet\",\r\n        \"storageProfile\": \"ManagedDisks\"\r\n      }\r\n    ],\r\n    \"linuxProfile\": {\r\n      \"adminUsername\": \"\",\r\n      \"ssh\": {\r\n        \"publicKeys\": [\r\n          {\r\n            \"keyData\": \"ssh-rsa ...\"\"\r\n          }\r\n        ]\r\n      }\r\n    },\r\n    \"servicePrincipalProfile\": {\r\n      \"clientId\": \"\",\r\n      \"secret\": \"\"\r\n    }\r\n  }\r\n}\r\n```\r\n**Orchestrator and version (e.g. Kubernetes, DC/OS, Swarm)**\r\n\r\n\r\n**What happened**:\r\nCommand output:\r\n```\r\nINFO[0547] Finished ARM Deployment (nine-test-cluster_rg-715616485). Error: Code=\"DeploymentFailed\" Message=\"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-debug for usage details.\" Details=  [\r\n    {\r\n      \"code\": \"Conflict\",\r\n      \"message\": \"{\\r\\n  \\\"status\\\": \\\"Failed\\\",\\r\\n  \\\"error\\\": {\\r\\n    \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n    \\\"message\\\": \\\"The resource operation completed with terminal provisioning state 'Failed'.\\\",\\r\\n    \\\"details\\\": [\\r\\n      {\\r\\n        \\\"code\\\": \\\"VMExtensionProvisioningError\\\",\\r\\n        \\\"message\\\": \\\"VM has reported a failure when processing extension 'cse-agent-2'. Error message: \\\\\\\"Enable failed: failed to execute command: command terminated with exit status=99\\\\n[stdout]\\\\n\\\\n[stderr]\\\\n\\\\\\\".\\\"\\r\\n      }\\r\\n    ]\\r\\n  }\\r\\n}\"\r\n    },\r\n    {\r\n      \"code\": \"Conflict\",\r\n      \"message\": \"{\\r\\n  \\\"status\\\": \\\"Failed\\\",\\r\\n  \\\"error\\\": {\\r\\n    \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n    \\\"message\\\": \\\"The resource operation completed with terminal provisioning state 'Failed'.\\\",\\r\\n    \\\"details\\\": [\\r\\n      {\\r\\n        \\\"code\\\": \\\"VMExtensionProvisioningError\\\",\\r\\n        \\\"message\\\": \\\"VM has reported a failure when processing extension 'cse-agent-1'. Error message: \\\\\\\"Enable failed: failed to execute command: command terminated with exit status=99\\\\n[stdout]\\\\n\\\\n[stderr]\\\\n\\\\\\\".\\\"\\r\\n      }\\r\\n    ]\\r\\n  }\\r\\n}\"\r\n    },\r\n    {\r\n      \"code\": \"Conflict\",\r\n      \"message\": \"{\\r\\n  \\\"status\\\": \\\"Failed\\\",\\r\\n  \\\"error\\\": {\\r\\n    \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n    \\\"message\\\": \\\"The resource operation completed with terminal provisioning state 'Failed'.\\\",\\r\\n    \\\"details\\\": [\\r\\n      {\\r\\n        \\\"code\\\": \\\"VMExtensionProvisioningError\\\",\\r\\n        \\\"message\\\": \\\"VM has reported a failure when processing extension 'cse-agent-0'. Error message: \\\\\\\"Enable failed: failed to execute command: command terminated with exit status=99\\\\n[stdout]\\\\n\\\\n[stderr]\\\\n\\\\\\\".\\\"\\r\\n      }\\r\\n    ]\\r\\n  }\\r\\n}\"\r\n    },\r\n    {\r\n      \"code\": \"Conflict\",\r\n      \"message\": \"{\\r\\n  \\\"status\\\": \\\"Failed\\\",\\r\\n  \\\"error\\\": {\\r\\n    \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n    \\\"message\\\": \\\"The resource operation completed with terminal provisioning state 'Failed'.\\\",\\r\\n    \\\"details\\\": [\\r\\n      {\\r\\n        \\\"code\\\": \\\"VMExtensionProvisioningError\\\",\\r\\n        \\\"message\\\": \\\"VM has reported a failure when processing extension 'cse-master-0'. Error message: \\\\\\\"Enable failed: failed to execute command: command terminated with exit status=99\\\\n[stdout]\\\\n\\\\n[stderr]\\\\n\\\\\\\".\\\"\\r\\n      }\\r\\n    ]\\r\\n  }\\r\\n}\"\r\n    }\r\n  ] \r\nFATA[0547] Code=\"DeploymentFailed\" Message=\"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-debug for usage details.\" Details=[\r\n    {\r\n      \"code\": \"Conflict\",\r\n      \"message\": \"{\\r\\n  \\\"status\\\": \\\"Failed\\\",\\r\\n  \\\"error\\\": {\\r\\n    \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n    \\\"message\\\": \\\"The resource operation completed with terminal provisioning state 'Failed'.\\\",\\r\\n    \\\"details\\\": [\\r\\n      {\\r\\n        \\\"code\\\": \\\"VMExtensionProvisioningError\\\",\\r\\n        \\\"message\\\": \\\"VM has reported a failure when processing extension 'cse-agent-2'. Error message: \\\\\\\"Enable failed: failed to execute command: command terminated with exit status=99\\\\n[stdout]\\\\n\\\\n[stderr]\\\\n\\\\\\\".\\\"\\r\\n      }\\r\\n    ]\\r\\n  }\\r\\n}\"\r\n    },\r\n    {\r\n      \"code\": \"Conflict\",\r\n      \"message\": \"{\\r\\n  \\\"status\\\": \\\"Failed\\\",\\r\\n  \\\"error\\\": {\\r\\n    \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n    \\\"message\\\": \\\"The resource operation completed with terminal provisioning state 'Failed'.\\\",\\r\\n    \\\"details\\\": [\\r\\n      {\\r\\n        \\\"code\\\": \\\"VMExtensionProvisioningError\\\",\\r\\n        \\\"message\\\": \\\"VM has reported a failure when processing extension 'cse-agent-1'. Error message: \\\\\\\"Enable failed: failed to execute command: command terminated with exit status=99\\\\n[stdout]\\\\n\\\\n[stderr]\\\\n\\\\\\\".\\\"\\r\\n      }\\r\\n    ]\\r\\n  }\\r\\n}\"\r\n    },\r\n    {\r\n      \"code\": \"Conflict\",\r\n      \"message\": \"{\\r\\n  \\\"status\\\": \\\"Failed\\\",\\r\\n  \\\"error\\\": {\\r\\n    \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n    \\\"message\\\": \\\"The resource operation completed with terminal provisioning state 'Failed'.\\\",\\r\\n    \\\"details\\\": [\\r\\n      {\\r\\n        \\\"code\\\": \\\"VMExtensionProvisioningError\\\",\\r\\n        \\\"message\\\": \\\"VM has reported a failure when processing extension 'cse-agent-0'. Error message: \\\\\\\"Enable failed: failed to execute command: command terminated with exit status=99\\\\n[stdout]\\\\n\\\\n[stderr]\\\\n\\\\\\\".\\\"\\r\\n      }\\r\\n    ]\\r\\n  }\\r\\n}\"\r\n    },\r\n    {\r\n      \"code\": \"Conflict\",\r\n      \"message\": \"{\\r\\n  \\\"status\\\": \\\"Failed\\\",\\r\\n  \\\"error\\\": {\\r\\n    \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n    \\\"message\\\": \\\"The resource operation completed with terminal provisioning state 'Failed'.\\\",\\r\\n    \\\"details\\\": [\\r\\n      {\\r\\n        \\\"code\\\": \\\"VMExtensionProvisioningError\\\",\\r\\n        \\\"message\\\": \\\"VM has reported a failure when processing extension 'cse-master-0'. Error message: \\\\\\\"Enable failed: failed to execute command: command terminated with exit status=99\\\\n[stdout]\\\\n\\\\n[stderr]\\\\n\\\\\\\".\\\"\\r\\n      }\\r\\n    ]\\r\\n  }\\r\\n}\"\r\n    }\r\n  ]\r\n```\r\n/var/log/azure/cluster-provisioning.log\r\n```\r\n++ date\r\n++ hostname\r\n+ echo Tue Oct 2 10:56:43 UTC 2018,k8s-master-17869660-0, startcustomscript\r\n+ source /opt/azure/containers/provision_source.sh\r\n++ ERR_SYSTEMCTL_START_FAIL=4\r\n++ ERR_CLOUD_INIT_TIMEOUT=5\r\n++ ERR_FILE_WATCH_TIMEOUT=6\r\n++ ERR_HOLD_WALINUXAGENT=7\r\n++ ERR_RELEASE_HOLD_WALINUXAGENT=8\r\n++ ERR_APT_INSTALL_TIMEOUT=9\r\n++ ERR_ETCD_DATA_DIR_NOT_FOUND=10\r\n++ ERR_ETCD_RUNNING_TIMEOUT=11\r\n++ ERR_ETCD_DOWNLOAD_TIMEOUT=12\r\n++ ERR_ETCD_VOL_MOUNT_FAIL=13\r\n++ ERR_ETCD_START_TIMEOUT=14\r\n++ ERR_ETCD_CONFIG_FAIL=15\r\n++ ERR_DOCKER_INSTALL_TIMEOUT=20\r\n++ ERR_DOCKER_DOWNLOAD_TIMEOUT=21\r\n++ ERR_DOCKER_KEY_DOWNLOAD_TIMEOUT=22\r\n++ ERR_DOCKER_APT_KEY_TIMEOUT=23\r\n++ ERR_DOCKER_START_FAIL=24\r\n++ ERR_K8S_RUNNING_TIMEOUT=30\r\n++ ERR_K8S_DOWNLOAD_TIMEOUT=31\r\n++ ERR_KUBECTL_NOT_FOUND=32\r\n++ ERR_KUBELET_START_FAIL=34\r\n++ ERR_IMG_DOWNLOAD_TIMEOUT=33\r\n++ ERR_CNI_DOWNLOAD_TIMEOUT=41\r\n++ ERR_MS_PROD_DEB_DOWNLOAD_TIMEOUT=42\r\n++ ERR_MS_PROD_DEB_PKG_ADD_FAIL=43\r\n++ ERR_MODPROBE_FAIL=49\r\n++ ERR_OUTBOUND_CONN_FAIL=50\r\n++ ERR_KATA_KEY_DOWNLOAD_TIMEOUT=60\r\n++ ERR_KATA_APT_KEY_TIMEOUT=61\r\n++ ERR_KATA_INSTALL_TIMEOUT=62\r\n++ ERR_CONTAINERD_DOWNLOAD_TIMEOUT=70\r\n++ ERR_CUSTOM_SEARCH_DOMAINS_FAIL=80\r\n++ ERR_GPU_DRIVERS_START_FAIL=84\r\n++ ERR_GPU_DRIVERS_INSTALL_TIMEOUT=85\r\n++ ERR_APT_DAILY_TIMEOUT=98\r\n++ ERR_APT_UPDATE_TIMEOUT=99\r\n++ ERR_CSE_PROVISION_SCRIPT_NOT_READY_TIMEOUT=100\r\n+++ awk '{print toupper($0)}'\r\n+++ tr -d 'ID=\"'\r\n+++ grep '^ID='\r\n+++ cat /etc/lsb-release /etc/os-release\r\n++ OS=UBUNTU\r\n++ UBUNTU_OS_NAME=UBUNTU\r\n++ RHEL_OS_NAME=RHEL\r\n++ COREOS_OS_NAME=COREOS\r\n++ KUBECTL=/usr/local/bin/kubectl\r\n++ DOCKER=/usr/bin/docker\r\n++ GPU_DV=396.26\r\n++ GPU_DEST=/usr/local/nvidia\r\n++ NVIDIA_DOCKER_VERSION=2.0.3\r\n++ DOCKER_VERSION=1.13.1-1\r\n++ NVIDIA_CONTAINER_RUNTIME_VERSION=2.0.0\r\n+ source /opt/azure/containers/provision_installs.sh\r\n++ CC_SERVICE_IN_TMP=/opt/azure/containers/cc-proxy.service.in\r\n++ CC_SOCKET_IN_TMP=/opt/azure/containers/cc-proxy.socket.in\r\n++ CNI_CONFIG_DIR=/etc/cni/net.d\r\n++ CNI_BIN_DIR=/opt/cni/bin\r\n++ CNI_DOWNLOADS_DIR=/opt/cni/downloads\r\n+ source /opt/azure/containers/provision_configs.sh\r\n+ CUSTOM_SEARCH_DOMAIN_SCRIPT=/opt/azure/containers/setup-custom-search-domains.sh\r\n+ set +x\r\n+ [[ UBUNTU == COREOS ]]\r\n+ '[' -f /var/run/reboot-required ']'\r\n+ REBOOTREQUIRED=false\r\n+ '[' -f /var/log/azure/golden-image-install.complete ']'\r\n+ echo 'detected golden image pre-install'\r\ndetected golden image pre-install\r\n+ FULL_INSTALL_REQUIRED=false\r\n+ testOutboundConnection\r\n+ retrycmd_if_failure 40 1 3 nc -vz www.google.com 443\r\n+ retries=40\r\n+ wait_sleep=1\r\n+ timeout=3\r\n+ shift\r\n+ shift\r\n+ shift\r\n++ seq 1 40\r\n+ for i in '$(seq 1 $retries)'\r\n+ timeout 3 nc -vz www.google.com 443\r\nConnection to www.google.com 443 port [tcp/https] succeeded!\r\n+ '[' 0 -eq 0 ']'\r\n+ break\r\n+ echo Executed '\"nc' -vz www.google.com '443\"' 1 times\r\nExecuted \"nc -vz www.google.com 443\" 1 times\r\n+ [[ ! -z true ]]\r\n+ installEtcd\r\n++ tr -d '[:space:]'\r\n++ cut -d : -f 2\r\n++ grep 'etcd Version'\r\n++ etcd --version\r\n+ CURRENT_VERSION=3.2.23\r\n+ [[ 3.2.23 == \\3\\.\\2\\.\\2\\3 ]]\r\n+ echo 'etcd version 3.2.23 is already installed, skipping download'\r\netcd version 3.2.23 is already installed, skipping download\r\n+ false\r\n+ echo 'Golden image; skipping dependencies installation'\r\nGolden image; skipping dependencies installation\r\n+ installContainerRuntime\r\n+ [[ docker == \\d\\o\\c\\k\\e\\r ]]\r\n+ installDocker\r\n++ cut -d , -f 1\r\n++ cut -d ' ' -f 3\r\n++ docker --version\r\n+ CURRENT_VERSION=1.13.1\r\n+ [[ 1.13.1 = 17.05.* ]]\r\n+ retrycmd_if_failure_no_stats 20 1 5 curl -fsSL https://aptdocker.azureedge.net/gpg\r\n+ retries=20\r\n+ wait_sleep=1\r\n+ timeout=5\r\n+ shift\r\n+ shift\r\n+ shift\r\n++ seq 1 20\r\n+ for i in '$(seq 1 $retries)'\r\n+ timeout 5 curl -fsSL https://aptdocker.azureedge.net/gpg\r\n+ '[' 0 -eq 0 ']'\r\n+ break\r\n+ retrycmd_if_failure 10 5 10 apt-key add /tmp/aptdocker.gpg\r\n+ retries=10\r\n+ wait_sleep=5\r\n+ timeout=10\r\n+ shift\r\n+ shift\r\n+ shift\r\n++ seq 1 10\r\n+ for i in '$(seq 1 $retries)'\r\n+ timeout 10 apt-key add /tmp/aptdocker.gpg\r\nOK\r\n+ '[' 0 -eq 0 ']'\r\n+ break\r\n+ echo Executed '\"apt-key' add '/tmp/aptdocker.gpg\"' 1 times\r\nExecuted \"apt-key add /tmp/aptdocker.gpg\" 1 times\r\n+ sudo tee /etc/apt/sources.list.d/docker.list\r\n+ echo 'deb https://aptdocker.azureedge.net/repo ubuntu-xenial main'\r\ndeb https://aptdocker.azureedge.net/repo ubuntu-xenial main\r\n+ printf 'Package: docker-engine\\nPin: version 17.05.*\\nPin-Priority: 550\\n'\r\n+ apt_get_update\r\n+ retries=10\r\n+ apt_update_output=/tmp/apt-get-update.out\r\n++ seq 1 10\r\n+ for i in '$(seq 1 $retries)'\r\n+ timeout 30 dpkg --configure -a\r\n+ timeout 30 apt-get -f -y install\r\nReading package lists...\r\nBuilding dependency tree...\r\nReading state information...\r\n0 upgraded, 0 newly installed, 0 to remove and 23 not upgraded.\r\n+ grep -E '^([WE]:.*)|([eE]rr.*)$'\r\n+ tee /tmp/apt-get-update.out\r\n+ timeout 120 apt-get update\r\nE: Could not get lock /var/lib/apt/lists/lock - open (11: Resource temporarily unavailable)\r\nE: Unable to lock directory /var/lib/apt/lists/\r\n+ '[' 0 -ne 0 ']'\r\n+ cat /tmp/apt-get-update.out\r\nReading package lists...\r\nE: Could not get lock /var/lib/apt/lists/lock - open (11: Resource temporarily unavailable)\r\nE: Unable to lock directory /var/lib/apt/lists/\r\n+ '[' 1 -eq 10 ']'\r\n+ sleep 30\r\n+ for i in '$(seq 1 $retries)'\r\n+ timeout 30 dpkg --configure -a\r\ndpkg: error: dpkg status database is locked by another process\r\n+ timeout 30 apt-get -f -y install\r\nE: Could not get lock /var/lib/dpkg/lock - open (11: Resource temporarily unavailable)\r\nE: Unable to lock the administration directory (/var/lib/dpkg/), is another process using it?\r\n+ grep -E '^([WE]:.*)|([eE]rr.*)$'\r\n+ tee /tmp/apt-get-update.out\r\n+ timeout 120 apt-get update\r\nErr:9 https://nvidia.github.io/libnvidia-container/ubuntu16.04/amd64  InRelease\r\nErr:10 https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64  InRelease\r\nErr:11 https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64  InRelease\r\nW: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://nvidia.github.io/libnvidia-container/ubuntu16.04/amd64  InRelease: The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64  InRelease: The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64  InRelease: The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Failed to fetch https://nvidia.github.io/libnvidia-container/ubuntu16.04/amd64/InRelease  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Failed to fetch https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64/InRelease  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Failed to fetch https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64/InRelease  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Some index files failed to download. They have been ignored, or old ones used instead.\r\n+ '[' 0 -ne 0 ']'\r\n+ cat /tmp/apt-get-update.out\r\nHit:1 http://azure.archive.ubuntu.com/ubuntu xenial InRelease\r\nHit:2 http://azure.archive.ubuntu.com/ubuntu xenial-updates InRelease\r\nHit:3 http://azure.archive.ubuntu.com/ubuntu xenial-backports InRelease\r\nIgn:4 http://download.opensuse.org/repositories/home:/clearcontainers:/clear-containers-3/xUbuntu_16.04  InRelease\r\nHit:5 http://download.opensuse.org/repositories/home:/clearcontainers:/clear-containers-3/xUbuntu_16.04  Release\r\nHit:6 http://security.ubuntu.com/ubuntu xenial-security InRelease\r\nHit:7 https://packages.microsoft.com/ubuntu/16.04/prod xenial InRelease\r\nHit:8 https://aptdocker.azureedge.net/repo ubuntu-xenial InRelease\r\nGet:10 https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64  InRelease [1,136 B]\r\nGet:11 https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64  InRelease [1,129 B]\r\nErr:9 https://nvidia.github.io/libnvidia-container/ubuntu16.04/amd64  InRelease\r\n  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nErr:10 https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64  InRelease\r\n  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nErr:11 https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64  InRelease\r\n  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nFetched 2,265 B in 1s (1,567 B/s)\r\nReading package lists...\r\nW: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://nvidia.github.io/libnvidia-container/ubuntu16.04/amd64  InRelease: The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64  InRelease: The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64  InRelease: The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Failed to fetch https://nvidia.github.io/libnvidia-container/ubuntu16.04/amd64/InRelease  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Failed to fetch https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64/InRelease  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Failed to fetch https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64/InRelease  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Some index files failed to download. They have been ignored, or old ones used instead.\r\n+ '[' 2 -eq 10 ']'\r\n+ sleep 30\r\n+ for i in '$(seq 1 $retries)'\r\n+ timeout 30 dpkg --configure -a\r\ndpkg: error: dpkg status database is locked by another process\r\n+ timeout 30 apt-get -f -y install\r\nE: Could not get lock /var/lib/dpkg/lock - open (11: Resource temporarily unavailable)\r\nE: Unable to lock the administration directory (/var/lib/dpkg/), is another process using it?\r\n+ grep -E '^([WE]:.*)|([eE]rr.*)$'\r\n+ tee /tmp/apt-get-update.out\r\n+ timeout 120 apt-get update\r\nErr:8 https://nvidia.github.io/libnvidia-container/ubuntu16.04/amd64  InRelease\r\nErr:10 https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64  InRelease\r\nErr:11 https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64  InRelease\r\nW: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://nvidia.github.io/libnvidia-container/ubuntu16.04/amd64  InRelease: The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64  InRelease: The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64  InRelease: The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Failed to fetch https://nvidia.github.io/libnvidia-container/ubuntu16.04/amd64/InRelease  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Failed to fetch https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64/InRelease  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Failed to fetch https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64/InRelease  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Some index files failed to download. They have been ignored, or old ones used instead.\r\n+ '[' 0 -ne 0 ']'\r\n+ cat /tmp/apt-get-update.out\r\nHit:1 http://azure.archive.ubuntu.com/ubuntu xenial InRelease\r\nHit:2 http://azure.archive.ubuntu.com/ubuntu xenial-updates InRelease\r\nHit:3 http://azure.archive.ubuntu.com/ubuntu xenial-backports InRelease\r\nHit:4 http://security.ubuntu.com/ubuntu xenial-security InRelease\r\nIgn:5 http://download.opensuse.org/repositories/home:/clearcontainers:/clear-containers-3/xUbuntu_16.04  InRelease\r\nHit:6 http://download.opensuse.org/repositories/home:/clearcontainers:/clear-containers-3/xUbuntu_16.04  Release\r\nHit:7 https://packages.microsoft.com/ubuntu/16.04/prod xenial InRelease\r\nHit:9 https://aptdocker.azureedge.net/repo ubuntu-xenial InRelease\r\nGet:10 https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64  InRelease [1,136 B]\r\nGet:11 https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64  InRelease [1,129 B]\r\nErr:8 https://nvidia.github.io/libnvidia-container/ubuntu16.04/amd64  InRelease\r\n  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nErr:10 https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64  InRelease\r\n  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nErr:11 https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64  InRelease\r\n  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nFetched 2,265 B in 1s (1,197 B/s)\r\nReading package lists...\r\nW: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://nvidia.github.io/libnvidia-container/ubuntu16.04/amd64  InRelease: The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64  InRelease: The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64  InRelease: The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Failed to fetch https://nvidia.github.io/libnvidia-container/ubuntu16.04/amd64/InRelease  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Failed to fetch https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64/InRelease  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Failed to fetch https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64/InRelease  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Some index files failed to download. They have been ignored, or old ones used instead.\r\n+ '[' 3 -eq 10 ']'\r\n+ sleep 30\r\n+ for i in '$(seq 1 $retries)'\r\n+ timeout 30 dpkg --configure -a\r\n+ timeout 30 apt-get -f -y install\r\nReading package lists...\r\nBuilding dependency tree...\r\nReading state information...\r\n0 upgraded, 0 newly installed, 0 to remove and 6 not upgraded.\r\n+ grep -E '^([WE]:.*)|([eE]rr.*)$'\r\n+ tee /tmp/apt-get-update.out\r\n+ timeout 120 apt-get update\r\nErr:8 https://nvidia.github.io/libnvidia-container/ubuntu16.04/amd64  InRelease\r\nErr:10 https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64  InRelease\r\nErr:11 https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64  InRelease\r\nW: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://nvidia.github.io/libnvidia-container/ubuntu16.04/amd64  InRelease: The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64  InRelease: The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64  InRelease: The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Failed to fetch https://nvidia.github.io/libnvidia-container/ubuntu16.04/amd64/InRelease  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Failed to fetch https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64/InRelease  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Failed to fetch https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64/InRelease  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Some index files failed to download. They have been ignored, or old ones used instead.\r\n+ '[' 0 -ne 0 ']'\r\n+ cat /tmp/apt-get-update.out\r\nHit:1 http://azure.archive.ubuntu.com/ubuntu xenial InRelease\r\nHit:2 http://azure.archive.ubuntu.com/ubuntu xenial-updates InRelease\r\nHit:3 http://azure.archive.ubuntu.com/ubuntu xenial-backports InRelease\r\nHit:4 http://security.ubuntu.com/ubuntu xenial-security InRelease\r\nIgn:5 http://download.opensuse.org/repositories/home:/clearcontainers:/clear-containers-3/xUbuntu_16.04  InRelease\r\nHit:6 http://download.opensuse.org/repositories/home:/clearcontainers:/clear-containers-3/xUbuntu_16.04  Release\r\nHit:7 https://packages.microsoft.com/ubuntu/16.04/prod xenial InRelease\r\nHit:9 https://aptdocker.azureedge.net/repo ubuntu-xenial InRelease\r\nGet:10 https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64  InRelease [1,136 B]\r\nGet:11 https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64  InRelease [1,129 B]\r\nErr:8 https://nvidia.github.io/libnvidia-container/ubuntu16.04/amd64  InRelease\r\n  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nErr:10 https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64  InRelease\r\n  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nErr:11 https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64  InRelease\r\n  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nFetched 2,265 B in 0s (3,202 B/s)\r\nReading package lists...\r\nW: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://nvidia.github.io/libnvidia-container/ubuntu16.04/amd64  InRelease: The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64  InRelease: The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64  InRelease: The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Failed to fetch https://nvidia.github.io/libnvidia-container/ubuntu16.04/amd64/InRelease  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Failed to fetch https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64/InRelease  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Failed to fetch https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64/InRelease  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Some index files failed to download. They have been ignored, or old ones used instead.\r\n+ '[' 4 -eq 10 ']'\r\n+ sleep 30\r\n+ for i in '$(seq 1 $retries)'\r\n+ timeout 30 dpkg --configure -a\r\n+ timeout 30 apt-get -f -y install\r\nReading package lists...\r\nBuilding dependency tree...\r\nReading state information...\r\n0 upgraded, 0 newly installed, 0 to remove and 6 not upgraded.\r\n+ grep -E '^([WE]:.*)|([eE]rr.*)$'\r\n+ tee /tmp/apt-get-update.out\r\n+ timeout 120 apt-get update\r\nErr:9 https://nvidia.github.io/libnvidia-container/ubuntu16.04/amd64  InRelease\r\nErr:10 https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64  InRelease\r\nErr:11 https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64  InRelease\r\nW: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://nvidia.github.io/libnvidia-container/ubuntu16.04/amd64  InRelease: The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64  InRelease: The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64  InRelease: The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Failed to fetch https://nvidia.github.io/libnvidia-container/ubuntu16.04/amd64/InRelease  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Failed to fetch https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64/InRelease  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Failed to fetch https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64/InRelease  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Some index files failed to download. They have been ignored, or old ones used instead.\r\n+ '[' 0 -ne 0 ']'\r\n+ cat /tmp/apt-get-update.out\r\nHit:1 http://azure.archive.ubuntu.com/ubuntu xenial InRelease\r\nHit:2 http://azure.archive.ubuntu.com/ubuntu xenial-updates InRelease\r\nHit:3 http://azure.archive.ubuntu.com/ubuntu xenial-backports InRelease\r\nHit:4 http://security.ubuntu.com/ubuntu xenial-security InRelease\r\nIgn:5 http://download.opensuse.org/repositories/home:/clearcontainers:/clear-containers-3/xUbuntu_16.04  InRelease\r\nHit:6 http://download.opensuse.org/repositories/home:/clearcontainers:/clear-containers-3/xUbuntu_16.04  Release\r\nHit:7 https://packages.microsoft.com/ubuntu/16.04/prod xenial InRelease\r\nHit:8 https://aptdocker.azureedge.net/repo ubuntu-xenial InRelease\r\nGet:10 https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64  InRelease [1,136 B]\r\nGet:11 https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64  InRelease [1,129 B]\r\nErr:9 https://nvidia.github.io/libnvidia-container/ubuntu16.04/amd64  InRelease\r\n  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nErr:10 https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64  InRelease\r\n  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nErr:11 https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64  InRelease\r\n  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nFetched 2,265 B in 0s (2,417 B/s)\r\nReading package lists...\r\nW: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://nvidia.github.io/libnvidia-container/ubuntu16.04/amd64  InRelease: The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64  InRelease: The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64  InRelease: The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Failed to fetch https://nvidia.github.io/libnvidia-container/ubuntu16.04/amd64/InRelease  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Failed to fetch https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64/InRelease  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Failed to fetch https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64/InRelease  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Some index files failed to download. They have been ignored, or old ones used instead.\r\n+ '[' 5 -eq 10 ']'\r\n+ sleep 30\r\n+ for i in '$(seq 1 $retries)'\r\n+ timeout 30 dpkg --configure -a\r\n+ timeout 30 apt-get -f -y install\r\nReading package lists...\r\nBuilding dependency tree...\r\nReading state information...\r\n0 upgraded, 0 newly installed, 0 to remove and 6 not upgraded.\r\n+ grep -E '^([WE]:.*)|([eE]rr.*)$'\r\n+ tee /tmp/apt-get-update.out\r\n+ timeout 120 apt-get update\r\nErr:9 https://nvidia.github.io/libnvidia-container/ubuntu16.04/amd64  InRelease\r\nErr:10 https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64  InRelease\r\nErr:11 https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64  InRelease\r\nW: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://nvidia.github.io/libnvidia-container/ubuntu16.04/amd64  InRelease: The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64  InRelease: The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64  InRelease: The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Failed to fetch https://nvidia.github.io/libnvidia-container/ubuntu16.04/amd64/InRelease  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Failed to fetch https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64/InRelease  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Failed to fetch https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64/InRelease  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Some index files failed to download. They have been ignored, or old ones used instead.\r\n+ '[' 0 -ne 0 ']'\r\n+ cat /tmp/apt-get-update.out\r\nHit:1 http://azure.archive.ubuntu.com/ubuntu xenial InRelease\r\nHit:2 http://security.ubuntu.com/ubuntu xenial-security InRelease\r\nHit:3 http://azure.archive.ubuntu.com/ubuntu xenial-updates InRelease\r\nHit:4 http://azure.archive.ubuntu.com/ubuntu xenial-backports InRelease\r\nIgn:5 http://download.opensuse.org/repositories/home:/clearcontainers:/clear-containers-3/xUbuntu_16.04  InRelease\r\nHit:6 http://download.opensuse.org/repositories/home:/clearcontainers:/clear-containers-3/xUbuntu_16.04  Release\r\nHit:7 https://packages.microsoft.com/ubuntu/16.04/prod xenial InRelease\r\nHit:8 https://aptdocker.azureedge.net/repo ubuntu-xenial InRelease\r\nGet:10 https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64  InRelease [1,136 B]\r\nGet:11 https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64  InRelease [1,129 B]\r\nErr:9 https://nvidia.github.io/libnvidia-container/ubuntu16.04/amd64  InRelease\r\n  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nErr:10 https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64  InRelease\r\n  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nErr:11 https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64  InRelease\r\n  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nFetched 2,265 B in 1s (2,207 B/s)\r\nReading package lists...\r\nW: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://nvidia.github.io/libnvidia-container/ubuntu16.04/amd64  InRelease: The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64  InRelease: The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64  InRelease: The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Failed to fetch https://nvidia.github.io/libnvidia-container/ubuntu16.04/amd64/InRelease  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Failed to fetch https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64/InRelease  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Failed to fetch https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64/InRelease  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Some index files failed to download. They have been ignored, or old ones used instead.\r\n+ '[' 6 -eq 10 ']'\r\n+ sleep 30\r\n+ for i in '$(seq 1 $retries)'\r\n+ timeout 30 dpkg --configure -a\r\n+ timeout 30 apt-get -f -y install\r\nReading package lists...\r\nBuilding dependency tree...\r\nReading state information...\r\n0 upgraded, 0 newly installed, 0 to remove and 6 not upgraded.\r\n+ grep -E '^([WE]:.*)|([eE]rr.*)$'\r\n+ tee /tmp/apt-get-update.out\r\n+ timeout 120 apt-get update\r\nErr:8 https://nvidia.github.io/libnvidia-container/ubuntu16.04/amd64  InRelease\r\nErr:10 https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64  InRelease\r\nErr:11 https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64  InRelease\r\nW: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://nvidia.github.io/libnvidia-container/ubuntu16.04/amd64  InRelease: The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64  InRelease: The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64  InRelease: The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Failed to fetch https://nvidia.github.io/libnvidia-container/ubuntu16.04/amd64/InRelease  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Failed to fetch https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64/InRelease  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Failed to fetch https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64/InRelease  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Some index files failed to download. They have been ignored, or old ones used instead.\r\n+ '[' 0 -ne 0 ']'\r\n+ cat /tmp/apt-get-update.out\r\nHit:1 http://azure.archive.ubuntu.com/ubuntu xenial InRelease\r\nHit:2 http://azure.archive.ubuntu.com/ubuntu xenial-updates InRelease\r\nHit:3 http://azure.archive.ubuntu.com/ubuntu xenial-backports InRelease\r\nIgn:4 http://download.opensuse.org/repositories/home:/clearcontainers:/clear-containers-3/xUbuntu_16.04  InRelease\r\nHit:5 http://download.opensuse.org/repositories/home:/clearcontainers:/clear-containers-3/xUbuntu_16.04  Release\r\nHit:6 http://security.ubuntu.com/ubuntu xenial-security InRelease\r\nHit:7 https://packages.microsoft.com/ubuntu/16.04/prod xenial InRelease\r\nHit:9 https://aptdocker.azureedge.net/repo ubuntu-xenial InRelease\r\nGet:10 https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64  InRelease [1,136 B]\r\nGet:11 https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64  InRelease [1,129 B]\r\nErr:8 https://nvidia.github.io/libnvidia-container/ubuntu16.04/amd64  InRelease\r\n  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nErr:10 https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64  InRelease\r\n  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nErr:11 https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64  InRelease\r\n  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nFetched 2,265 B in 1s (2,200 B/s)\r\nReading package lists...\r\nW: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://nvidia.github.io/libnvidia-container/ubuntu16.04/amd64  InRelease: The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64  InRelease: The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64  InRelease: The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Failed to fetch https://nvidia.github.io/libnvidia-container/ubuntu16.04/amd64/InRelease  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Failed to fetch https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64/InRelease  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Failed to fetch https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64/InRelease  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Some index files failed to download. They have been ignored, or old ones used instead.\r\n+ '[' 7 -eq 10 ']'\r\n+ sleep 30\r\n+ for i in '$(seq 1 $retries)'\r\n+ timeout 30 dpkg --configure -a\r\n+ timeout 30 apt-get -f -y install\r\nReading package lists...\r\nBuilding dependency tree...\r\nReading state information...\r\n0 upgraded, 0 newly installed, 0 to remove and 6 not upgraded.\r\n+ grep -E '^([WE]:.*)|([eE]rr.*)$'\r\n+ tee /tmp/apt-get-update.out\r\n+ timeout 120 apt-get update\r\nErr:8 https://nvidia.github.io/libnvidia-container/ubuntu16.04/amd64  InRelease\r\nErr:10 https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64  InRelease\r\nErr:11 https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64  InRelease\r\nW: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://nvidia.github.io/libnvidia-container/ubuntu16.04/amd64  InRelease: The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64  InRelease: The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64  InRelease: The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Failed to fetch https://nvidia.github.io/libnvidia-container/ubuntu16.04/amd64/InRelease  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Failed to fetch https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64/InRelease  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Failed to fetch https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64/InRelease  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Some index files failed to download. They have been ignored, or old ones used instead.\r\n+ '[' 0 -ne 0 ']'\r\n+ cat /tmp/apt-get-update.out\r\nHit:1 http://azure.archive.ubuntu.com/ubuntu xenial InRelease\r\nHit:2 http://azure.archive.ubuntu.com/ubuntu xenial-updates InRelease\r\nHit:3 http://azure.archive.ubuntu.com/ubuntu xenial-backports InRelease\r\nIgn:4 http://download.opensuse.org/repositories/home:/clearcontainers:/clear-containers-3/xUbuntu_16.04  InRelease\r\nHit:5 http://download.opensuse.org/repositories/home:/clearcontainers:/clear-containers-3/xUbuntu_16.04  Release\r\nHit:6 http://security.ubuntu.com/ubuntu xenial-security InRelease\r\nHit:7 https://packages.microsoft.com/ubuntu/16.04/prod xenial InRelease\r\nHit:9 https://aptdocker.azureedge.net/repo ubuntu-xenial InRelease\r\nGet:10 https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64  InRelease [1,136 B]\r\nGet:11 https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64  InRelease [1,129 B]\r\nErr:8 https://nvidia.github.io/libnvidia-container/ubuntu16.04/amd64  InRelease\r\n  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nErr:10 https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64  InRelease\r\n  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nErr:11 https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64  InRelease\r\n  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nFetched 2,265 B in 1s (2,107 B/s)\r\nReading package lists...\r\nW: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://nvidia.github.io/libnvidia-container/ubuntu16.04/amd64  InRelease: The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64  InRelease: The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64  InRelease: The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Failed to fetch https://nvidia.github.io/libnvidia-container/ubuntu16.04/amd64/InRelease  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Failed to fetch https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64/InRelease  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Failed to fetch https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64/InRelease  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Some index files failed to download. They have been ignored, or old ones used instead.\r\n+ '[' 8 -eq 10 ']'\r\n+ sleep 30\r\n+ for i in '$(seq 1 $retries)'\r\n+ timeout 30 dpkg --configure -a\r\n+ timeout 30 apt-get -f -y install\r\nReading package lists...\r\nBuilding dependency tree...\r\nReading state information...\r\n0 upgraded, 0 newly installed, 0 to remove and 6 not upgraded.\r\n+ grep -E '^([WE]:.*)|([eE]rr.*)$'\r\n+ tee /tmp/apt-get-update.out\r\n+ timeout 120 apt-get update\r\nErr:9 https://nvidia.github.io/libnvidia-container/ubuntu16.04/amd64  InRelease\r\nErr:10 https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64  InRelease\r\nErr:11 https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64  InRelease\r\nW: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://nvidia.github.io/libnvidia-container/ubuntu16.04/amd64  InRelease: The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64  InRelease: The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64  InRelease: The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Failed to fetch https://nvidia.github.io/libnvidia-container/ubuntu16.04/amd64/InRelease  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Failed to fetch https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64/InRelease  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Failed to fetch https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64/InRelease  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Some index files failed to download. They have been ignored, or old ones used instead.\r\n+ '[' 0 -ne 0 ']'\r\n+ cat /tmp/apt-get-update.out\r\nHit:1 http://azure.archive.ubuntu.com/ubuntu xenial InRelease\r\nHit:2 http://azure.archive.ubuntu.com/ubuntu xenial-updates InRelease\r\nHit:3 http://azure.archive.ubuntu.com/ubuntu xenial-backports InRelease\r\nGet:4 http://security.ubuntu.com/ubuntu xenial-security InRelease [107 kB]\r\nIgn:5 http://download.opensuse.org/repositories/home:/clearcontainers:/clear-containers-3/xUbuntu_16.04  InRelease\r\nHit:6 http://download.opensuse.org/repositories/home:/clearcontainers:/clear-containers-3/xUbuntu_16.04  Release\r\nHit:7 https://aptdocker.azureedge.net/repo ubuntu-xenial InRelease\r\nHit:8 https://packages.microsoft.com/ubuntu/16.04/prod xenial InRelease\r\nGet:10 https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64  InRelease [1,136 B]\r\nGet:11 https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64  InRelease [1,129 B]\r\nErr:9 https://nvidia.github.io/libnvidia-container/ubuntu16.04/amd64  InRelease\r\n  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nErr:10 https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64  InRelease\r\n  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nErr:11 https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64  InRelease\r\n  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nFetched 109 kB in 1s (95.4 kB/s)\r\nReading package lists...\r\nW: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://nvidia.github.io/libnvidia-container/ubuntu16.04/amd64  InRelease: The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64  InRelease: The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64  InRelease: The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Failed to fetch https://nvidia.github.io/libnvidia-container/ubuntu16.04/amd64/InRelease  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Failed to fetch https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64/InRelease  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Failed to fetch https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64/InRelease  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Some index files failed to download. They have been ignored, or old ones used instead.\r\n+ '[' 9 -eq 10 ']'\r\n+ sleep 30\r\n+ for i in '$(seq 1 $retries)'\r\n+ timeout 30 dpkg --configure -a\r\n+ timeout 30 apt-get -f -y install\r\nReading package lists...\r\nBuilding dependency tree...\r\nReading state information...\r\n0 upgraded, 0 newly installed, 0 to remove and 6 not upgraded.\r\n+ grep -E '^([WE]:.*)|([eE]rr.*)$'\r\n+ tee /tmp/apt-get-update.out\r\n+ timeout 120 apt-get update\r\nErr:8 https://nvidia.github.io/libnvidia-container/ubuntu16.04/amd64  InRelease\r\nErr:9 https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64  InRelease\r\nErr:10 https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64  InRelease\r\nW: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://nvidia.github.io/libnvidia-container/ubuntu16.04/amd64  InRelease: The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64  InRelease: The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64  InRelease: The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Failed to fetch https://nvidia.github.io/libnvidia-container/ubuntu16.04/amd64/InRelease  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Failed to fetch https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64/InRelease  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Failed to fetch https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64/InRelease  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Some index files failed to download. They have been ignored, or old ones used instead.\r\n+ '[' 0 -ne 0 ']'\r\n+ cat /tmp/apt-get-update.out\r\nHit:1 http://azure.archive.ubuntu.com/ubuntu xenial InRelease\r\nHit:2 http://azure.archive.ubuntu.com/ubuntu xenial-updates InRelease\r\nHit:3 http://azure.archive.ubuntu.com/ubuntu xenial-backports InRelease\r\nGet:4 http://security.ubuntu.com/ubuntu xenial-security InRelease [107 kB]\r\nIgn:5 http://download.opensuse.org/repositories/home:/clearcontainers:/clear-containers-3/xUbuntu_16.04  InRelease\r\nHit:6 https://aptdocker.azureedge.net/repo ubuntu-xenial InRelease\r\nHit:7 https://packages.microsoft.com/ubuntu/16.04/prod xenial InRelease\r\nGet:9 https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64  InRelease [1,136 B]\r\nGet:10 https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64  InRelease [1,129 B]\r\nHit:11 http://download.opensuse.org/repositories/home:/clearcontainers:/clear-containers-3/xUbuntu_16.04  Release\r\nErr:8 https://nvidia.github.io/libnvidia-container/ubuntu16.04/amd64  InRelease\r\n  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nErr:9 https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64  InRelease\r\n  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nErr:10 https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64  InRelease\r\n  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nFetched 109 kB in 2s (52.8 kB/s)\r\nReading package lists...\r\nW: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://nvidia.github.io/libnvidia-container/ubuntu16.04/amd64  InRelease: The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64  InRelease: The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64  InRelease: The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Failed to fetch https://nvidia.github.io/libnvidia-container/ubuntu16.04/amd64/InRelease  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Failed to fetch https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64/InRelease  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Failed to fetch https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64/InRelease  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Some index files failed to download. They have been ignored, or old ones used instead.\r\n+ '[' 10 -eq 10 ']'\r\n+ return 1\r\n+ exit 99\r\n```\r\n\r\n**What you expected to happen**:\r\n\r\nA new cluster should be built\r\n\r\n**How to reproduce it** (as minimally and precisely as possible):\r\n```\r\nacs-engine-0.22.2 deploy --subscription-id ... --location northeurope --resource-group ... --api-model ./kubernetes.json --output-directory ./arm-templates_1.11.2 --debug\r\n```\r\n**Anything else we need to know**:\r\n\r\nI logged in to the master and executed \r\n\r\n```\r\nsudo apt-get update\r\n```\r\nwith the following result\r\n\r\n```\r\nHit:1 http://azure.archive.ubuntu.com/ubuntu xenial InRelease\r\nHit:2 http://azure.archive.ubuntu.com/ubuntu xenial-updates InRelease\r\nHit:3 http://azure.archive.ubuntu.com/ubuntu xenial-backports InRelease\r\nGet:4 http://security.ubuntu.com/ubuntu xenial-security InRelease [107 kB]\r\nHit:5 https://packages.microsoft.com/ubuntu/16.04/prod xenial InRelease\r\nHit:7 https://aptdocker.azureedge.net/repo ubuntu-xenial InRelease                  \r\nGet:8 https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64  InRelease [1136 B]\r\nGet:9 https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64  InRelease [1129 B]  \r\nIgn:10 http://download.opensuse.org/repositories/home:/clearcontainers:/clear-containers-3/xUbuntu_16.04  InRelease\r\nHit:11 http://download.opensuse.org/repositories/home:/clearcontainers:/clear-containers-3/xUbuntu_16.04  Release\r\nErr:6 https://nvidia.github.io/libnvidia-container/ubuntu16.04/amd64  InRelease\r\n  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nErr:8 https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64  InRelease\r\n  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nErr:9 https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64  InRelease\r\n  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nFetched 109 kB in 0s (136 kB/s)\r\nReading package lists... Done\r\nW: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://nvidia.github.io/libnvidia-container/ubuntu16.04/amd64  InRelease: The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64  InRelease: The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64  InRelease: The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Failed to fetch https://nvidia.github.io/libnvidia-container/ubuntu16.04/amd64/InRelease  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Failed to fetch https://nvidia.github.io/nvidia-container-runtime/ubuntu16.04/amd64/InRelease  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Failed to fetch https://nvidia.github.io/nvidia-docker/ubuntu16.04/amd64/InRelease  The following signatures were invalid: KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745  KEYEXPIRED 1538166745\r\nW: Some index files failed to download. They have been ignored, or old ones used instead.\r\n```\r\nAs can be seen from the above, something is wrong with the nvidia repository keys.\r\nPlease advice as I'm stuck at the moment."},"comment":{"url":"https://api.github.com/repos/Azure/acs-engine/issues/comments/426384810","html_url":"https://github.com/Azure/acs-engine/issues/3933#issuecomment-426384810","issue_url":"https://api.github.com/repos/Azure/acs-engine/issues/3933","id":426384810,"node_id":"MDEyOklzc3VlQ29tbWVudDQyNjM4NDgxMA==","user":{"login":"nikolajbrinch","id":6940117,"node_id":"MDQ6VXNlcjY5NDAxMTc=","avatar_url":"https://avatars3.githubusercontent.com/u/6940117?v=4","gravatar_id":"","url":"https://api.github.com/users/nikolajbrinch","html_url":"https://github.com/nikolajbrinch","followers_url":"https://api.github.com/users/nikolajbrinch/followers","following_url":"https://api.github.com/users/nikolajbrinch/following{/other_user}","gists_url":"https://api.github.com/users/nikolajbrinch/gists{/gist_id}","starred_url":"https://api.github.com/users/nikolajbrinch/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/nikolajbrinch/subscriptions","organizations_url":"https://api.github.com/users/nikolajbrinch/orgs","repos_url":"https://api.github.com/users/nikolajbrinch/repos","events_url":"https://api.github.com/users/nikolajbrinch/events{/privacy}","received_events_url":"https://api.github.com/users/nikolajbrinch/received_events","type":"User","site_admin":false},"created_at":"2018-10-02T18:37:53Z","updated_at":"2018-10-02T18:37:53Z","author_association":"NONE","body":"@CecileRobertMichon I mean using acs-engine 0.22.3\r\n```\r\n$ bin/acs-engine-0.22.2 version\r\nVersion: v0.22.2\r\nGitCommit: 03f15953f\r\nGitTreeState: clean\r\n```\r\n\r\nand generating templates, the following is in my azuredeploy.json\r\n\r\n```\r\n    \"osImageVersion\": {\r\n      \"defaultValue\": \"16.04.201804050\",\r\n      \"metadata\": {\r\n        \"description\": \"OS image version.\"\r\n      },\r\n      \"type\": \"string\"\r\n    },\r\n```\r\n\r\nand I was of the impression that azuredeploy.json states the defaulValues for the current acs-engine version. That would be nice though, so I wouldn't have to go to the code...\r\nEven better if this was documented somewhere."}}
{"actor":{"display_login":"nikolajbrinch"}}