{"action":"created","issue":{"url":"https://api.github.com/repos/Azure/acs-engine/issues/3697","repository_url":"https://api.github.com/repos/Azure/acs-engine","labels_url":"https://api.github.com/repos/Azure/acs-engine/issues/3697/labels{/name}","comments_url":"https://api.github.com/repos/Azure/acs-engine/issues/3697/comments","events_url":"https://api.github.com/repos/Azure/acs-engine/issues/3697/events","html_url":"https://github.com/Azure/acs-engine/issues/3697","id":351494923,"node_id":"MDU6SXNzdWUzNTE0OTQ5MjM=","number":3697,"title":"acs-engine scale failed - Message=\"Deployment template validation failed: 'The resource 'Microsoft.Compute/virtualMachines/k8s-vm1-62727722-0' is not defined in the template","user":{"login":"kosta709","id":17096555,"node_id":"MDQ6VXNlcjE3MDk2NTU1","avatar_url":"https://avatars0.githubusercontent.com/u/17096555?v=4","gravatar_id":"","url":"https://api.github.com/users/kosta709","html_url":"https://github.com/kosta709","followers_url":"https://api.github.com/users/kosta709/followers","following_url":"https://api.github.com/users/kosta709/following{/other_user}","gists_url":"https://api.github.com/users/kosta709/gists{/gist_id}","starred_url":"https://api.github.com/users/kosta709/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/kosta709/subscriptions","organizations_url":"https://api.github.com/users/kosta709/orgs","repos_url":"https://api.github.com/users/kosta709/repos","events_url":"https://api.github.com/users/kosta709/events{/privacy}","received_events_url":"https://api.github.com/users/kosta709/received_events","type":"User","site_admin":false},"labels":[{"id":897320581,"node_id":"MDU6TGFiZWw4OTczMjA1ODE=","url":"https://api.github.com/repos/Azure/acs-engine/labels/feature/scale","name":"feature/scale","color":"7dc7d1","default":false}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":8,"created_at":"2018-08-17T07:57:56Z","updated_at":"2018-08-30T16:12:59Z","closed_at":null,"author_association":"NONE","body":"<!-- Thanks for filing an issue! Before hitting the button, please answer these questions. It's helpful to search the existing GitHub issues first. It's likely that another user has already reported the issue you're facing, or it's a known issue that we're already aware of-->\r\n\r\n**Is this a request for help?**:\r\nYES\r\n---\r\n\r\n**Is this an ISSUE or FEATURE REQUEST?** (choose one):\r\nISSUE\r\n---\r\n\r\n**What version of acs-engine?**:\r\nv0.20.9\r\ntried on v0.19.5, v0.20.5\r\n---\r\n\r\n\r\n<!--\r\nIf this is a ISSUE, please:\r\n  - Fill in as much of the template below as you can.  If you leave out\r\n    information, we can't help you as well.\r\n\r\nIf this is a FEATURE REQUEST, please:\r\n  - Describe *in detail* the feature/behavior/change you'd like to see.\r\n\r\nIn both cases, be ready for followup questions, and please respond in a timely\r\nmanner.  If we can't reproduce a bug or think a feature already exists, we\r\nmight close your issue.  If we're wrong, PLEASE feel free to reopen it and\r\nexplain why.\r\n-->\r\n\r\n**Orchestrator and version (e.g. Kubernetes, DC/OS, Swarm)**\r\nKubernetes 1.10.5\r\n\r\n**What happened**:\r\nExecuting acs-engine scale on AvailabilitySet pool returns error resources.DeploymentsClient#CreateOrUpdate: Failure sending request: StatusCode=0 -- Original Error: autorest/azure: Service returned an error. Status=400 Code=\"InvalidTemplate\" Message=\"Deployment template validation failed: 'The resource 'Microsoft.Compute/virtualMachines/k8s-dind1-62727722-0' is not defined in the template. Please see https://aka.ms/arm-template for usage details.'.\"\r\n\r\n\r\n`acs-engine scale --debug --subscription-id ******* --resource-group az-test-1-dind-k8s-sa --location centralus --deployment-dir _clusters/az-test-1/dind-k8s-sa --node-pool dind1 --new-node-count 2`\r\n\r\n**What you expected to happen**:\r\nscale node-pool\r\n\r\n**How to reproduce it** (as minimally and precisely as possible):\r\ncreate simple acs-engine k8s cluster (1 master 1 node) with availabilitySet and customVnetSubnetId using\r\n`acs-engine generate <acs-engine-template.json>`\r\n`az group deployment create ...`\r\ncluster started normally\r\n\r\nthen after some time  \r\nacs-engine scale --debug --subscription-id ******* --resource-group az-test-1-dind-k8s-sa --location centralus --deployment-dir _clusters/az-test-1/dind-k8s-sa --node-pool dind1 --new-node-count 2\r\n\r\nget InvalidTemplate\r\n**Anything else we need to know**:\r\ncluster definition json\r\n```\r\n{\r\n    \"apiVersion\": \"vlabs\",\r\n    \"properties\": {\r\n      \"orchestratorProfile\": {\r\n        \"orchestratorType\": \"Kubernetes\",\r\n        \"orchestratorRelease\": \"1.10\",\r\n        \"kubernetesConfig\": {\r\n          \"useManagedIdentity\": true,\r\n          \"clusterSubnet\": \"10.246.0.0/16\",\r\n          \"networkPolicy\": \"calico\",\r\n          \"apiServerConfig\": {\r\n            \"--enable-admission-plugins\":  \"NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,ExtendedResourceToleration\"\r\n          },\r\n          \"kubeletConfig\": {\r\n            \"--enable-controller-attach-detach\": \"true\"\r\n          }                    \r\n        }\r\n      },\r\n      \"masterProfile\": {\r\n        \"count\": 1,\r\n        \"dnsPrefix\": \"az-test-1-k8s-sa\",\r\n        \"storageProfile\": \"StorageAccount\",\r\n        \"vmSize\": \"Standard_DS1_v2\",\r\n        \"firstConsecutiveStaticIP\": \"10.230.254.5\",\r\n        \"vnetCidr\": \"10.0.0.0/8\",\r\n        \r\n        \"vnetSubnetId\": \"/subscriptions/*******/resourceGroups/az-test-1-vnet/providers/Microsoft.Network/virtualNetworks/vnet1/subnets/subnet2\"\r\n      },\r\n      \"agentPoolProfiles\": [       \r\n        {\r\n          \"name\": \"dind1\",\r\n          \"count\": 1,\r\n          \"vmSize\": \"Standard_DS3_v2\",\r\n          \"storageProfile\": \"StorageAccount\",\r\n          \"availabilityProfile\": \"AvailabilitySet\",\r\n          \"acceleratedNetworkingEnabled\": false,\r\n          \"customNodeLabels\": {\r\n            \"node-type\": \"dind\"\r\n          },\r\n               \r\n          \"vnetSubnetId\": \"/subscriptions/*********/resourceGroups/az-test-1-vnet/providers/Microsoft.Network/virtualNetworks/vnet1/subnets/subnet2\"                   \r\n        }             \r\n      ],\r\n      \"linuxProfile\": {\r\n        \"adminUsername\": \"ubuntu\",\r\n        \"ssh\": {\r\n            \"publicKeys\": [\r\n                {\r\n                  \"keyData\": \"ssh-rsa *******\"\r\n                }\r\n            ]\r\n        }\r\n      }\r\n    }\r\n  }\r\n```\r\n\r\nFull Output:\r\n```\r\nacs-engine scale --debug --subscription-id ************************* --resource-group az-test-1-dind-k8s-sa --location centralus --deployment-dir /d1/home/kosta/devel/dind-cluster-infra-azure/_clusters/az-test-1/dind-k8s-sa --node-pool dind1 --new-node-count 2\r\n\r\nINFO[0000] validating...\r\nDEBU[0000] Resolving tenantID for subscriptionID: *******************\r\nDEBU[0000] Attempting to load token from cache. path=\"****************************\"\r\nDEBU[0001] Saved token to cache. path=\"***************************\"\r\nDEBU[0003] Already registered for \"Microsoft.Compute\"\r\nDEBU[0003] Already registered for \"Microsoft.Storage\"\r\nDEBU[0003] Already registered for \"Microsoft.Network\"\r\nINFO[0005] Name suffix: 62727722\r\nINFO[0005] Starting ARM Deployment (az-test-1-dind-k8s-sa-1345681146). This will take some time...\r\nError: resources.DeploymentsClient#CreateOrUpdate: Failure sending request: StatusCode=0 -- Original Error: autorest/azure: Service returned an error. Status=400 Code=\"InvalidTemplate\" Message=\"Deployment template validation failed: 'The resource 'Microsoft.Compute/virtualMachines/k8s-dind1-62727722-0' is not defined in the template. Please see https://aka.ms/arm-template for usage details.'.\"\r\nUsage:\r\n  acs-engine scale [flags]\r\n\r\nFlags:\r\n      --auth-method device        auth method (default:device, `client_secret`, `client_certificate`) (default \"device\")\r\n      --azure-env string          the target Azure cloud (default \"AzurePublicCloud\")\r\n      --certificate-path string   path to client certificate (used with --auth-method=client_certificate)\r\n      --classic-mode              enable classic parameters and outputs\r\n      --client-id string          client id (used with --auth-method=[client_secret|client_certificate])\r\n      --client-secret string      client secret (used with --auth-mode=client_secret)\r\n      --deployment-dir generate   the location of the output from generate\r\n  -h, --help                      help for scale\r\n      --language string           language to return error messages in (default \"en-us\")\r\n  -l, --location string           location the cluster is deployed in\r\n      --master-FQDN string        FQDN for the master load balancer, Needed to scale down Kubernetes agent pools\r\n      --new-node-count int        desired number of nodes\r\n      --node-pool string          node pool to scale\r\n      --private-key-path string   path to private key (used with --auth-method=client_certificate)\r\n  -g, --resource-group string     the resource group where the cluster is deployed\r\n      --subscription-id string    azure subscription id (required)\r\n\r\nGlobal Flags:\r\n      --debug   enable verbose debug logs\r\n\r\nFATA[0008] resources.DeploymentsClient#CreateOrUpdate: Failure sending request: StatusCode=0 -- Original Error: autorest/azure: Service returned an error. Status=400 Code=\"InvalidTemplate\" Message=\"Deployment template validation failed: 'The resource 'Microsoft.Compute/virtualMachines/k8s-dind1-62727722-0' is not defined in the template. Please see https://aka.ms/arm-template for usage details.'.\"\r\n```"},"comment":{"url":"https://api.github.com/repos/Azure/acs-engine/issues/comments/417376513","html_url":"https://github.com/Azure/acs-engine/issues/3697#issuecomment-417376513","issue_url":"https://api.github.com/repos/Azure/acs-engine/issues/3697","id":417376513,"node_id":"MDEyOklzc3VlQ29tbWVudDQxNzM3NjUxMw==","user":{"login":"kosta709","id":17096555,"node_id":"MDQ6VXNlcjE3MDk2NTU1","avatar_url":"https://avatars0.githubusercontent.com/u/17096555?v=4","gravatar_id":"","url":"https://api.github.com/users/kosta709","html_url":"https://github.com/kosta709","followers_url":"https://api.github.com/users/kosta709/followers","following_url":"https://api.github.com/users/kosta709/following{/other_user}","gists_url":"https://api.github.com/users/kosta709/gists{/gist_id}","starred_url":"https://api.github.com/users/kosta709/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/kosta709/subscriptions","organizations_url":"https://api.github.com/users/kosta709/orgs","repos_url":"https://api.github.com/users/kosta709/repos","events_url":"https://api.github.com/users/kosta709/events{/privacy}","received_events_url":"https://api.github.com/users/kosta709/received_events","type":"User","site_admin":false},"created_at":"2018-08-30T16:12:59Z","updated_at":"2018-08-30T16:12:59Z","author_association":"NONE","body":"hi, any progress here?"}}
{"actor":{"display_login":"kosta709"}}