{"action":"created","issue":{"url":"https://api.github.com/repos/rancher/rancher/issues/4596","repository_url":"https://api.github.com/repos/rancher/rancher","labels_url":"https://api.github.com/repos/rancher/rancher/issues/4596/labels{/name}","comments_url":"https://api.github.com/repos/rancher/rancher/issues/4596/comments","events_url":"https://api.github.com/repos/rancher/rancher/issues/4596/events","html_url":"https://github.com/rancher/rancher/issues/4596","id":151755592,"number":4596,"title":"route53 instance stuck in \"Initializing\" state and then keeps getting recreated because of failed health check due to \"Throttling: Rate exceeded\" error ","user":{"login":"sangeethah","id":4266958,"avatar_url":"https://avatars.githubusercontent.com/u/4266958?v=3","gravatar_id":"","url":"https://api.github.com/users/sangeethah","html_url":"https://github.com/sangeethah","followers_url":"https://api.github.com/users/sangeethah/followers","following_url":"https://api.github.com/users/sangeethah/following{/other_user}","gists_url":"https://api.github.com/users/sangeethah/gists{/gist_id}","starred_url":"https://api.github.com/users/sangeethah/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/sangeethah/subscriptions","organizations_url":"https://api.github.com/users/sangeethah/orgs","repos_url":"https://api.github.com/users/sangeethah/repos","events_url":"https://api.github.com/users/sangeethah/events{/privacy}","received_events_url":"https://api.github.com/users/sangeethah/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/rancher/rancher/labels/kind/bug","name":"kind/bug","color":"fc2929"}],"state":"open","locked":false,"assignee":{"login":"janeczku","id":3813921,"avatar_url":"https://avatars.githubusercontent.com/u/3813921?v=3","gravatar_id":"","url":"https://api.github.com/users/janeczku","html_url":"https://github.com/janeczku","followers_url":"https://api.github.com/users/janeczku/followers","following_url":"https://api.github.com/users/janeczku/following{/other_user}","gists_url":"https://api.github.com/users/janeczku/gists{/gist_id}","starred_url":"https://api.github.com/users/janeczku/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/janeczku/subscriptions","organizations_url":"https://api.github.com/users/janeczku/orgs","repos_url":"https://api.github.com/users/janeczku/repos","events_url":"https://api.github.com/users/janeczku/events{/privacy}","received_events_url":"https://api.github.com/users/janeczku/received_events","type":"User","site_admin":false},"milestone":{"url":"https://api.github.com/repos/rancher/rancher/milestones/61","html_url":"https://github.com/rancher/rancher/milestones/Release%201.1.0","labels_url":"https://api.github.com/repos/rancher/rancher/milestones/61/labels","id":1651837,"number":61,"title":"Release 1.1.0","description":"","creator":{"login":"will-chan","id":10134676,"avatar_url":"https://avatars.githubusercontent.com/u/10134676?v=3","gravatar_id":"","url":"https://api.github.com/users/will-chan","html_url":"https://github.com/will-chan","followers_url":"https://api.github.com/users/will-chan/followers","following_url":"https://api.github.com/users/will-chan/following{/other_user}","gists_url":"https://api.github.com/users/will-chan/gists{/gist_id}","starred_url":"https://api.github.com/users/will-chan/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/will-chan/subscriptions","organizations_url":"https://api.github.com/users/will-chan/orgs","repos_url":"https://api.github.com/users/will-chan/repos","events_url":"https://api.github.com/users/will-chan/events{/privacy}","received_events_url":"https://api.github.com/users/will-chan/received_events","type":"User","site_admin":false},"open_issues":177,"closed_issues":20,"state":"open","created_at":"2016-03-17T17:24:50Z","updated_at":"2016-06-01T21:20:59Z","due_on":"2016-06-15T07:00:00Z","closed_at":null},"comments":3,"created_at":"2016-04-28T22:15:04Z","updated_at":"2016-06-01T22:21:03Z","closed_at":null,"body":"Rancher Version: Build from master Apr28\r\n\r\nHave 2 rancher-server instances with Route53 service (version - rancher/external-dns:v0.4.0) pointing to the same \"AWS Hosted Zone\"\r\n\r\nCreate 100 services with exposed ports on each of the rancher-server instances , to simulate parallel request to \"AWS Hosted\"\r\n\r\nThis results in route53 instance stuck in \"Initializing\" state and then keeps getting recreated because of failed health check due to \"Throttling: Rate exceeded\" error \r\n\r\n<img width=\"1332\" alt=\"screen shot 2016-04-28 at 2 31 57 pm\" src=\"https://cloud.githubusercontent.com/assets/4266958/14902235/8fda2be0-0d4e-11e6-8ada-9dc4382cf094.png\">\r\n\r\n\r\nlogs from route53 instance that was deleted:\r\n\r\n```\r\nroot@sangeemas2-10acre-1:/home/sangeethahariharan1# docker logs a2b151e69649\r\ntime=\"2016-04-28T21:14:24Z\" level=info msg=\"CLOUDFLARE_EMAIL is not set, skipping init of CloudFlare provider\" \r\ntime=\"2016-04-28T21:14:24Z\" level=info msg=\"DNSIMPLE_TOKEN is not set, skipping init of DNSimple provider\" \r\ntime=\"2016-04-28T21:14:24Z\" level=info msg=\"GANDI_APIKEY is not set, skipping init of Gandi provider\" \r\ntime=\"2016-04-28T21:14:24Z\" level=info msg=\"POINTHQ_TOKEN is not set, skipping init of PointHQ provider\" \r\ntime=\"2016-04-28T21:14:25Z\" level=info msg=\"Configured Route 53 with hosted zone 'sangee-test1.com.' in region 'us-west-2' \" \r\ntime=\"2016-04-28T21:14:25Z\" level=info msg=\"Starting Rancher External DNS service\" \r\ntime=\"2016-04-28T21:14:25Z\" level=info msg=\"Powered by Route 53\" \r\ntime=\"2016-04-28T21:14:25Z\" level=info msg=\"Healthcheck handler is listening on :1000\" \r\ntime=\"2016-04-28T21:14:25Z\" level=info msg=\"DNS records to remove: [{test-51.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-67.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-29.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-43.test440934.default.sangee-test1.com. [104.197.251.169] A 299}]\" \r\ntime=\"2016-04-28T21:14:25Z\" level=info msg=\"Removing dns record: {test-51.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:14:26Z\" level=info msg=\"Removing dns record: {test-67.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:14:33Z\" level=error msg=\"Failed to remove DNS record from provider {test-67.test440934.default.sangee-test1.com. [104.197.251.169] A 299}: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: 346965cf-0d86-11e6-8bf7-b504e4cf9801\" \r\ntime=\"2016-04-28T21:14:33Z\" level=info msg=\"Removing dns record: {test-29.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:14:33Z\" level=info msg=\"Removing dns record: {test-43.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:14:33Z\" level=info msg=\"DNS records to add: [{test-3.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-35.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-37.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-70.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-84.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-46.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-91.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-90.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-88.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-77.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-51.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-23.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-30.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-45.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-62.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-79.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-80.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-1.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-16.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-55.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-20.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-17.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-49.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-56.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-48.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-74.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-87.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-67.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-2.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-39.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-92.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-71.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-4.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-93.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-69.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-95.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-9.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-25.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-12.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-36.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-57.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-98.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-61.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-22.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-94.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-75.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-83.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-68.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-73.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-8.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-26.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-64.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-96.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-89.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-59.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-53.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-82.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-86.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-28.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-47.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-50.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-85.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-72.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-19.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-97.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-58.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-42.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-41.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-15.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-7.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-11.test52972.default.sangee-test1.com. [104.197.241.231] A 299} {test-60.test52972.default.sangee-test1.com. [104.197.241.231] A 299}]\" \r\ntime=\"2016-04-28T21:14:33Z\" level=info msg=\"Adding dns record: {test-3.test52972.default.sangee-test1.com. [104.197.241.231] A 299}\" \r\ntime=\"2016-04-28T21:14:35Z\" level=info msg=\"Adding dns record: {test-35.test52972.default.sangee-test1.com. [104.197.241.231] A 299}\" \r\ntime=\"2016-04-28T21:14:35Z\" level=info msg=\"Adding dns record: {test-37.test52972.default.sangee-test1.com. [104.197.241.231] A 299}\" \r\ntime=\"2016-04-28T21:14:35Z\" level=info msg=\"Adding dns record: {test-70.test52972.default.sangee-test1.com. [104.197.241.231] A 299}\" \r\ntime=\"2016-04-28T21:14:35Z\" level=info msg=\"Adding dns record: {test-84.test52972.default.sangee-test1.com. [104.197.241.231] A 299}\" \r\ntime=\"2016-04-28T21:14:38Z\" level=info msg=\"Adding dns record: {test-46.test52972.default.sangee-test1.com. [104.197.241.231] A 299}\" \r\ntime=\"2016-04-28T21:14:41Z\" level=info msg=\"Adding dns record: {test-91.test52972.default.sangee-test1.com. [104.197.241.231] A 299}\" \r\ntime=\"2016-04-28T21:14:49Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:14:49Z\" level=error msg=\"Failed to add DNS record to provider {test-91.test52972.default.sangee-test1.com. [104.197.241.231] A 299}: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: 3dafd0fc-0d86-11e6-8bf7-b504e4cf9801\" \r\ntime=\"2016-04-28T21:14:49Z\" level=info msg=\"Adding dns record: {test-90.test52972.default.sangee-test1.com. [104.197.241.231] A 299}\" \r\ntime=\"2016-04-28T21:14:53Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\nroot@sangeemas2-10acre-1:/home/sangeethahariharan1# docker logs b5b99783706f\r\ntime=\"2016-04-28T21:14:55Z\" level=info msg=\"CLOUDFLARE_EMAIL is not set, skipping init of CloudFlare provider\" \r\ntime=\"2016-04-28T21:14:55Z\" level=info msg=\"DNSIMPLE_TOKEN is not set, skipping init of DNSimple provider\" \r\ntime=\"2016-04-28T21:14:55Z\" level=info msg=\"GANDI_APIKEY is not set, skipping init of Gandi provider\" \r\ntime=\"2016-04-28T21:14:55Z\" level=info msg=\"POINTHQ_TOKEN is not set, skipping init of PointHQ provider\" \r\ntime=\"2016-04-28T21:15:02Z\" level=fatal msg=\"Could not list hosted zones: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: 45a35784-0d86-11e6-a597-53ed50230b85\" \r\ntime=\"2016-04-28T21:15:05Z\" level=info msg=\"CLOUDFLARE_EMAIL is not set, skipping init of CloudFlare provider\" \r\ntime=\"2016-04-28T21:15:05Z\" level=info msg=\"DNSIMPLE_TOKEN is not set, skipping init of DNSimple provider\" \r\ntime=\"2016-04-28T21:15:05Z\" level=info msg=\"GANDI_APIKEY is not set, skipping init of Gandi provider\" \r\ntime=\"2016-04-28T21:15:05Z\" level=info msg=\"POINTHQ_TOKEN is not set, skipping init of PointHQ provider\" \r\ntime=\"2016-04-28T21:15:12Z\" level=fatal msg=\"Could not list hosted zones: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: 4b8ded7b-0d86-11e6-9a54-316efdc1856b\" \r\ntime=\"2016-04-28T21:15:14Z\" level=info msg=\"CLOUDFLARE_EMAIL is not set, skipping init of CloudFlare provider\" \r\ntime=\"2016-04-28T21:15:14Z\" level=info msg=\"DNSIMPLE_TOKEN is not set, skipping init of DNSimple provider\" \r\ntime=\"2016-04-28T21:15:14Z\" level=info msg=\"GANDI_APIKEY is not set, skipping init of Gandi provider\" \r\ntime=\"2016-04-28T21:15:14Z\" level=info msg=\"POINTHQ_TOKEN is not set, skipping init of PointHQ provider\" \r\ntime=\"2016-04-28T21:15:22Z\" level=fatal msg=\"Could not list hosted zones: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: 515f2f3b-0d86-11e6-b373-d79a3e9d3ada\" \r\ntime=\"2016-04-28T21:15:24Z\" level=info msg=\"CLOUDFLARE_EMAIL is not set, skipping init of CloudFlare provider\" \r\ntime=\"2016-04-28T21:15:24Z\" level=info msg=\"DNSIMPLE_TOKEN is not set, skipping init of DNSimple provider\" \r\ntime=\"2016-04-28T21:15:24Z\" level=info msg=\"GANDI_APIKEY is not set, skipping init of Gandi provider\" \r\ntime=\"2016-04-28T21:15:24Z\" level=info msg=\"POINTHQ_TOKEN is not set, skipping init of PointHQ provider\" \r\ntime=\"2016-04-28T21:15:32Z\" level=fatal msg=\"Could not list hosted zones: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: 5723c791-0d86-11e6-8bf7-b504e4cf9801\" \r\ntime=\"2016-04-28T21:15:34Z\" level=info msg=\"CLOUDFLARE_EMAIL is not set, skipping init of CloudFlare provider\" \r\ntime=\"2016-04-28T21:15:34Z\" level=info msg=\"DNSIMPLE_TOKEN is not set, skipping init of DNSimple provider\" \r\ntime=\"2016-04-28T21:15:34Z\" level=info msg=\"GANDI_APIKEY is not set, skipping init of Gandi provider\" \r\ntime=\"2016-04-28T21:15:34Z\" level=info msg=\"POINTHQ_TOKEN is not set, skipping init of PointHQ provider\" \r\ntime=\"2016-04-28T21:15:41Z\" level=fatal msg=\"Could not list hosted zones: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: 5cea3399-0d86-11e6-a597-53ed50230b85\" \r\ntime=\"2016-04-28T21:15:43Z\" level=info msg=\"CLOUDFLARE_EMAIL is not set, skipping init of CloudFlare provider\" \r\ntime=\"2016-04-28T21:15:43Z\" level=info msg=\"DNSIMPLE_TOKEN is not set, skipping init of DNSimple provider\" \r\ntime=\"2016-04-28T21:15:43Z\" level=info msg=\"GANDI_APIKEY is not set, skipping init of Gandi provider\" \r\ntime=\"2016-04-28T21:15:43Z\" level=info msg=\"POINTHQ_TOKEN is not set, skipping init of PointHQ provider\" \r\ntime=\"2016-04-28T21:15:51Z\" level=fatal msg=\"Could not list hosted zones: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: 62b5d083-0d86-11e6-9a54-316efdc1856b\" \r\ntime=\"2016-04-28T21:15:54Z\" level=info msg=\"CLOUDFLARE_EMAIL is not set, skipping init of CloudFlare provider\" \r\ntime=\"2016-04-28T21:15:54Z\" level=info msg=\"DNSIMPLE_TOKEN is not set, skipping init of DNSimple provider\" \r\ntime=\"2016-04-28T21:15:54Z\" level=info msg=\"GANDI_APIKEY is not set, skipping init of Gandi provider\" \r\ntime=\"2016-04-28T21:15:54Z\" level=info msg=\"POINTHQ_TOKEN is not set, skipping init of PointHQ provider\" \r\ntime=\"2016-04-28T21:16:01Z\" level=fatal msg=\"Could not list hosted zones: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: 68d5ceee-0d86-11e6-b373-d79a3e9d3ada\" \r\ntime=\"2016-04-28T21:16:03Z\" level=info msg=\"CLOUDFLARE_EMAIL is not set, skipping init of CloudFlare provider\" \r\ntime=\"2016-04-28T21:16:03Z\" level=info msg=\"DNSIMPLE_TOKEN is not set, skipping init of DNSimple provider\" \r\ntime=\"2016-04-28T21:16:03Z\" level=info msg=\"GANDI_APIKEY is not set, skipping init of Gandi provider\" \r\ntime=\"2016-04-28T21:16:03Z\" level=info msg=\"POINTHQ_TOKEN is not set, skipping init of PointHQ provider\" \r\ntime=\"2016-04-28T21:16:11Z\" level=fatal msg=\"Could not list hosted zones: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: 6ea08145-0d86-11e6-9a54-316efdc1856b\" \r\ntime=\"2016-04-28T21:16:13Z\" level=info msg=\"CLOUDFLARE_EMAIL is not set, skipping init of CloudFlare provider\" \r\ntime=\"2016-04-28T21:16:13Z\" level=info msg=\"DNSIMPLE_TOKEN is not set, skipping init of DNSimple provider\" \r\ntime=\"2016-04-28T21:16:13Z\" level=info msg=\"GANDI_APIKEY is not set, skipping init of Gandi provider\" \r\ntime=\"2016-04-28T21:16:13Z\" level=info msg=\"POINTHQ_TOKEN is not set, skipping init of PointHQ provider\" \r\ntime=\"2016-04-28T21:16:13Z\" level=info msg=\"Configured Route 53 with hosted zone 'sangee-test1.com.' in region 'us-west-2' \" \r\ntime=\"2016-04-28T21:16:13Z\" level=info msg=\"Starting Rancher External DNS service\" \r\ntime=\"2016-04-28T21:16:13Z\" level=info msg=\"Powered by Route 53\" \r\ntime=\"2016-04-28T21:16:13Z\" level=info msg=\"Healthcheck handler is listening on :1000\" \r\ntime=\"2016-04-28T21:16:14Z\" level=info msg=\"DNS records to remove: [{test-38.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-83.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-16.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-43.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-59.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-66.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-69.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-33.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-5.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-72.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-86.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-92.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-48.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-85.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-17.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-20.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-26.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-32.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-44.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-93.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-96.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-51.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-62.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-27.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-52.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-73.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-81.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-98.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-22.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-67.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-9.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-11.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-57.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-60.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-74.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-89.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-12.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-14.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-50.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-54.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-41.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-70.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-90.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-95.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-23.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-64.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-79.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-88.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-65.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-53.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-35.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-80.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-10.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-37.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-75.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-84.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-18.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-21.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-39.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-77.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-94.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-8.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-97.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-1.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-4.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-47.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-56.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-58.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-78.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-87.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-82.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-2.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-25.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-42.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-30.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-99.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-19.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-34.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-40.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-13.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-68.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-71.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-91.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-29.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-6.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-15.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-24.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-28.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-36.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-45.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-61.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-46.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-49.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-63.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-7.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-76.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-3.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-31.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-55.test440934.default.sangee-test1.com. [104.197.251.169] A 299}]\" \r\ntime=\"2016-04-28T21:16:14Z\" level=info msg=\"Removing dns record: {test-38.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:16:14Z\" level=info msg=\"Removing dns record: {test-83.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:16:14Z\" level=info msg=\"Removing dns record: {test-16.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:16:15Z\" level=info msg=\"Removing dns record: {test-43.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:16:17Z\" level=info msg=\"Removing dns record: {test-59.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:16:20Z\" level=info msg=\"Removing dns record: {test-66.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:16:21Z\" level=info msg=\"Removing dns record: {test-69.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:16:21Z\" level=info msg=\"Removing dns record: {test-33.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:16:21Z\" level=info msg=\"Removing dns record: {test-5.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:16:22Z\" level=info msg=\"Removing dns record: {test-72.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:16:23Z\" level=info msg=\"Removing dns record: {test-86.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:16:23Z\" level=info msg=\"Removing dns record: {test-92.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:16:24Z\" level=info msg=\"Removing dns record: {test-48.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:16:24Z\" level=info msg=\"Removing dns record: {test-85.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:16:24Z\" level=info msg=\"Removing dns record: {test-17.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:16:25Z\" level=info msg=\"Removing dns record: {test-20.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:16:25Z\" level=info msg=\"Removing dns record: {test-26.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:16:25Z\" level=info msg=\"Removing dns record: {test-32.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:16:25Z\" level=info msg=\"Removing dns record: {test-44.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:16:25Z\" level=info msg=\"Removing dns record: {test-93.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:16:25Z\" level=info msg=\"Removing dns record: {test-96.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:16:26Z\" level=info msg=\"Removing dns record: {test-51.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:16:27Z\" level=info msg=\"Removing dns record: {test-62.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:16:27Z\" level=info msg=\"Removing dns record: {test-27.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:16:27Z\" level=info msg=\"Removing dns record: {test-52.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:16:27Z\" level=info msg=\"Removing dns record: {test-73.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:16:27Z\" level=info msg=\"Removing dns record: {test-81.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:16:31Z\" level=info msg=\"Removing dns record: {test-98.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:16:31Z\" level=info msg=\"Removing dns record: {test-22.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:16:31Z\" level=info msg=\"Removing dns record: {test-67.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:16:34Z\" level=info msg=\"Removing dns record: {test-9.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:16:36Z\" level=info msg=\"Removing dns record: {test-11.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:16:36Z\" level=info msg=\"Removing dns record: {test-57.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:16:36Z\" level=info msg=\"Removing dns record: {test-60.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:16:36Z\" level=info msg=\"Removing dns record: {test-74.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:16:37Z\" level=info msg=\"Removing dns record: {test-89.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:16:38Z\" level=info msg=\"Removing dns record: {test-12.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:16:38Z\" level=info msg=\"Removing dns recor\r\n```\r\nlogs of route53 that is stuck in \"Intializing\"..\r\n\r\n```\r\nroot@sangeemas2-10acre-1:/home/sangeethahariharan1# docker logs 9392bc4bf79d\r\ntime=\"2016-04-28T21:21:37Z\" level=info msg=\"CLOUDFLARE_EMAIL is not set, skipping init of CloudFlare provider\" \r\ntime=\"2016-04-28T21:21:37Z\" level=info msg=\"DNSIMPLE_TOKEN is not set, skipping init of DNSimple provider\" \r\ntime=\"2016-04-28T21:21:37Z\" level=info msg=\"GANDI_APIKEY is not set, skipping init of Gandi provider\" \r\ntime=\"2016-04-28T21:21:37Z\" level=info msg=\"POINTHQ_TOKEN is not set, skipping init of PointHQ provider\" \r\ntime=\"2016-04-28T21:21:44Z\" level=fatal msg=\"Could not list hosted zones: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: 3551d46f-0d87-11e6-9a54-316efdc1856b\" \r\ntime=\"2016-04-28T21:21:46Z\" level=info msg=\"CLOUDFLARE_EMAIL is not set, skipping init of CloudFlare provider\" \r\ntime=\"2016-04-28T21:21:46Z\" level=info msg=\"DNSIMPLE_TOKEN is not set, skipping init of DNSimple provider\" \r\ntime=\"2016-04-28T21:21:46Z\" level=info msg=\"GANDI_APIKEY is not set, skipping init of Gandi provider\" \r\ntime=\"2016-04-28T21:21:46Z\" level=info msg=\"POINTHQ_TOKEN is not set, skipping init of PointHQ provider\" \r\ntime=\"2016-04-28T21:21:54Z\" level=fatal msg=\"Could not list hosted zones: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: 3b03597e-0d87-11e6-8bf7-b504e4cf9801\" \r\ntime=\"2016-04-28T21:21:56Z\" level=info msg=\"CLOUDFLARE_EMAIL is not set, skipping init of CloudFlare provider\" \r\ntime=\"2016-04-28T21:21:56Z\" level=info msg=\"DNSIMPLE_TOKEN is not set, skipping init of DNSimple provider\" \r\ntime=\"2016-04-28T21:21:56Z\" level=info msg=\"GANDI_APIKEY is not set, skipping init of Gandi provider\" \r\ntime=\"2016-04-28T21:21:56Z\" level=info msg=\"POINTHQ_TOKEN is not set, skipping init of PointHQ provider\" \r\ntime=\"2016-04-28T21:22:03Z\" level=fatal msg=\"Could not list hosted zones: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: 40b246dd-0d87-11e6-b373-d79a3e9d3ada\" \r\ntime=\"2016-04-28T21:22:05Z\" level=info msg=\"CLOUDFLARE_EMAIL is not set, skipping init of CloudFlare provider\" \r\ntime=\"2016-04-28T21:22:05Z\" level=info msg=\"DNSIMPLE_TOKEN is not set, skipping init of DNSimple provider\" \r\ntime=\"2016-04-28T21:22:05Z\" level=info msg=\"GANDI_APIKEY is not set, skipping init of Gandi provider\" \r\ntime=\"2016-04-28T21:22:05Z\" level=info msg=\"POINTHQ_TOKEN is not set, skipping init of PointHQ provider\" \r\ntime=\"2016-04-28T21:22:13Z\" level=fatal msg=\"Could not list hosted zones: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: 465bdc3a-0d87-11e6-8bf7-b504e4cf9801\" \r\ntime=\"2016-04-28T21:22:15Z\" level=info msg=\"CLOUDFLARE_EMAIL is not set, skipping init of CloudFlare provider\" \r\ntime=\"2016-04-28T21:22:15Z\" level=info msg=\"DNSIMPLE_TOKEN is not set, skipping init of DNSimple provider\" \r\ntime=\"2016-04-28T21:22:15Z\" level=info msg=\"GANDI_APIKEY is not set, skipping init of Gandi provider\" \r\ntime=\"2016-04-28T21:22:15Z\" level=info msg=\"POINTHQ_TOKEN is not set, skipping init of PointHQ provider\" \r\ntime=\"2016-04-28T21:22:22Z\" level=fatal msg=\"Could not list hosted zones: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: 4c07e2f0-0d87-11e6-b373-d79a3e9d3ada\" \r\ntime=\"2016-04-28T21:22:24Z\" level=info msg=\"CLOUDFLARE_EMAIL is not set, skipping init of CloudFlare provider\" \r\ntime=\"2016-04-28T21:22:24Z\" level=info msg=\"DNSIMPLE_TOKEN is not set, skipping init of DNSimple provider\" \r\ntime=\"2016-04-28T21:22:24Z\" level=info msg=\"GANDI_APIKEY is not set, skipping init of Gandi provider\" \r\ntime=\"2016-04-28T21:22:24Z\" level=info msg=\"POINTHQ_TOKEN is not set, skipping init of PointHQ provider\" \r\ntime=\"2016-04-28T21:22:32Z\" level=fatal msg=\"Could not list hosted zones: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: 51a45961-0d87-11e6-b373-d79a3e9d3ada\" \r\ntime=\"2016-04-28T21:22:34Z\" level=info msg=\"CLOUDFLARE_EMAIL is not set, skipping init of CloudFlare provider\" \r\ntime=\"2016-04-28T21:22:34Z\" level=info msg=\"DNSIMPLE_TOKEN is not set, skipping init of DNSimple provider\" \r\ntime=\"2016-04-28T21:22:34Z\" level=info msg=\"GANDI_APIKEY is not set, skipping init of Gandi provider\" \r\ntime=\"2016-04-28T21:22:34Z\" level=info msg=\"POINTHQ_TOKEN is not set, skipping init of PointHQ provider\" \r\ntime=\"2016-04-28T21:22:42Z\" level=fatal msg=\"Could not list hosted zones: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: 5771cb10-0d87-11e6-a597-53ed50230b85\" \r\ntime=\"2016-04-28T21:22:44Z\" level=info msg=\"CLOUDFLARE_EMAIL is not set, skipping init of CloudFlare provider\" \r\ntime=\"2016-04-28T21:22:44Z\" level=info msg=\"DNSIMPLE_TOKEN is not set, skipping init of DNSimple provider\" \r\ntime=\"2016-04-28T21:22:44Z\" level=info msg=\"GANDI_APIKEY is not set, skipping init of Gandi provider\" \r\ntime=\"2016-04-28T21:22:44Z\" level=info msg=\"POINTHQ_TOKEN is not set, skipping init of PointHQ provider\" \r\ntime=\"2016-04-28T21:22:51Z\" level=fatal msg=\"Could not list hosted zones: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: 5d1d356a-0d87-11e6-9a54-316efdc1856b\" \r\ntime=\"2016-04-28T21:22:53Z\" level=info msg=\"CLOUDFLARE_EMAIL is not set, skipping init of CloudFlare provider\" \r\ntime=\"2016-04-28T21:22:53Z\" level=info msg=\"DNSIMPLE_TOKEN is not set, skipping init of DNSimple provider\" \r\ntime=\"2016-04-28T21:22:53Z\" level=info msg=\"GANDI_APIKEY is not set, skipping init of Gandi provider\" \r\ntime=\"2016-04-28T21:22:53Z\" level=info msg=\"POINTHQ_TOKEN is not set, skipping init of PointHQ provider\" \r\ntime=\"2016-04-28T21:23:01Z\" level=fatal msg=\"Could not list hosted zones: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: 62c4cf23-0d87-11e6-8bf7-b504e4cf9801\" \r\ntime=\"2016-04-28T21:23:03Z\" level=info msg=\"CLOUDFLARE_EMAIL is not set, skipping init of CloudFlare provider\" \r\ntime=\"2016-04-28T21:23:03Z\" level=info msg=\"DNSIMPLE_TOKEN is not set, skipping init of DNSimple provider\" \r\ntime=\"2016-04-28T21:23:03Z\" level=info msg=\"GANDI_APIKEY is not set, skipping init of Gandi provider\" \r\ntime=\"2016-04-28T21:23:03Z\" level=info msg=\"POINTHQ_TOKEN is not set, skipping init of PointHQ provider\" \r\ntime=\"2016-04-28T21:23:10Z\" level=fatal msg=\"Could not list hosted zones: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: 68b1d66b-0d87-11e6-8bf7-b504e4cf9801\" \r\ntime=\"2016-04-28T21:23:13Z\" level=info msg=\"CLOUDFLARE_EMAIL is not set, skipping init of CloudFlare provider\" \r\ntime=\"2016-04-28T21:23:13Z\" level=info msg=\"DNSIMPLE_TOKEN is not set, skipping init of DNSimple provider\" \r\ntime=\"2016-04-28T21:23:13Z\" level=info msg=\"GANDI_APIKEY is not set, skipping init of Gandi provider\" \r\ntime=\"2016-04-28T21:23:13Z\" level=info msg=\"POINTHQ_TOKEN is not set, skipping init of PointHQ provider\" \r\ntime=\"2016-04-28T21:23:20Z\" level=fatal msg=\"Could not list hosted zones: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: 6e66de75-0d87-11e6-8bf7-b504e4cf9801\" \r\ntime=\"2016-04-28T21:23:22Z\" level=info msg=\"CLOUDFLARE_EMAIL is not set, skipping init of CloudFlare provider\" \r\ntime=\"2016-04-28T21:23:22Z\" level=info msg=\"DNSIMPLE_TOKEN is not set, skipping init of DNSimple provider\" \r\ntime=\"2016-04-28T21:23:22Z\" level=info msg=\"GANDI_APIKEY is not set, skipping init of Gandi provider\" \r\ntime=\"2016-04-28T21:23:22Z\" level=info msg=\"POINTHQ_TOKEN is not set, skipping init of PointHQ provider\" \r\ntime=\"2016-04-28T21:23:29Z\" level=fatal msg=\"Could not list hosted zones: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: 7402df01-0d87-11e6-a597-53ed50230b85\" \r\ntime=\"2016-04-28T21:23:32Z\" level=info msg=\"CLOUDFLARE_EMAIL is not set, skipping init of CloudFlare provider\" \r\ntime=\"2016-04-28T21:23:32Z\" level=info msg=\"DNSIMPLE_TOKEN is not set, skipping init of DNSimple provider\" \r\ntime=\"2016-04-28T21:23:32Z\" level=info msg=\"GANDI_APIKEY is not set, skipping init of Gandi provider\" \r\ntime=\"2016-04-28T21:23:32Z\" level=info msg=\"POINTHQ_TOKEN is not set, skipping init of PointHQ provider\" \r\ntime=\"2016-04-28T21:23:39Z\" level=fatal msg=\"Could not list hosted zones: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: 79b41661-0d87-11e6-8bf7-b504e4cf9801\" \r\ntime=\"2016-04-28T21:23:41Z\" level=info msg=\"CLOUDFLARE_EMAIL is not set, skipping init of CloudFlare provider\" \r\ntime=\"2016-04-28T21:23:41Z\" level=info msg=\"DNSIMPLE_TOKEN is not set, skipping init of DNSimple provider\" \r\ntime=\"2016-04-28T21:23:41Z\" level=info msg=\"GANDI_APIKEY is not set, skipping init of Gandi provider\" \r\ntime=\"2016-04-28T21:23:41Z\" level=info msg=\"POINTHQ_TOKEN is not set, skipping init of PointHQ provider\" \r\ntime=\"2016-04-28T21:23:49Z\" level=fatal msg=\"Could not list hosted zones: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: 7f8cab1a-0d87-11e6-a597-53ed50230b85\" \r\ntime=\"2016-04-28T21:23:51Z\" level=info msg=\"CLOUDFLARE_EMAIL is not set, skipping init of CloudFlare provider\" \r\ntime=\"2016-04-28T21:23:51Z\" level=info msg=\"DNSIMPLE_TOKEN is not set, skipping init of DNSimple provider\" \r\ntime=\"2016-04-28T21:23:51Z\" level=info msg=\"GANDI_APIKEY is not set, skipping init of Gandi provider\" \r\ntime=\"2016-04-28T21:23:51Z\" level=info msg=\"POINTHQ_TOKEN is not set, skipping init of PointHQ provider\" \r\ntime=\"2016-04-28T21:23:54Z\" level=info msg=\"Configured Route 53 with hosted zone 'sangee-test1.com.' in region 'us-west-2' \" \r\ntime=\"2016-04-28T21:23:54Z\" level=info msg=\"Starting Rancher External DNS service\" \r\ntime=\"2016-04-28T21:23:54Z\" level=info msg=\"Powered by Route 53\" \r\ntime=\"2016-04-28T21:23:54Z\" level=info msg=\"Healthcheck handler is listening on :1000\" \r\ntime=\"2016-04-28T21:24:02Z\" level=error msg=\"Failed to update provider with new DNS records: Provider error reading dns entries: Route 53 API call has failed: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: 87308a13-0d87-11e6-8bf7-b504e4cf9801\" \r\ntime=\"2016-04-28T21:24:02Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:24:06Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:24:10Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:24:14Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:24:18Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:24:22Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:24:34Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:24:38Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:24:42Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:24:46Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:24:50Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:24:54Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:24:58Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:25:02Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:25:06Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:25:09Z\" level=info msg=\"DNS records to remove: [{test-33.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-99.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-85.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-13.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-30.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-74.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-18.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-20.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-96.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-39.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-56.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-57.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-76.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-6.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-14.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-29.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-35.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-41.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-48.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-17.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-72.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-9.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-2.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-23.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-40.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-70.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-81.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-95.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-98.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-16.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-19.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-27.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-31.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-55.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-7.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-78.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-8.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-12.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-52.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-59.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-64.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-63.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-68.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-97.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-1.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-3.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-89.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-21.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-28.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-37.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-87.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-11.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-44.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-53.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-10.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-25.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-71.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-75.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-62.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-66.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-91.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-43.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-45.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-47.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-5.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-82.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-88.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-36.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-50.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-51.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-77.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-94.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-15.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-38.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-54.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-60.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-69.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-32.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-92.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-79.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-84.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-90.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-4.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-42.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-24.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-26.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-22.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-34.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-46.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-67.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-80.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-61.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-58.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-93.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-49.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-65.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-73.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-83.test440934.default.sangee-test1.com. [104.197.251.169] A 299} {test-86.test440934.default.sangee-test1.com. [104.197.251.169] A 299}]\" \r\ntime=\"2016-04-28T21:25:09Z\" level=info msg=\"Removing dns record: {test-33.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:25:11Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:25:14Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:25:17Z\" level=error msg=\"Failed to remove DNS record from provider {test-33.test440934.default.sangee-test1.com. [104.197.251.169] A 299}: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: b3d474ed-0d87-11e6-9a54-316efdc1856b\" \r\ntime=\"2016-04-28T21:25:17Z\" level=info msg=\"Removing dns record: {test-99.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:25:18Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:25:22Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:25:24Z\" level=error msg=\"Failed to remove DNS record from provider {test-99.test440934.default.sangee-test1.com. [104.197.251.169] A 299}: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: b826df54-0d87-11e6-b373-d79a3e9d3ada\" \r\ntime=\"2016-04-28T21:25:24Z\" level=info msg=\"Removing dns record: {test-85.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:25:26Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:25:30Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:25:31Z\" level=error msg=\"Failed to remove DNS record from provider {test-85.test440934.default.sangee-test1.com. [104.197.251.169] A 299}: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: bc7ca546-0d87-11e6-a597-53ed50230b85\" \r\ntime=\"2016-04-28T21:25:31Z\" level=info msg=\"Removing dns record: {test-13.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:25:34Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:25:38Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:25:38Z\" level=error msg=\"Failed to remove DNS record from provider {test-13.test440934.default.sangee-test1.com. [104.197.251.169] A 299}: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: c0e6dd1f-0d87-11e6-8bf7-b504e4cf9801\" \r\ntime=\"2016-04-28T21:25:38Z\" level=info msg=\"Removing dns record: {test-30.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:25:42Z\" level=info msg=\"Removing dns record: {test-74.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:25:42Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:25:46Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:25:49Z\" level=error msg=\"Failed to remove DNS record from provider {test-74.test440934.default.sangee-test1.com. [104.197.251.169] A 299}: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: c722ee89-0d87-11e6-a597-53ed50230b85\" \r\ntime=\"2016-04-28T21:25:49Z\" level=info msg=\"Removing dns record: {test-18.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:25:50Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:25:54Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:25:56Z\" level=error msg=\"Failed to remove DNS record from provider {test-18.test440934.default.sangee-test1.com. [104.197.251.169] A 299}: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: cb7642b7-0d87-11e6-9a54-316efdc1856b\" \r\ntime=\"2016-04-28T21:25:56Z\" level=info msg=\"Removing dns record: {test-20.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:25:58Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:26:02Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:26:03Z\" level=error msg=\"Failed to remove DNS record from provider {test-20.test440934.default.sangee-test1.com. [104.197.251.169] A 299}: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: cfca824a-0d87-11e6-b373-d79a3e9d3ada\" \r\ntime=\"2016-04-28T21:26:03Z\" level=info msg=\"Removing dns record: {test-96.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:26:06Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:26:10Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:26:11Z\" level=error msg=\"Failed to remove DNS record from provider {test-96.test440934.default.sangee-test1.com. [104.197.251.169] A 299}: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: d42b6b23-0d87-11e6-8bf7-b504e4cf9801\" \r\ntime=\"2016-04-28T21:26:11Z\" level=info msg=\"Removing dns record: {test-39.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:26:14Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:26:18Z\" level=error msg=\"Failed to remove DNS record from provider {test-39.test440934.default.sangee-test1.com. [104.197.251.169] A 299}: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: d8765b50-0d87-11e6-a597-53ed50230b85\" \r\ntime=\"2016-04-28T21:26:18Z\" level=info msg=\"Removing dns record: {test-56.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:26:18Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:26:22Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:26:25Z\" level=error msg=\"Failed to remove DNS record from provider {test-56.test440934.default.sangee-test1.com. [104.197.251.169] A 299}: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: dccd5928-0d87-11e6-a597-53ed50230b85\" \r\ntime=\"2016-04-28T21:26:25Z\" level=info msg=\"Removing dns record: {test-57.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:26:26Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:26:30Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:26:32Z\" level=error msg=\"Failed to remove DNS record from provider {test-57.test440934.default.sangee-test1.com. [104.197.251.169] A 299}: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: e112f212-0d87-11e6-a597-53ed50230b85\" \r\ntime=\"2016-04-28T21:26:32Z\" level=info msg=\"Removing dns record: {test-76.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:26:34Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:26:38Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:26:40Z\" level=error msg=\"Failed to remove DNS record from provider {test-76.test440934.default.sangee-test1.com. [104.197.251.169] A 299}: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: e56dc074-0d87-11e6-b373-d79a3e9d3ada\" \r\ntime=\"2016-04-28T21:26:40Z\" level=info msg=\"Removing dns record: {test-6.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:26:42Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:26:46Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:26:47Z\" level=error msg=\"Failed to remove DNS record from provider {test-6.test440934.default.sangee-test1.com. [104.197.251.169] A 299}: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: e9c31141-0d87-11e6-8bf7-b504e4cf9801\" \r\ntime=\"2016-04-28T21:26:47Z\" level=info msg=\"Removing dns record: {test-14.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:26:50Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:26:54Z\" level=error msg=\"Failed to remove DNS record from provider {test-14.test440934.default.sangee-test1.com. [104.197.251.169] A 299}: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: ee10e77f-0d87-11e6-8bf7-b504e4cf9801\" \r\ntime=\"2016-04-28T21:26:54Z\" level=info msg=\"Removing dns record: {test-29.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:26:54Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:26:58Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:27:02Z\" level=error msg=\"Failed to remove DNS record from provider {test-29.test440934.default.sangee-test1.com. [104.197.251.169] A 299}: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: f26c04a2-0d87-11e6-8bf7-b504e4cf9801\" \r\ntime=\"2016-04-28T21:27:02Z\" level=info msg=\"Removing dns record: {test-35.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:27:02Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:27:06Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:27:09Z\" level=error msg=\"Failed to remove DNS record from provider {test-35.test440934.default.sangee-test1.com. [104.197.251.169] A 299}: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: f6c76ee1-0d87-11e6-a597-53ed50230b85\" \r\ntime=\"2016-04-28T21:27:09Z\" level=info msg=\"Removing dns record: {test-41.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:27:10Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:27:14Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:27:16Z\" level=error msg=\"Failed to remove DNS record from provider {test-41.test440934.default.sangee-test1.com. [104.197.251.169] A 299}: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: fb0fee97-0d87-11e6-8bf7-b504e4cf9801\" \r\ntime=\"2016-04-28T21:27:16Z\" level=info msg=\"Removing dns record: {test-48.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:27:18Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:27:22Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:27:23Z\" level=error msg=\"Failed to remove DNS record from provider {test-48.test440934.default.sangee-test1.com. [104.197.251.169] A 299}: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: ff5f71df-0d87-11e6-8bf7-b504e4cf9801\" \r\ntime=\"2016-04-28T21:27:23Z\" level=info msg=\"Removing dns record: {test-17.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:27:26Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:27:30Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:27:31Z\" level=error msg=\"Failed to remove DNS record from provider {test-17.test440934.default.sangee-test1.com. [104.197.251.169] A 299}: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: 03c1ba99-0d88-11e6-a597-53ed50230b85\" \r\ntime=\"2016-04-28T21:27:31Z\" level=info msg=\"Removing dns record: {test-72.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:27:34Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:27:38Z\" level=error msg=\"Failed to remove DNS record from provider {test-72.test440934.default.sangee-test1.com. [104.197.251.169] A 299}: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: 081f489a-0d88-11e6-b373-d79a3e9d3ada\" \r\ntime=\"2016-04-28T21:27:38Z\" level=info msg=\"Removing dns record: {test-9.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:27:38Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:27:45Z\" level=error msg=\"Failed to remove DNS record from provider {test-9.test440934.default.sangee-test1.com. [104.197.251.169] A 299}: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: 0c76bba8-0d88-11e6-8bf7-b504e4cf9801\" \r\ntime=\"2016-04-28T21:27:45Z\" level=info msg=\"Removing dns record: {test-2.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:27:46Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:27:50Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:27:52Z\" level=error msg=\"Failed to remove DNS record from provider {test-2.test440934.default.sangee-test1.com. [104.197.251.169] A 299}: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: 10c52e8a-0d88-11e6-b373-d79a3e9d3ada\" \r\ntime=\"2016-04-28T21:27:52Z\" level=info msg=\"Removing dns record: {test-23.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:27:54Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:27:56Z\" level=info msg=\"Removing dns record: {test-40.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:27:56Z\" level=info msg=\"Removing dns record: {test-70.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:27:58Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:28:03Z\" level=error msg=\"Failed to remove DNS record from provider {test-70.test440934.default.sangee-test1.com. [104.197.251.169] A 299}: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: 17195ca6-0d88-11e6-8bf7-b504e4cf9801\" \r\ntime=\"2016-04-28T21:28:03Z\" level=info msg=\"Removing dns record: {test-81.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:28:05Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:28:09Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:28:10Z\" level=error msg=\"Failed to remove DNS record from provider {test-81.test440934.default.sangee-test1.com. [104.197.251.169] A 299}: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: 1b62ed3f-0d88-11e6-9a54-316efdc1856b\" \r\ntime=\"2016-04-28T21:28:10Z\" level=info msg=\"Removing dns record: {test-95.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:28:13Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:28:17Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:28:18Z\" level=error msg=\"Failed to remove DNS record from provider {test-95.test440934.default.sangee-test1.com. [104.197.251.169] A 299}: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: 1fb6b63a-0d88-11e6-b373-d79a3e9d3ada\" \r\ntime=\"2016-04-28T21:28:18Z\" level=info msg=\"Removing dns record: {test-98.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:28:21Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:28:25Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:28:25Z\" level=error msg=\"Failed to remove DNS record from provider {test-98.test440934.default.sangee-test1.com. [104.197.251.169] A 299}: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: 24083630-0d88-11e6-b373-d79a3e9d3ada\" \r\ntime=\"2016-04-28T21:28:25Z\" level=info msg=\"Removing dns record: {test-16.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:28:29Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:28:32Z\" level=error msg=\"Failed to remove DNS record from provider {test-16.test440934.default.sangee-test1.com. [104.197.251.169] A 299}: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: 285dadfb-0d88-11e6-a597-53ed50230b85\" \r\ntime=\"2016-04-28T21:28:32Z\" level=info msg=\"Removing dns record: {test-19.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:28:33Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:28:37Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:28:39Z\" level=error msg=\"Failed to remove DNS record from provider {test-19.test440934.default.sangee-test1.com. [104.197.251.169] A 299}: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: 2cb6325e-0d88-11e6-a597-53ed50230b85\" \r\ntime=\"2016-04-28T21:28:39Z\" level=info msg=\"Removing dns record: {test-27.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:28:41Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:28:45Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:28:47Z\" level=error msg=\"Failed to remove DNS record from provider {test-27.test440934.default.sangee-test1.com. [104.197.251.169] A 299}: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: 310d0951-0d88-11e6-a597-53ed50230b85\" \r\ntime=\"2016-04-28T21:28:47Z\" level=info msg=\"Removing dns record: {test-31.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:28:49Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:28:54Z\" level=error msg=\"Failed to remove DNS record from provider {test-31.test440934.default.sangee-test1.com. [104.197.251.169] A 299}: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: 355d7759-0d88-11e6-9a54-316efdc1856b\" \r\ntime=\"2016-04-28T21:28:54Z\" level=info msg=\"Removing dns record: {test-55.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:28:57Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:29:00Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:29:01Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:29:01Z\" level=error msg=\"Failed to remove DNS record from provider {test-55.test440934.default.sangee-test1.com. [104.197.251.169] A 299}: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: 39b0a4e5-0d88-11e6-8bf7-b504e4cf9801\" \r\ntime=\"2016-04-28T21:29:01Z\" level=info msg=\"Removing dns record: {test-7.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:29:05Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:29:08Z\" level=error msg=\"Failed to remove DNS record from provider {test-7.test440934.default.sangee-test1.com. [104.197.251.169] A 299}: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: 3e033683-0d88-11e6-8bf7-b504e4cf9801\" \r\ntime=\"2016-04-28T21:29:08Z\" level=info msg=\"Removing dns record: {test-78.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:29:09Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:29:13Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:29:16Z\" level=error msg=\"Failed to remove DNS record from provider {test-78.test440934.default.sangee-test1.com. [104.197.251.169] A 299}: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: 4250977a-0d88-11e6-8bf7-b504e4cf9801\" \r\ntime=\"2016-04-28T21:29:16Z\" level=info msg=\"Removing dns record: {test-8.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:29:17Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:29:21Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:29:23Z\" level=error msg=\"Failed to remove DNS record from provider {test-8.test440934.default.sangee-test1.com. [104.197.251.169] A 299}: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: 469d5cd9-0d88-11e6-a597-53ed50230b85\" \r\ntime=\"2016-04-28T21:29:23Z\" level=info msg=\"Removing dns record: {test-12.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:29:25Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:29:29Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:29:30Z\" level=error msg=\"Failed to remove DNS record from provider {test-12.test440934.default.sangee-test1.com. [104.197.251.169] A 299}: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: 4aedcb07-0d88-11e6-b373-d79a3e9d3ada\" \r\ntime=\"2016-04-28T21:29:30Z\" level=info msg=\"Removing dns record: {test-52.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:29:33Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:29:37Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\ntime=\"2016-04-28T21:29:37Z\" level=error msg=\"Failed to remove DNS record from provider {test-52.test440934.default.sangee-test1.com. [104.197.251.169] A 299}: Throttling: Rate exceeded\\n\\tstatus code: 400, request id: 4f4257fa-0d88-11e6-9a54-316efdc1856b\" \r\ntime=\"2016-04-28T21:29:37Z\" level=info msg=\"Removing dns record: {test-59.test440934.default.sangee-test1.com. [104.197.251.169] A 299}\" \r\ntime=\"2016-04-28T21:29:41Z\" level=error msg=\"Healtcheck failed: unable to reach a provider\" \r\n```"},"comment":{"url":"https://api.github.com/repos/rancher/rancher/issues/comments/223142620","html_url":"https://github.com/rancher/rancher/issues/4596#issuecomment-223142620","issue_url":"https://api.github.com/repos/rancher/rancher/issues/4596","id":223142620,"user":{"login":"janeczku","id":3813921,"avatar_url":"https://avatars.githubusercontent.com/u/3813921?v=3","gravatar_id":"","url":"https://api.github.com/users/janeczku","html_url":"https://github.com/janeczku","followers_url":"https://api.github.com/users/janeczku/followers","following_url":"https://api.github.com/users/janeczku/following{/other_user}","gists_url":"https://api.github.com/users/janeczku/gists{/gist_id}","starred_url":"https://api.github.com/users/janeczku/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/janeczku/subscriptions","organizations_url":"https://api.github.com/users/janeczku/orgs","repos_url":"https://api.github.com/users/janeczku/repos","events_url":"https://api.github.com/users/janeczku/events{/privacy}","received_events_url":"https://api.github.com/users/janeczku/received_events","type":"User","site_admin":false},"created_at":"2016-06-01T22:21:02Z","updated_at":"2016-06-01T22:21:02Z","body":"@sangeethah @alena1108 Considering the very strict API rate limits for Route 53 and other DNS providers it may be better to not send interval API calls in health check and instead refer to the result of the last API call made during normal operation. See PR https://github.com/rancher/external-dns/pull/38"}}
{"actor":{"display_login":"janeczku"}}