{"push_id":1373877948,"size":16,"distinct_size":4,"ref":"refs/heads/127345741_cve_notifer","head":"48c213143db889d20d72e5086247e54a6b4f240d","before":"997dc09136f07c63f892f34ff47e783a4bfcf961","commits":[{"sha":"0dfe1dc73885b25706ffc5aa7dad44eef197b330","author":{"name":"Hector Rivas Gandara","email":"7b7e5985d0d5e042df62f31a43aa47b3c2b7c938@gmail.com"},"message":"Update the bosh stemcell to 6263.8 as in CF\n\nWe have upgraded the CF stemcell to 6263.8 in #565.\n\nWe upgrade to the same stemcell in bosh.","distinct":false,"url":"https://api.github.com/repos/alphagov/paas-cf/commits/0dfe1dc73885b25706ffc5aa7dad44eef197b330"},{"sha":"4f52046b35da99022dc022ca862031509e091408","author":{"name":"Hector Rivas Gandara","email":"7b7e5985d0d5e042df62f31a43aa47b3c2b7c938@gmail.com"},"message":"Upgrade to bosh release v258\n\nAdds some new options as --dry-run and --fix and includes bugfixes\nand other minor improvements.\n\nMore info in https://github.com/cloudfoundry/bosh/releases/tag/v258","distinct":false,"url":"https://api.github.com/repos/alphagov/paas-cf/commits/4f52046b35da99022dc022ca862031509e091408"},{"sha":"097e93c33ad39d7143f04552f3944d860477eb9f","author":{"name":"Hector Rivas Gandara","email":"7b7e5985d0d5e042df62f31a43aa47b3c2b7c938@gmail.com"},"message":"Upgrade bosh-aws-cpi release to v60\n\nWe change it for bosh and bosh-init (they use the same reference) and\nbosh-init for concourse.\n\nMost interesting changes are:\n\n * Use EBS disks for ephemeral disk (/var/vcap/data) instead of instance\n   storage.\n * Switched to gp2 disk type as default for all disks\n\nWe will do additional changes to tune the disk settings","distinct":false,"url":"https://api.github.com/repos/alphagov/paas-cf/commits/097e93c33ad39d7143f04552f3944d860477eb9f"},{"sha":"55fc997838e9a8153650d9af1542d56cf7cdbfe8","author":{"name":"Hector Rivas Gandara","email":"7b7e5985d0d5e042df62f31a43aa47b3c2b7c938@gmail.com"},"message":"Add 100G of ephemeral disk for the Cells\n\nThe cells are using the local VM space for ephemeral storage, and there\nis a risk that they running out of space. We should add more ephemeral\nspace, but there was a concern about the user impact.\n\nAfter upgrade the CPI, we know that all the ephemeral disks will be EBS[1]\n\n* Use EBS disks for ephemeral disk (/var/vcap/data) instead of instance storage\n  * Very convenient when shutting down and starting up large number of machines directly in AWS\n  * Can opt-in to use instance storage via  ephemeral_disk.use_instance_storage=true\n\nIn more detail, as described in [2]\n\nCurrently our cell configuration is to use ephemeral disks. The instance type\nwe use (r3.xlarge) has 80GB ephemeral disk. 30GB is used for swap, which\nleaves 50GB available for tenant instances and other cf data.\n\nAs it turns out, this might be not enough because:\n\n * default droplet disk limit is 2GB. It is rarely suggested to use less\n   (in docs etc.), set by the cc.maximum_app_disk_in_mb\n * available disk space is not checked as rigorously as available memory when\n   CF/Diego when picking cell to host new instance It is possible that a\n   eployment will be attempted on a cell that has not enough disk space available\n * CF has a cache directory in `/var/vcap/data/executor_cache`. We've seen\n   this take 9G (or 20% of available space) on a cell in staging.\n   We also have seen very high disk usage on cells in CI.\n\nIn this commit we add dedicated ephemeral disk. We consider that 100GB should\nbe able to support our current load without issues (100-150 instances)\n\n[1] https://github.com/cloudfoundry-incubator/bosh-aws-cpi-release/releases/tag/v53\n[2] https://www.pivotaltracker.com/n/projects/1275640/stories/133104393","distinct":false,"url":"https://api.github.com/repos/alphagov/paas-cf/commits/55fc997838e9a8153650d9af1542d56cf7cdbfe8"},{"sha":"d7f3a926138e7189474765bd20b8c08ee9e97df4","author":{"name":"Hector Rivas Gandara","email":"7b7e5985d0d5e042df62f31a43aa47b3c2b7c938@gmail.com"},"message":"Enable bosh director record of events\n\nSince v256 of bosh we can enable recording of events to the database and\nsyslog. This will increase the auditing capabilities. [1][2]\n\n[1] https://bosh.io/docs/events.html\n[2] https://bosh.io/jobs/director?source=github.com/cloudfoundry/bosh#p=director.events.record_events","distinct":false,"url":"https://api.github.com/repos/alphagov/paas-cf/commits/d7f3a926138e7189474765bd20b8c08ee9e97df4"},{"sha":"19a22d90cfc877c152531ad8679589fea84a242d","author":{"name":"Hector Rivas Gandara","email":"7b7e5985d0d5e042df62f31a43aa47b3c2b7c938@gmail.com"},"message":"Enable explicit arp flushing of deployed VMs\n\nCertain IaaSes may limit and/or disable gratuitous ARP for security\nreasons (for example AWS). Linux kernel performs periodic garbage\ncollection of stale ARP entries; however, if there are open or stale\nconnections these entries will not be cleared causing new connections to\nfail since they just use an existing outdated MAC address.\n\nSince bosh v256, the option `director.flush_arp`[1][2] will make bosh\nsend explicit messages to all agents to flush ARP entries for specific\nIPs.[3]\n\n[1] https://bosh.io/jobs/director?source=github.com/cloudfoundry/bosh#p=director.flush_arp\n[2] https://bosh.io/docs/flush-arp.html\n[3] https://github.com/cloudfoundry/bosh-notes/blob/master/finished/forceful-arp.md","distinct":false,"url":"https://api.github.com/repos/alphagov/paas-cf/commits/19a22d90cfc877c152531ad8679589fea84a242d"},{"sha":"c10b9412c4b54aa1bcdeb4f361e9113a2c15dcc6","author":{"name":"Hector Rivas Gandara","email":"7b7e5985d0d5e042df62f31a43aa47b3c2b7c938@gmail.com"},"message":"Enable dedicated workers for status tasks\n\nIn bosh v257 the parameter `director.enable_dedicated_status_worker`[1] was\nadded. When true, it reserves one bosh worker for status tasks, like\n`bosh ssh` or `bosh vms`.\n\nThis allows operate and control the platform even when other tasks are\nrunning in background.\n\nWe enable it and add an additional worker (default was 3) to keep the\nnumber of workers for normal tasks the same.\n\n[1] https://bosh.io/jobs/director?source=github.com/cloudfoundry/bosh#p=director.enable_dedicated_status_worker","distinct":false,"url":"https://api.github.com/repos/alphagov/paas-cf/commits/c10b9412c4b54aa1bcdeb4f361e9113a2c15dcc6"},{"sha":"a03b617bd775c4cda3db3eec6255777cc616dcd8","author":{"name":"Hector Rivas Gandara","email":"7b7e5985d0d5e042df62f31a43aa47b3c2b7c938@gmail.com"},"message":"Pass the etcd name to metron agent addon\n\nWith bosh v258 we must pass all the required properties to the addons.\nThe metron_agent requires `loggregator.etcd.machines` which currently\nwe set as the value in `etc.advertise_urls_dns_suffix`.\n\nWithout this property, the deployment will fail with this error for all\nthe VMs:\n\n   - Unable to render jobs for instance group 'ingestor_z2'. Errors are:\n     - Unable to render templates for job 'metron_agent'. Errors are:\n       - Error filling in template 'metron_agent.json.erb' (line 33: Can't find property '[\"loggregator.etcd.machines\"]')\n\nIn order to be able to deploy metron agent as addon, we must set this\nproperty. We move the definition of the value to the file\ncommon/metron.yml and grab it in `etcd.advertise_urls_dns_suffix` and\nthe addon `loggregator.etc.machines`.\n\nNote, there are plans to remove metron_agent as addon, so this commit\nmust be reverted by then.","distinct":false,"url":"https://api.github.com/repos/alphagov/paas-cf/commits/a03b617bd775c4cda3db3eec6255777cc616dcd8"},{"sha":"1cc60ed4a3573a479554e4aaac668933c859016d","author":{"name":"Hector Rivas Gandara","email":"7b7e5985d0d5e042df62f31a43aa47b3c2b7c938@gmail.com"},"message":"Pass metron_endpoint.shared_secret to metron_agent\n\nSince v258, using metron_agent as addon requires pass all the\nproperties to the addons. We need to also pass\nmetron_endpoint.shared_secret, which is based on the\nsecrets.loggregator_endpoint_shared_secret.\n\nOtherwise, we would get this error for all instances:\n\n   - Unable to render jobs for instance group 'clock_global'. Errors are:\n     - Unable to render templates for job 'metron_agent'. Errors are:\n       - Error filling in template 'metron_agent.json.erb' (line 44: Can't find property '[\"metron_endpoint.shared_secret\"]')\n\nThis commit can be reverted once the metron_agent has been removed as addon.","distinct":false,"url":"https://api.github.com/repos/alphagov/paas-cf/commits/1cc60ed4a3573a479554e4aaac668933c859016d"},{"sha":"58adb35f3e7a9094db4d6d9d96e770a15b399257","author":{"name":"Hector Rivas Gandara","email":"7b7e5985d0d5e042df62f31a43aa47b3c2b7c938@gmail.com"},"message":"Merge branch 'feature/132681767_upgrade_stemcells' into feature/132681767_upgrade_bosh_cpi_and_release\n\n* feature/132681767_upgrade_stemcells:\n  Update the bosh stemcell to 6263.8 as in CF","distinct":false,"url":"https://api.github.com/repos/alphagov/paas-cf/commits/58adb35f3e7a9094db4d6d9d96e770a15b399257"},{"sha":"9ea63ed2053be2452c7602927dbc136b109cd0be","author":{"name":"Hector Rivas Gandara","email":"7b7e5985d0d5e042df62f31a43aa47b3c2b7c938@gmail.com"},"message":"Explicitly set EBS ephemeral disk to all VM types\n\nAs it turns out, if you don't specify the ephemeral disk, the new\nbosh will automatically create the EBS volume volume matching the\nprevious free size in the instance disk.\n\nFor instance, in m3.large it will create a 4 GB EBS volume by default\nwhich matches the previous disk.\n\nWe think it is convenient to explicitly define the ephemeral disk for\nevery VM type.\n\nWe add a test to check that we define, at least, 10GB disk for all the\nVM types. We add the ephemeral disk for ingestor, access, and\ncompilation types. Compilation has currently 12GB, we decided to set\n20G.","distinct":false,"url":"https://api.github.com/repos/alphagov/paas-cf/commits/9ea63ed2053be2452c7602927dbc136b109cd0be"},{"sha":"090464428c0cd37a21040bf5954a395d5205960f","author":{"name":"Michal Tekel","email":"362152e0b47ba94f38b061841c00275d934e3fee@gmail.com"},"message":"Merge pull request #570 from alphagov/feature/132681767_upgrade_bosh_cpi_and_release\n\n[#132681767] Upgrade bosh #2: bosh release, cpi and enable some features","distinct":false,"url":"https://api.github.com/repos/alphagov/paas-cf/commits/090464428c0cd37a21040bf5954a395d5205960f"},{"sha":"99e430adfa339d710180319e09be4bf155727e19","author":{"name":"Colin Saliceti","email":"c20ddd69cca5123f81b76f495aee28e803e78fe3@gmail.com"},"message":"Deploy cve-notifier application to paas\n\nThe app scraps the Pivotal security web page\n(https://pivotal.io/security) and reports them to Datadog.\nWe only deploy to prod as we only need one instance running.","distinct":true,"url":"https://api.github.com/repos/alphagov/paas-cf/commits/99e430adfa339d710180319e09be4bf155727e19"},{"sha":"c5d5d039a2b79c8666ffecf24182d50768da66d1","author":{"name":"Colin Saliceti","email":"c20ddd69cca5123f81b76f495aee28e803e78fe3@gmail.com"},"message":"[TEMP] Enable cve notifier in dev\n\nUseful to be able to test in a dev environment. Remove after testing.","distinct":true,"url":"https://api.github.com/repos/alphagov/paas-cf/commits/c5d5d039a2b79c8666ffecf24182d50768da66d1"},{"sha":"843f723c5c2662103d697f93c921e478a81d609e","author":{"name":"Colin Saliceti","email":"c20ddd69cca5123f81b76f495aee28e803e78fe3@gmail.com"},"message":"[TEMP] 127345741_ensure_notifications branch\n\nThe deploy depends on cve-notifier being merged to master so we need to\ndownload from the branch temporarily.\nDelete after cve-notifier merge.","distinct":true,"url":"https://api.github.com/repos/alphagov/paas-cf/commits/843f723c5c2662103d697f93c921e478a81d609e"},{"sha":"48c213143db889d20d72e5086247e54a6b4f240d","author":{"name":"Colin Saliceti","email":"c20ddd69cca5123f81b76f495aee28e803e78fe3@gmail.com"},"message":"Terraform CVE notifier monitor","distinct":true,"url":"https://api.github.com/repos/alphagov/paas-cf/commits/48c213143db889d20d72e5086247e54a6b4f240d"}]}
{"actor":{"display_login":"saliceti"}}