{"action":"created","comment":{"url":"https://api.github.com/repos/kubernetes/community/pulls/comments/222099908","pull_request_review_id":160908508,"id":222099908,"node_id":"MDI0OlB1bGxSZXF1ZXN0UmV2aWV3Q29tbWVudDIyMjA5OTkwOA==","diff_hunk":"@@ -0,0 +1,249 @@\n+---\n+kep-number: 25\n+title: Migrating API objects to latest storage version\n+authors:\n+  - \"@xuchao\"\n+owning-sig: sig-api-machinery\n+reviewers:\n+  - \"@deads2k\"\n+  - \"@lavalamp\"\n+approvers:\n+  - \"@deads2k\"\n+  - \"@lavalamp\"\n+creation-date: 2018-08-06\n+last-updated: 2018-09-25\n+status: provisional\n+---\n+\n+# Migrating API objects to latest storage version\n+\n+## Table of Contents\n+\n+   * [Migrating API objects to latest storage version](#migrating-api-objects-to-latest-storage-version)\n+      * [Table of Contents](#table-of-contents)\n+      * [Summary](#summary)\n+      * [Motivation](#motivation)\n+         * [Goals](#goals)\n+      * [Proposal](#proposal)\n+         * [Alpha workflow](#alpha-workflow)\n+         * [Alpha API](#alpha-api)\n+         * [Failure recovery](#failure-recovery)\n+         * [Beta workflow - Automation](#beta-workflow---automation)\n+         * [Risks and Mitigations](#risks-and-mitigations)\n+      * [Graduation Criteria](#graduation-criteria)\n+      * [Alternatives](#alternatives)\n+         * [update-storage-objects.sh](#update-storage-objectssh)\n+\n+## Summary\n+\n+We propose a solution to migrate the stored API objects in Kubernetes clusters.\n+In 2018 Q4, we will deliver a tool of alpha quality. The tool extends and\n+improves based on the [oc adm migrate storage][] command.  We will integrate the\n+storage migration into the Kubernetes upgrade process in 2019 Q1.  We will make\n+the migration automatically triggered in 2019.\n+\n+[oc adm migrate storage]:https://www.mankier.com/1/oc-adm-migrate-storage\n+\n+## Motivation\n+\n+\"Today it is possible to create API objects (e.g., HPAs) in one version of\n+Kubernetes, go through multiple upgrade cycles without touching those objects,\n+and eventually arrive at a version of Kubernetes that can’t interpret the stored\n+resource and crashes. See k8s.io/pr/52185.\"[1][]. We propose a solution to the\n+problem.\n+\n+[1]:https://docs.google.com/document/d/1eoS1K40HLMl4zUyw5pnC05dEF3mzFLp5TPEEt4PFvsM\n+\n+### Goals\n+\n+A successful storage version migration tool must:\n+* work for Kubernetes built-in APIs, custom resources (CR), and aggregated APIs.\n+* do not add burden to cluster administrators or Kubernetes distributions.\n+* only cause insignificant load to apiservers. For example, if the master has\n+  10GB memory, the migration tool should generate less than 10 qps of single\n+  object operations(TODO: measure the memory consumption of PUT operations;\n+  study how well the default 10 Mbps bandwidth limit in the oc command work).\n+* work for big clusters that have ~10^6 instances of some resource types.\n+* make progress in flaky environment, e.g., flaky apiservers, or the migration\n+  process get preempted.\n+* allow system administrators to track the migration progress.\n+\n+As to the deliverables,\n+* in the short term, providing system administrators with a tool to migrate\n+  the API objects to the proper storage versions.\n+* in the long term, automating the migration of Kubernetes built-in APIs, CR,\n+  aggregated APIs without further burdening system administrators or Kubernetes\n+  distributions.\n+\n+## Proposal\n+\n+### Alpha workflow\n+\n+We will create a **kube-migrator** command line tool. At the alpha stage,\n+**kube-migrator** needs to be manually invoked, and does not handle custom\n+resources or aggregated resources.\n+\n+After all the kube-apiservers are at the desired version, the cluster\n+administrator runs the `kube-migrator install` command. It\n+* deletes any existing `deployment` of **kube-migrator controller** \n+* creates a `deployment` of **kube-migrator controller** \n+* generates a comprehensive list of resource types via the discovery API\n+* discovers all custom resources via listing CRDs\n+* discovers all aggregated resources via listing all `apiservices` that have\n+  `.spec.service != null`\n+* removes the custom resources and aggregated resources from the comprehensive\n+  resource list. The list now only contains Kubernetes built-in resources.\n+* removes resources that share the same storage. At the alpha stage, the\n+  information is hard-coded, like in this [list][].\n+* creates `migration` CRs (see the [API section][] for the schema) for all\n+  remaining resources. The `ownerReferences` of the `migration` objects are set\n+  to the **kube-migrator controller** `deployment`. Thus, the old `migration`s\n+  are deleted with the old `deployment` in the first step.\n+* uses the same kubeconfig file as **kubectl** does.\n+\n+The control loop of **kube-migrator controller** does the following:\n+* watches the instances of the `migration` CR, adds them to a [workqueue][].\n+* syncs one `migration` at a time to avoid overloading the apiserver,\n+  * if `migration.status.completed == false`, it creates a **migration worker**\n+    `job` to migrate the resource type. The `ownerReference` of the `job` is set\n+    to the `migration`.\n+  * waits until the **migration worker** `job` finishes, updates\n+    `migration.status.completed` to `true`, and deletes the `job`.\n+\n+The **migrator worker** `job` runs the equivalence of `oc adm migrate storage\n+--include=<resource type>` to migrate a resource type. The **migrator worker**\n+uses API chunking to retrieve partial lists of a resource type and thus can\n+migrate a small chunk at a time. It stores the [continue token] in the owner\n+`migration.status.continueToken`. With the inconsistent continue token\n+introduced in [#67284][], the **migrator worker** does not need to worry about\n+expired continue token.\n+\n+[list]:https://github.com/openshift/origin/blob/2a8633598ef0dcfa4589d1e9e944447373ac00d7/pkg/oc/cli/admin/migrate/storage/storage.go#L120-L184\n+[workqueue]:https://github.com/kubernetes/client-go/tree/master/util/workqueue\n+[#67284]:https://github.com/kubernetes/kubernetes/pull/67284\n+[API section]:#alpha-api\n+\n+The cluster admin can run the `kubectl get migrations -o\n+jsonpath=\"{.status.completed}\"` to see if all migrations have completed.\n+\n+We will support a `kube-migrator migrate --resources=<list of resources>`\n+command. It (re)creates `migration` CRs for the resources to trigger their\n+migration. This command facilitates manually migrating custom resources and\n+aggregated resources.\n+\n+### Alpha API\n+\n+We introduce the `migration` API to record the intention and the progress of a\n+migration. The API will be a CRD defined in the `migration.k8s.io` group.\n+\n+Read the [workflow section][] to understand how the API is used.\n+\n+```golang\n+type StorageVersionMigration struct {\n+  metav1.TypeMeta\n+  // metadata.name should be \"<resource>.<group>\" of the resource being\n+  // migrated.\n+  // Because resouces can be served at different groups, in the future version,\n+  // metadata.name can be hash(etcd instance, etcd path prefix).\n+  metav1.ObjectMeta\n+  Spec StorageVersionMigrationSpec\n+  Status StorageVersionMigrationStatus\n+}\n+\n+type StorageVersionMigrationSpec {\n+  // Resource is the resource that is being migrated. The migrator sends\n+  // requests to the endpoint serving the Resource.\n+  // Immutable.","path":"keps/sig-api-machinery/storage-migration.md","position":156,"original_position":156,"commit_id":"f30c85f65bbcdff670d2a992781e425ef143d3fd","original_commit_id":"f30c85f65bbcdff670d2a992781e425ef143d3fd","user":{"login":"caesarxuchao","id":2823529,"node_id":"MDQ6VXNlcjI4MjM1Mjk=","avatar_url":"https://avatars2.githubusercontent.com/u/2823529?v=4","gravatar_id":"","url":"https://api.github.com/users/caesarxuchao","html_url":"https://github.com/caesarxuchao","followers_url":"https://api.github.com/users/caesarxuchao/followers","following_url":"https://api.github.com/users/caesarxuchao/following{/other_user}","gists_url":"https://api.github.com/users/caesarxuchao/gists{/gist_id}","starred_url":"https://api.github.com/users/caesarxuchao/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/caesarxuchao/subscriptions","organizations_url":"https://api.github.com/users/caesarxuchao/orgs","repos_url":"https://api.github.com/users/caesarxuchao/repos","events_url":"https://api.github.com/users/caesarxuchao/events{/privacy}","received_events_url":"https://api.github.com/users/caesarxuchao/received_events","type":"User","site_admin":false},"body":"I'm thinking in the future we will add a mutable field to this spec, like `targetStorageVersion(Hash)`, then the spec will be changing.\r\n\r\nMy concern with a `Reason string` field is it's too loose. User might edit the `Reason` and inadvertently triggered a new round of migration.\r\n\r\nCan the external system to be triggered by the `migration.status.conditions == proposed`?","created_at":"2018-10-02T20:27:42Z","updated_at":"2018-10-02T20:27:42Z","html_url":"https://github.com/kubernetes/community/pull/2524#discussion_r222099908","pull_request_url":"https://api.github.com/repos/kubernetes/community/pulls/2524","author_association":"MEMBER","_links":{"self":{"href":"https://api.github.com/repos/kubernetes/community/pulls/comments/222099908"},"html":{"href":"https://github.com/kubernetes/community/pull/2524#discussion_r222099908"},"pull_request":{"href":"https://api.github.com/repos/kubernetes/community/pulls/2524"}},"in_reply_to_id":222049630},"pull_request":{"url":"https://api.github.com/repos/kubernetes/community/pulls/2524","id":208042263,"node_id":"MDExOlB1bGxSZXF1ZXN0MjA4MDQyMjYz","html_url":"https://github.com/kubernetes/community/pull/2524","diff_url":"https://github.com/kubernetes/community/pull/2524.diff","patch_url":"https://github.com/kubernetes/community/pull/2524.patch","issue_url":"https://api.github.com/repos/kubernetes/community/issues/2524","number":2524,"state":"open","locked":false,"title":"[KEP] storage api version migration","user":{"login":"caesarxuchao","id":2823529,"node_id":"MDQ6VXNlcjI4MjM1Mjk=","avatar_url":"https://avatars2.githubusercontent.com/u/2823529?v=4","gravatar_id":"","url":"https://api.github.com/users/caesarxuchao","html_url":"https://github.com/caesarxuchao","followers_url":"https://api.github.com/users/caesarxuchao/followers","following_url":"https://api.github.com/users/caesarxuchao/following{/other_user}","gists_url":"https://api.github.com/users/caesarxuchao/gists{/gist_id}","starred_url":"https://api.github.com/users/caesarxuchao/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/caesarxuchao/subscriptions","organizations_url":"https://api.github.com/users/caesarxuchao/orgs","repos_url":"https://api.github.com/users/caesarxuchao/repos","events_url":"https://api.github.com/users/caesarxuchao/events{/privacy}","received_events_url":"https://api.github.com/users/caesarxuchao/received_events","type":"User","site_admin":false},"body":"This KEP proposes a tool that migrates the stored data in etcd to the latest storage version. The KEP is based on the [doc](https://docs.google.com/document/d/16HWEjqnlEc2PJnS4D7TVbHoNyVlyWpjx0zRsFNyxDsI/edit#heading=h.fap52hhsdgdt) which was discussed in the Aug. 1, 2018 sig apimachinery meeting. The KEP added more details on the tool's workflow and development timeline.\r\n\r\n/sig api-machinery\r\n/assign @lavalamp @deads2k \r\n\r\nFor my own record, archived versions of this KEP:\r\n* https://github.com/caesarxuchao/community/tree/storage-with-two-triggering-options.","created_at":"2018-08-13T17:03:04Z","updated_at":"2018-10-02T20:27:42Z","closed_at":null,"merged_at":null,"merge_commit_sha":"5aacf0b54974669a4671d933206a28d9fc79140f","assignee":{"login":"lavalamp","id":647318,"node_id":"MDQ6VXNlcjY0NzMxOA==","avatar_url":"https://avatars0.githubusercontent.com/u/647318?v=4","gravatar_id":"","url":"https://api.github.com/users/lavalamp","html_url":"https://github.com/lavalamp","followers_url":"https://api.github.com/users/lavalamp/followers","following_url":"https://api.github.com/users/lavalamp/following{/other_user}","gists_url":"https://api.github.com/users/lavalamp/gists{/gist_id}","starred_url":"https://api.github.com/users/lavalamp/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/lavalamp/subscriptions","organizations_url":"https://api.github.com/users/lavalamp/orgs","repos_url":"https://api.github.com/users/lavalamp/repos","events_url":"https://api.github.com/users/lavalamp/events{/privacy}","received_events_url":"https://api.github.com/users/lavalamp/received_events","type":"User","site_admin":false},"assignees":[{"login":"lavalamp","id":647318,"node_id":"MDQ6VXNlcjY0NzMxOA==","avatar_url":"https://avatars0.githubusercontent.com/u/647318?v=4","gravatar_id":"","url":"https://api.github.com/users/lavalamp","html_url":"https://github.com/lavalamp","followers_url":"https://api.github.com/users/lavalamp/followers","following_url":"https://api.github.com/users/lavalamp/following{/other_user}","gists_url":"https://api.github.com/users/lavalamp/gists{/gist_id}","starred_url":"https://api.github.com/users/lavalamp/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/lavalamp/subscriptions","organizations_url":"https://api.github.com/users/lavalamp/orgs","repos_url":"https://api.github.com/users/lavalamp/repos","events_url":"https://api.github.com/users/lavalamp/events{/privacy}","received_events_url":"https://api.github.com/users/lavalamp/received_events","type":"User","site_admin":false},{"login":"deads2k","id":8225098,"node_id":"MDQ6VXNlcjgyMjUwOTg=","avatar_url":"https://avatars0.githubusercontent.com/u/8225098?v=4","gravatar_id":"","url":"https://api.github.com/users/deads2k","html_url":"https://github.com/deads2k","followers_url":"https://api.github.com/users/deads2k/followers","following_url":"https://api.github.com/users/deads2k/following{/other_user}","gists_url":"https://api.github.com/users/deads2k/gists{/gist_id}","starred_url":"https://api.github.com/users/deads2k/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/deads2k/subscriptions","organizations_url":"https://api.github.com/users/deads2k/orgs","repos_url":"https://api.github.com/users/deads2k/repos","events_url":"https://api.github.com/users/deads2k/events{/privacy}","received_events_url":"https://api.github.com/users/deads2k/received_events","type":"User","site_admin":false},{"login":"yliaog","id":32884155,"node_id":"MDQ6VXNlcjMyODg0MTU1","avatar_url":"https://avatars0.githubusercontent.com/u/32884155?v=4","gravatar_id":"","url":"https://api.github.com/users/yliaog","html_url":"https://github.com/yliaog","followers_url":"https://api.github.com/users/yliaog/followers","following_url":"https://api.github.com/users/yliaog/following{/other_user}","gists_url":"https://api.github.com/users/yliaog/gists{/gist_id}","starred_url":"https://api.github.com/users/yliaog/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/yliaog/subscriptions","organizations_url":"https://api.github.com/users/yliaog/orgs","repos_url":"https://api.github.com/users/yliaog/repos","events_url":"https://api.github.com/users/yliaog/events{/privacy}","received_events_url":"https://api.github.com/users/yliaog/received_events","type":"User","site_admin":false}],"requested_reviewers":[],"requested_teams":[],"labels":[{"id":486032367,"node_id":"MDU6TGFiZWw0ODYwMzIzNjc=","url":"https://api.github.com/repos/kubernetes/community/labels/cncf-cla:%20yes","name":"cncf-cla: yes","color":"bfe5bf","default":false},{"id":653942861,"node_id":"MDU6TGFiZWw2NTM5NDI4NjE=","url":"https://api.github.com/repos/kubernetes/community/labels/sig/api-machinery","name":"sig/api-machinery","color":"d2b48c","default":false},{"id":653942863,"node_id":"MDU6TGFiZWw2NTM5NDI4NjM=","url":"https://api.github.com/repos/kubernetes/community/labels/sig/architecture","name":"sig/architecture","color":"d2b48c","default":false},{"id":653942910,"node_id":"MDU6TGFiZWw2NTM5NDI5MTA=","url":"https://api.github.com/repos/kubernetes/community/labels/size/L","name":"size/L","color":"ee9900","default":false}],"milestone":null,"commits_url":"https://api.github.com/repos/kubernetes/community/pulls/2524/commits","review_comments_url":"https://api.github.com/repos/kubernetes/community/pulls/2524/comments","review_comment_url":"https://api.github.com/repos/kubernetes/community/pulls/comments{/number}","comments_url":"https://api.github.com/repos/kubernetes/community/issues/2524/comments","statuses_url":"https://api.github.com/repos/kubernetes/community/statuses/f30c85f65bbcdff670d2a992781e425ef143d3fd","head":{"label":"caesarxuchao:storage","ref":"storage","sha":"f30c85f65bbcdff670d2a992781e425ef143d3fd","user":{"login":"caesarxuchao","id":2823529,"node_id":"MDQ6VXNlcjI4MjM1Mjk=","avatar_url":"https://avatars2.githubusercontent.com/u/2823529?v=4","gravatar_id":"","url":"https://api.github.com/users/caesarxuchao","html_url":"https://github.com/caesarxuchao","followers_url":"https://api.github.com/users/caesarxuchao/followers","following_url":"https://api.github.com/users/caesarxuchao/following{/other_user}","gists_url":"https://api.github.com/users/caesarxuchao/gists{/gist_id}","starred_url":"https://api.github.com/users/caesarxuchao/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/caesarxuchao/subscriptions","organizations_url":"https://api.github.com/users/caesarxuchao/orgs","repos_url":"https://api.github.com/users/caesarxuchao/repos","events_url":"https://api.github.com/users/caesarxuchao/events{/privacy}","received_events_url":"https://api.github.com/users/caesarxuchao/received_events","type":"User","site_admin":false},"repo":{"id":76486227,"node_id":"MDEwOlJlcG9zaXRvcnk3NjQ4NjIyNw==","name":"community","full_name":"caesarxuchao/community","private":false,"owner":{"login":"caesarxuchao","id":2823529,"node_id":"MDQ6VXNlcjI4MjM1Mjk=","avatar_url":"https://avatars2.githubusercontent.com/u/2823529?v=4","gravatar_id":"","url":"https://api.github.com/users/caesarxuchao","html_url":"https://github.com/caesarxuchao","followers_url":"https://api.github.com/users/caesarxuchao/followers","following_url":"https://api.github.com/users/caesarxuchao/following{/other_user}","gists_url":"https://api.github.com/users/caesarxuchao/gists{/gist_id}","starred_url":"https://api.github.com/users/caesarxuchao/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/caesarxuchao/subscriptions","organizations_url":"https://api.github.com/users/caesarxuchao/orgs","repos_url":"https://api.github.com/users/caesarxuchao/repos","events_url":"https://api.github.com/users/caesarxuchao/events{/privacy}","received_events_url":"https://api.github.com/users/caesarxuchao/received_events","type":"User","site_admin":false},"html_url":"https://github.com/caesarxuchao/community","description":"Kubernetes community content","fork":true,"url":"https://api.github.com/repos/caesarxuchao/community","forks_url":"https://api.github.com/repos/caesarxuchao/community/forks","keys_url":"https://api.github.com/repos/caesarxuchao/community/keys{/key_id}","collaborators_url":"https://api.github.com/repos/caesarxuchao/community/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/caesarxuchao/community/teams","hooks_url":"https://api.github.com/repos/caesarxuchao/community/hooks","issue_events_url":"https://api.github.com/repos/caesarxuchao/community/issues/events{/number}","events_url":"https://api.github.com/repos/caesarxuchao/community/events","assignees_url":"https://api.github.com/repos/caesarxuchao/community/assignees{/user}","branches_url":"https://api.github.com/repos/caesarxuchao/community/branches{/branch}","tags_url":"https://api.github.com/repos/caesarxuchao/community/tags","blobs_url":"https://api.github.com/repos/caesarxuchao/community/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/caesarxuchao/community/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/caesarxuchao/community/git/refs{/sha}","trees_url":"https://api.github.com/repos/caesarxuchao/community/git/trees{/sha}","statuses_url":"https://api.github.com/repos/caesarxuchao/community/statuses/{sha}","languages_url":"https://api.github.com/repos/caesarxuchao/community/languages","stargazers_url":"https://api.github.com/repos/caesarxuchao/community/stargazers","contributors_url":"https://api.github.com/repos/caesarxuchao/community/contributors","subscribers_url":"https://api.github.com/repos/caesarxuchao/community/subscribers","subscription_url":"https://api.github.com/repos/caesarxuchao/community/subscription","commits_url":"https://api.github.com/repos/caesarxuchao/community/commits{/sha}","git_commits_url":"https://api.github.com/repos/caesarxuchao/community/git/commits{/sha}","comments_url":"https://api.github.com/repos/caesarxuchao/community/comments{/number}","issue_comment_url":"https://api.github.com/repos/caesarxuchao/community/issues/comments{/number}","contents_url":"https://api.github.com/repos/caesarxuchao/community/contents/{+path}","compare_url":"https://api.github.com/repos/caesarxuchao/community/compare/{base}...{head}","merges_url":"https://api.github.com/repos/caesarxuchao/community/merges","archive_url":"https://api.github.com/repos/caesarxuchao/community/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/caesarxuchao/community/downloads","issues_url":"https://api.github.com/repos/caesarxuchao/community/issues{/number}","pulls_url":"https://api.github.com/repos/caesarxuchao/community/pulls{/number}","milestones_url":"https://api.github.com/repos/caesarxuchao/community/milestones{/number}","notifications_url":"https://api.github.com/repos/caesarxuchao/community/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/caesarxuchao/community/labels{/name}","releases_url":"https://api.github.com/repos/caesarxuchao/community/releases{/id}","deployments_url":"https://api.github.com/repos/caesarxuchao/community/deployments","created_at":"2016-12-14T18:31:22Z","updated_at":"2016-12-14T18:31:24Z","pushed_at":"2018-09-28T19:57:39Z","git_url":"git://github.com/caesarxuchao/community.git","ssh_url":"git@github.com:caesarxuchao/community.git","clone_url":"https://github.com/caesarxuchao/community.git","svn_url":"https://github.com/caesarxuchao/community","homepage":"","size":29813,"stargazers_count":0,"watchers_count":0,"language":"Makefile","has_issues":false,"has_projects":true,"has_downloads":true,"has_wiki":true,"has_pages":false,"forks_count":1,"mirror_url":null,"archived":false,"open_issues_count":0,"license":{"key":"apache-2.0","name":"Apache License 2.0","spdx_id":"Apache-2.0","url":"https://api.github.com/licenses/apache-2.0","node_id":"MDc6TGljZW5zZTI="},"forks":1,"open_issues":0,"watchers":0,"default_branch":"master"}},"base":{"label":"kubernetes:master","ref":"master","sha":"12247ef3641c1f7845193f634ff4f16dceff3803","user":{"login":"kubernetes","id":13629408,"node_id":"MDEyOk9yZ2FuaXphdGlvbjEzNjI5NDA4","avatar_url":"https://avatars2.githubusercontent.com/u/13629408?v=4","gravatar_id":"","url":"https://api.github.com/users/kubernetes","html_url":"https://github.com/kubernetes","followers_url":"https://api.github.com/users/kubernetes/followers","following_url":"https://api.github.com/users/kubernetes/following{/other_user}","gists_url":"https://api.github.com/users/kubernetes/gists{/gist_id}","starred_url":"https://api.github.com/users/kubernetes/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/kubernetes/subscriptions","organizations_url":"https://api.github.com/users/kubernetes/orgs","repos_url":"https://api.github.com/users/kubernetes/repos","events_url":"https://api.github.com/users/kubernetes/events{/privacy}","received_events_url":"https://api.github.com/users/kubernetes/received_events","type":"Organization","site_admin":false},"repo":{"id":57939112,"node_id":"MDEwOlJlcG9zaXRvcnk1NzkzOTExMg==","name":"community","full_name":"kubernetes/community","private":false,"owner":{"login":"kubernetes","id":13629408,"node_id":"MDEyOk9yZ2FuaXphdGlvbjEzNjI5NDA4","avatar_url":"https://avatars2.githubusercontent.com/u/13629408?v=4","gravatar_id":"","url":"https://api.github.com/users/kubernetes","html_url":"https://github.com/kubernetes","followers_url":"https://api.github.com/users/kubernetes/followers","following_url":"https://api.github.com/users/kubernetes/following{/other_user}","gists_url":"https://api.github.com/users/kubernetes/gists{/gist_id}","starred_url":"https://api.github.com/users/kubernetes/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/kubernetes/subscriptions","organizations_url":"https://api.github.com/users/kubernetes/orgs","repos_url":"https://api.github.com/users/kubernetes/repos","events_url":"https://api.github.com/users/kubernetes/events{/privacy}","received_events_url":"https://api.github.com/users/kubernetes/received_events","type":"Organization","site_admin":false},"html_url":"https://github.com/kubernetes/community","description":"Kubernetes community content","fork":false,"url":"https://api.github.com/repos/kubernetes/community","forks_url":"https://api.github.com/repos/kubernetes/community/forks","keys_url":"https://api.github.com/repos/kubernetes/community/keys{/key_id}","collaborators_url":"https://api.github.com/repos/kubernetes/community/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/kubernetes/community/teams","hooks_url":"https://api.github.com/repos/kubernetes/community/hooks","issue_events_url":"https://api.github.com/repos/kubernetes/community/issues/events{/number}","events_url":"https://api.github.com/repos/kubernetes/community/events","assignees_url":"https://api.github.com/repos/kubernetes/community/assignees{/user}","branches_url":"https://api.github.com/repos/kubernetes/community/branches{/branch}","tags_url":"https://api.github.com/repos/kubernetes/community/tags","blobs_url":"https://api.github.com/repos/kubernetes/community/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/kubernetes/community/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/kubernetes/community/git/refs{/sha}","trees_url":"https://api.github.com/repos/kubernetes/community/git/trees{/sha}","statuses_url":"https://api.github.com/repos/kubernetes/community/statuses/{sha}","languages_url":"https://api.github.com/repos/kubernetes/community/languages","stargazers_url":"https://api.github.com/repos/kubernetes/community/stargazers","contributors_url":"https://api.github.com/repos/kubernetes/community/contributors","subscribers_url":"https://api.github.com/repos/kubernetes/community/subscribers","subscription_url":"https://api.github.com/repos/kubernetes/community/subscription","commits_url":"https://api.github.com/repos/kubernetes/community/commits{/sha}","git_commits_url":"https://api.github.com/repos/kubernetes/community/git/commits{/sha}","comments_url":"https://api.github.com/repos/kubernetes/community/comments{/number}","issue_comment_url":"https://api.github.com/repos/kubernetes/community/issues/comments{/number}","contents_url":"https://api.github.com/repos/kubernetes/community/contents/{+path}","compare_url":"https://api.github.com/repos/kubernetes/community/compare/{base}...{head}","merges_url":"https://api.github.com/repos/kubernetes/community/merges","archive_url":"https://api.github.com/repos/kubernetes/community/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/kubernetes/community/downloads","issues_url":"https://api.github.com/repos/kubernetes/community/issues{/number}","pulls_url":"https://api.github.com/repos/kubernetes/community/pulls{/number}","milestones_url":"https://api.github.com/repos/kubernetes/community/milestones{/number}","notifications_url":"https://api.github.com/repos/kubernetes/community/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/kubernetes/community/labels{/name}","releases_url":"https://api.github.com/repos/kubernetes/community/releases{/id}","deployments_url":"https://api.github.com/repos/kubernetes/community/deployments","created_at":"2016-05-03T03:36:05Z","updated_at":"2018-10-02T19:36:36Z","pushed_at":"2018-10-02T19:36:19Z","git_url":"git://github.com/kubernetes/community.git","ssh_url":"git@github.com:kubernetes/community.git","clone_url":"https://github.com/kubernetes/community.git","svn_url":"https://github.com/kubernetes/community","homepage":"","size":32307,"stargazers_count":2563,"watchers_count":2563,"language":"Go","has_issues":true,"has_projects":true,"has_downloads":true,"has_wiki":false,"has_pages":false,"forks_count":1481,"mirror_url":null,"archived":false,"open_issues_count":222,"license":{"key":"apache-2.0","name":"Apache License 2.0","spdx_id":"Apache-2.0","url":"https://api.github.com/licenses/apache-2.0","node_id":"MDc6TGljZW5zZTI="},"forks":1481,"open_issues":222,"watchers":2563,"default_branch":"master"}},"_links":{"self":{"href":"https://api.github.com/repos/kubernetes/community/pulls/2524"},"html":{"href":"https://github.com/kubernetes/community/pull/2524"},"issue":{"href":"https://api.github.com/repos/kubernetes/community/issues/2524"},"comments":{"href":"https://api.github.com/repos/kubernetes/community/issues/2524/comments"},"review_comments":{"href":"https://api.github.com/repos/kubernetes/community/pulls/2524/comments"},"review_comment":{"href":"https://api.github.com/repos/kubernetes/community/pulls/comments{/number}"},"commits":{"href":"https://api.github.com/repos/kubernetes/community/pulls/2524/commits"},"statuses":{"href":"https://api.github.com/repos/kubernetes/community/statuses/f30c85f65bbcdff670d2a992781e425ef143d3fd"}},"author_association":"MEMBER"}}
{"actor":{"display_login":"caesarxuchao"}}