{"action":"created","issue":{"url":"https://api.github.com/repos/kubeflow/kubeflow/issues/1583","repository_url":"https://api.github.com/repos/kubeflow/kubeflow","labels_url":"https://api.github.com/repos/kubeflow/kubeflow/issues/1583/labels{/name}","comments_url":"https://api.github.com/repos/kubeflow/kubeflow/issues/1583/comments","events_url":"https://api.github.com/repos/kubeflow/kubeflow/issues/1583/events","html_url":"https://github.com/kubeflow/kubeflow/issues/1583","id":361976444,"node_id":"MDU6SXNzdWUzNjE5NzY0NDQ=","number":1583,"title":"Use Flink to provide an alternative runner for TFX","user":{"login":"jlewi","id":777219,"node_id":"MDQ6VXNlcjc3NzIxOQ==","avatar_url":"https://avatars3.githubusercontent.com/u/777219?v=4","gravatar_id":"","url":"https://api.github.com/users/jlewi","html_url":"https://github.com/jlewi","followers_url":"https://api.github.com/users/jlewi/followers","following_url":"https://api.github.com/users/jlewi/following{/other_user}","gists_url":"https://api.github.com/users/jlewi/gists{/gist_id}","starred_url":"https://api.github.com/users/jlewi/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jlewi/subscriptions","organizations_url":"https://api.github.com/users/jlewi/orgs","repos_url":"https://api.github.com/users/jlewi/repos","events_url":"https://api.github.com/users/jlewi/events{/privacy}","received_events_url":"https://api.github.com/users/jlewi/received_events","type":"User","site_admin":false},"labels":[{"id":1053592615,"node_id":"MDU6TGFiZWwxMDUzNTkyNjE1","url":"https://api.github.com/repos/kubeflow/kubeflow/labels/area/0.4.0","name":"area/0.4.0","color":"ef1ad6","default":false},{"id":984905924,"node_id":"MDU6TGFiZWw5ODQ5MDU5MjQ=","url":"https://api.github.com/repos/kubeflow/kubeflow/labels/area/tfx","name":"area/tfx","color":"612cdd","default":false},{"id":849036167,"node_id":"MDU6TGFiZWw4NDkwMzYxNjc=","url":"https://api.github.com/repos/kubeflow/kubeflow/labels/priority/p2","name":"priority/p2","color":"fc9915","default":false}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":4,"created_at":"2018-09-20T00:39:32Z","updated_at":"2018-10-25T09:03:12Z","closed_at":null,"author_association":"CONTRIBUTOR","body":"I think we will want to use the Flink Beam Runner to provide a distributed runner for TFX.\r\n\r\nNot sure what the ETA is for the Flink beam runner is.\r\n\r\nWe need to figure out what the Flink community is planning w.r.t to Kubernetes; e.g. do they have any plans to provide an operator like the spark operator for running Flink Jobs?"},"comment":{"url":"https://api.github.com/repos/kubeflow/kubeflow/issues/comments/432972447","html_url":"https://github.com/kubeflow/kubeflow/issues/1583#issuecomment-432972447","issue_url":"https://api.github.com/repos/kubeflow/kubeflow/issues/1583","id":432972447,"node_id":"MDEyOklzc3VlQ29tbWVudDQzMjk3MjQ0Nw==","user":{"login":"khsibr","id":1479225,"node_id":"MDQ6VXNlcjE0NzkyMjU=","avatar_url":"https://avatars1.githubusercontent.com/u/1479225?v=4","gravatar_id":"","url":"https://api.github.com/users/khsibr","html_url":"https://github.com/khsibr","followers_url":"https://api.github.com/users/khsibr/followers","following_url":"https://api.github.com/users/khsibr/following{/other_user}","gists_url":"https://api.github.com/users/khsibr/gists{/gist_id}","starred_url":"https://api.github.com/users/khsibr/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/khsibr/subscriptions","organizations_url":"https://api.github.com/users/khsibr/orgs","repos_url":"https://api.github.com/users/khsibr/repos","events_url":"https://api.github.com/users/khsibr/events{/privacy}","received_events_url":"https://api.github.com/users/khsibr/received_events","type":"User","site_admin":false},"created_at":"2018-10-25T09:03:12Z","updated_at":"2018-10-25T09:03:12Z","author_association":"NONE","body":"@jlewi best documentation about Beam capabilities are documented here:\r\nhttps://beam.apache.org/documentation/runners/capability-matrix/\r\nFlink features support is almost complete.\r\n\r\nAFAIK, there is no real time processing concept in Kubeflow. We could create a TFX operator to deploy tf.Transform code to Flink.\r\n\r\nIs TFX serving already implemented?"}}
{"actor":{"display_login":"khsibr"}}