{"action":"created","issue":{"url":"https://api.github.com/repos/databricks/koalas/issues/139","repository_url":"https://api.github.com/repos/databricks/koalas","labels_url":"https://api.github.com/repos/databricks/koalas/issues/139/labels{/name}","comments_url":"https://api.github.com/repos/databricks/koalas/issues/139/comments","events_url":"https://api.github.com/repos/databricks/koalas/issues/139/events","html_url":"https://github.com/databricks/koalas/issues/139","id":435980457,"node_id":"MDU6SXNzdWU0MzU5ODA0NTc=","number":139,"title":"Koalas DataFrame should only have Pandas corresponding APIs (not Spark APIs)","user":{"login":"HyukjinKwon","id":6477701,"node_id":"MDQ6VXNlcjY0Nzc3MDE=","avatar_url":"https://avatars0.githubusercontent.com/u/6477701?v=4","gravatar_id":"","url":"https://api.github.com/users/HyukjinKwon","html_url":"https://github.com/HyukjinKwon","followers_url":"https://api.github.com/users/HyukjinKwon/followers","following_url":"https://api.github.com/users/HyukjinKwon/following{/other_user}","gists_url":"https://api.github.com/users/HyukjinKwon/gists{/gist_id}","starred_url":"https://api.github.com/users/HyukjinKwon/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/HyukjinKwon/subscriptions","organizations_url":"https://api.github.com/users/HyukjinKwon/orgs","repos_url":"https://api.github.com/users/HyukjinKwon/repos","events_url":"https://api.github.com/users/HyukjinKwon/events{/privacy}","received_events_url":"https://api.github.com/users/HyukjinKwon/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":5,"created_at":"2019-04-23T03:21:07Z","updated_at":"2019-04-25T09:23:58Z","closed_at":null,"author_association":"MEMBER","body":"This is partially of https://github.com/databricks/koalas/issues/119\r\n\r\nI was thinking Koalas DataFrame strictly should have Pandas corresponding APIs, although there might be few exceptions with some strong reasons.\r\n\r\nMeaning Koalas DataFrame should not have Spark DataFrame specific APIs like `explain()` or `selectExpr()`. My current thought is we have a API like `koalas_df.to_spark()` (borrowed from @ueshin's idea via offline discussion) so that users can use Spark APIs.\r\n\r\n**Koalas API usages**\r\n\r\n```python\r\nkoalas_df.loc(...)\r\nkoalas_df.drop(...)  # works as Pandas API\r\n```\r\n\r\n**Spark API usages**\r\n\r\n```python\r\nkoalas_df.to_spark().explain()\r\nkoalas_df.to_spark().selectExpr()\r\nkoalas_df.to_spark().drop(...)  # works as Spark API\r\n```\r\n\r\nThis can clearly define what Koalas APIs expect and Spark APIs expect."},"comment":{"url":"https://api.github.com/repos/databricks/koalas/issues/comments/486590139","html_url":"https://github.com/databricks/koalas/issues/139#issuecomment-486590139","issue_url":"https://api.github.com/repos/databricks/koalas/issues/139","id":486590139,"node_id":"MDEyOklzc3VlQ29tbWVudDQ4NjU5MDEzOQ==","user":{"login":"HyukjinKwon","id":6477701,"node_id":"MDQ6VXNlcjY0Nzc3MDE=","avatar_url":"https://avatars0.githubusercontent.com/u/6477701?v=4","gravatar_id":"","url":"https://api.github.com/users/HyukjinKwon","html_url":"https://github.com/HyukjinKwon","followers_url":"https://api.github.com/users/HyukjinKwon/followers","following_url":"https://api.github.com/users/HyukjinKwon/following{/other_user}","gists_url":"https://api.github.com/users/HyukjinKwon/gists{/gist_id}","starred_url":"https://api.github.com/users/HyukjinKwon/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/HyukjinKwon/subscriptions","organizations_url":"https://api.github.com/users/HyukjinKwon/orgs","repos_url":"https://api.github.com/users/HyukjinKwon/repos","events_url":"https://api.github.com/users/HyukjinKwon/events{/privacy}","received_events_url":"https://api.github.com/users/HyukjinKwon/received_events","type":"User","site_admin":false},"created_at":"2019-04-25T09:23:58Z","updated_at":"2019-04-25T09:23:58Z","author_association":"MEMBER","body":"cc @rxin too to collect more feedback."}}
{"actor":{"display_login":"HyukjinKwon"}}