{"action":"created","issue":{"url":"https://api.github.com/repos/apache/spark/issues/14147","repository_url":"https://api.github.com/repos/apache/spark","labels_url":"https://api.github.com/repos/apache/spark/issues/14147/labels{/name}","comments_url":"https://api.github.com/repos/apache/spark/issues/14147/comments","events_url":"https://api.github.com/repos/apache/spark/issues/14147/events","html_url":"https://github.com/apache/spark/pull/14147","id":164976134,"number":14147,"title":"[SPARK-14812][ML][MLLIB][PYTHON] Experimental, DeveloperApi annotation audit for ML","user":{"login":"jkbradley","id":5084283,"avatar_url":"https://avatars.githubusercontent.com/u/5084283?v=3","gravatar_id":"","url":"https://api.github.com/users/jkbradley","html_url":"https://github.com/jkbradley","followers_url":"https://api.github.com/users/jkbradley/followers","following_url":"https://api.github.com/users/jkbradley/following{/other_user}","gists_url":"https://api.github.com/users/jkbradley/gists{/gist_id}","starred_url":"https://api.github.com/users/jkbradley/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jkbradley/subscriptions","organizations_url":"https://api.github.com/users/jkbradley/orgs","repos_url":"https://api.github.com/users/jkbradley/repos","events_url":"https://api.github.com/users/jkbradley/events{/privacy}","received_events_url":"https://api.github.com/users/jkbradley/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":8,"created_at":"2016-07-12T01:41:28Z","updated_at":"2016-07-13T19:33:04Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/apache/spark/pulls/14147","html_url":"https://github.com/apache/spark/pull/14147","diff_url":"https://github.com/apache/spark/pull/14147.diff","patch_url":"https://github.com/apache/spark/pull/14147.patch"},"body":"## What changes were proposed in this pull request?\r\n\r\nGeneral decisions to follow, except where noted:\r\n* spark.mllib, pyspark.mllib: Remove all Experimental annotations.  Leave DeveloperApi annotations alone.\r\n* spark.ml, pyspark.ml\r\n** Annotate Estimator-Model pairs of classes and companion objects the same way.\r\n** For all algorithms marked Experimental with Since tag <= 1.6, remove Experimental annotation.\r\n** For all algorithms marked Experimental with Since tag = 2.0, leave Experimental annotation.\r\n* DeveloperApi annotations are left alone, except where noted.\r\n* No changes to which types are sealed.\r\n\r\nExceptions where I am leaving items Experimental in spark.ml, pyspark.ml, mainly because the items are new:\r\n* Model Summary classes\r\n* MLWriter, MLReader, MLWritable, MLReadable\r\n* Evaluator and subclasses: There is discussion of changes around evaluating multiple metrics at once for efficiency.\r\n* RFormula: Its behavior may need to change slightly to match R in edge cases.\r\n* AFTSurvivalRegression\r\n* MultilayerPerceptronClassifier\r\n\r\nDeveloperApi changes:\r\n* ml.tree.Node, ml.tree.Split, and subclasses should no longer be DeveloperApi\r\n\r\n## How was this patch tested?\r\n\r\nN/A\r\n\r\nNote to reviewers:\r\n* spark.ml.clustering.LDA underwent significant changes (additional methods), so let me know if you want me to leave it Experimental.\r\n* Be careful to check for cases where a class should no longer be Experimental but has an Experimental method, val, or other feature.  I did not find such cases, but please verify.\r\n"},"comment":{"url":"https://api.github.com/repos/apache/spark/issues/comments/232462256","html_url":"https://github.com/apache/spark/pull/14147#issuecomment-232462256","issue_url":"https://api.github.com/repos/apache/spark/issues/14147","id":232462256,"user":{"login":"jkbradley","id":5084283,"avatar_url":"https://avatars.githubusercontent.com/u/5084283?v=3","gravatar_id":"","url":"https://api.github.com/users/jkbradley","html_url":"https://github.com/jkbradley","followers_url":"https://api.github.com/users/jkbradley/followers","following_url":"https://api.github.com/users/jkbradley/following{/other_user}","gists_url":"https://api.github.com/users/jkbradley/gists{/gist_id}","starred_url":"https://api.github.com/users/jkbradley/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jkbradley/subscriptions","organizations_url":"https://api.github.com/users/jkbradley/orgs","repos_url":"https://api.github.com/users/jkbradley/repos","events_url":"https://api.github.com/users/jkbradley/events{/privacy}","received_events_url":"https://api.github.com/users/jkbradley/received_events","type":"User","site_admin":false},"created_at":"2016-07-13T19:33:04Z","updated_at":"2016-07-13T19:33:04Z","body":"Merging with master and branch-2.0"}}
{"actor":{"display_login":"jkbradley"}}