{"action":"created","issue":{"url":"https://api.github.com/repos/apache/spark/issues/14886","repository_url":"https://api.github.com/repos/apache/spark","labels_url":"https://api.github.com/repos/apache/spark/issues/14886/labels{/name}","comments_url":"https://api.github.com/repos/apache/spark/issues/14886/comments","events_url":"https://api.github.com/repos/apache/spark/issues/14886/events","html_url":"https://github.com/apache/spark/pull/14886","id":174136529,"number":14886,"title":"[SPARK-17243] [Web UI] Spark 2.0 History Server won't load with very large application history","user":{"login":"ajbozarth","id":13952758,"avatar_url":"https://avatars.githubusercontent.com/u/13952758?v=3","gravatar_id":"","url":"https://api.github.com/users/ajbozarth","html_url":"https://github.com/ajbozarth","followers_url":"https://api.github.com/users/ajbozarth/followers","following_url":"https://api.github.com/users/ajbozarth/following{/other_user}","gists_url":"https://api.github.com/users/ajbozarth/gists{/gist_id}","starred_url":"https://api.github.com/users/ajbozarth/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ajbozarth/subscriptions","organizations_url":"https://api.github.com/users/ajbozarth/orgs","repos_url":"https://api.github.com/users/ajbozarth/repos","events_url":"https://api.github.com/users/ajbozarth/events{/privacy}","received_events_url":"https://api.github.com/users/ajbozarth/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":2,"created_at":"2016-08-30T21:58:25Z","updated_at":"2016-08-30T22:02:40Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/apache/spark/pulls/14886","html_url":"https://github.com/apache/spark/pull/14886","diff_url":"https://github.com/apache/spark/pull/14886.diff","patch_url":"https://github.com/apache/spark/pull/14886.patch"},"body":"## What changes were proposed in this pull request?\r\n\r\nback port of #14835 addressing merge conflicts\r\n\r\nWith the new History Server the summary page loads the application list via the the REST API, this makes it very slow to impossible to load with large (10K+) application history. This pr fixes this by adding the `spark.history.ui.maxApplications` conf to limit the number of applications the History Server displays. This is accomplished using a new optional `limit` param for the `applications` api. (Note this only applies to what the summary page displays, all the Application UI's are still accessible if the user knows the App ID and goes to the Application UI directly.)\r\n\r\nI've also added a new test for the `limit` param in `HistoryServerSuite.scala`\r\n\r\n## How was this patch tested?\r\n\r\nManual testing and dev/run-tests"},"comment":{"url":"https://api.github.com/repos/apache/spark/issues/comments/243595861","html_url":"https://github.com/apache/spark/pull/14886#issuecomment-243595861","issue_url":"https://api.github.com/repos/apache/spark/issues/14886","id":243595861,"user":{"login":"SparkQA","id":8108735,"avatar_url":"https://avatars.githubusercontent.com/u/8108735?v=3","gravatar_id":"","url":"https://api.github.com/users/SparkQA","html_url":"https://github.com/SparkQA","followers_url":"https://api.github.com/users/SparkQA/followers","following_url":"https://api.github.com/users/SparkQA/following{/other_user}","gists_url":"https://api.github.com/users/SparkQA/gists{/gist_id}","starred_url":"https://api.github.com/users/SparkQA/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/SparkQA/subscriptions","organizations_url":"https://api.github.com/users/SparkQA/orgs","repos_url":"https://api.github.com/users/SparkQA/repos","events_url":"https://api.github.com/users/SparkQA/events{/privacy}","received_events_url":"https://api.github.com/users/SparkQA/received_events","type":"User","site_admin":false},"created_at":"2016-08-30T22:02:40Z","updated_at":"2016-08-30T22:02:40Z","body":"**[Test build #64675 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64675/consoleFull)** for PR 14886 at commit [`22ddf01`](https://github.com/apache/spark/commit/22ddf01727afa9cf57456c9f198a2bdbd9f1b028)."}}
{"actor":{"display_login":"SparkQA"}}