{"action":"created","issue":{"url":"https://api.github.com/repos/apache/spark/issues/11423","repository_url":"https://api.github.com/repos/apache/spark","labels_url":"https://api.github.com/repos/apache/spark/issues/11423/labels{/name}","comments_url":"https://api.github.com/repos/apache/spark/issues/11423/comments","events_url":"https://api.github.com/repos/apache/spark/issues/11423/events","html_url":"https://github.com/apache/spark/pull/11423","id":137152065,"number":11423,"title":"[SPARK-13398][STREAMING] Move away from thread pool task support java forkjoin","user":{"login":"holdenk","id":59893,"avatar_url":"https://avatars.githubusercontent.com/u/59893?v=3","gravatar_id":"","url":"https://api.github.com/users/holdenk","html_url":"https://github.com/holdenk","followers_url":"https://api.github.com/users/holdenk/followers","following_url":"https://api.github.com/users/holdenk/following{/other_user}","gists_url":"https://api.github.com/users/holdenk/gists{/gist_id}","starred_url":"https://api.github.com/users/holdenk/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/holdenk/subscriptions","organizations_url":"https://api.github.com/users/holdenk/orgs","repos_url":"https://api.github.com/users/holdenk/repos","events_url":"https://api.github.com/users/holdenk/events{/privacy}","received_events_url":"https://api.github.com/users/holdenk/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":7,"created_at":"2016-02-29T05:05:41Z","updated_at":"2016-03-01T13:42:01Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/apache/spark/pulls/11423","html_url":"https://github.com/apache/spark/pull/11423","diff_url":"https://github.com/apache/spark/pull/11423.diff","patch_url":"https://github.com/apache/spark/pull/11423.patch"},"body":"## What changes were proposed in this pull request?\r\n\r\nRemove old deprecated ThreadPoolExecutor and replace with ExecutionContext using a ForkJoinPool. The downside of this is that scala's ForkJoinPool doesn't give us a way to specify the thread pool name (and is also deprecated in 2.12). We can use the Java version of ForkJoinPool instead, although we need supply the custom factory instead. One other implicit change that happens is the old ExecutionContext would have reported a different default parallelism since it used system parallelism rather than threadpool parallelism (this was likely not intended but also likely not a huge difference).\r\n\r\nThe previous version of this PR attempted to use an execution context constructed on the ThreadPool (but not the deprecated ThreadPoolExecutor class) so as to keep the ability to have human readable named threads but this reported system parallelism.\r\n\r\n## How was this patch tested?\r\n\r\nunit tests: streaming/testOnly org.apache.spark.streaming.util.*\r\n"},"comment":{"url":"https://api.github.com/repos/apache/spark/issues/comments/190728042","html_url":"https://github.com/apache/spark/pull/11423#issuecomment-190728042","issue_url":"https://api.github.com/repos/apache/spark/issues/11423","id":190728042,"user":{"login":"AmplabJenkins","id":4031291,"avatar_url":"https://avatars.githubusercontent.com/u/4031291?v=3","gravatar_id":"","url":"https://api.github.com/users/AmplabJenkins","html_url":"https://github.com/AmplabJenkins","followers_url":"https://api.github.com/users/AmplabJenkins/followers","following_url":"https://api.github.com/users/AmplabJenkins/following{/other_user}","gists_url":"https://api.github.com/users/AmplabJenkins/gists{/gist_id}","starred_url":"https://api.github.com/users/AmplabJenkins/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/AmplabJenkins/subscriptions","organizations_url":"https://api.github.com/users/AmplabJenkins/orgs","repos_url":"https://api.github.com/users/AmplabJenkins/repos","events_url":"https://api.github.com/users/AmplabJenkins/events{/privacy}","received_events_url":"https://api.github.com/users/AmplabJenkins/received_events","type":"User","site_admin":false},"created_at":"2016-03-01T13:42:01Z","updated_at":"2016-03-01T13:42:01Z","body":"Merged build finished. Test FAILed."}}