{"action":"created","issue":{"url":"https://api.github.com/repos/apache/beam/issues/5966","repository_url":"https://api.github.com/repos/apache/beam","labels_url":"https://api.github.com/repos/apache/beam/issues/5966/labels{/name}","comments_url":"https://api.github.com/repos/apache/beam/issues/5966/comments","events_url":"https://api.github.com/repos/apache/beam/issues/5966/events","html_url":"https://github.com/apache/beam/pull/5966","id":341964120,"node_id":"MDExOlB1bGxSZXF1ZXN0MjAxOTc2MjI2","number":5966,"title":"[BEAM-4761] Run Nexmark on Dataflow","user":{"login":"apilloud","id":5972627,"node_id":"MDQ6VXNlcjU5NzI2Mjc=","avatar_url":"https://avatars2.githubusercontent.com/u/5972627?v=4","gravatar_id":"","url":"https://api.github.com/users/apilloud","html_url":"https://github.com/apilloud","followers_url":"https://api.github.com/users/apilloud/followers","following_url":"https://api.github.com/users/apilloud/following{/other_user}","gists_url":"https://api.github.com/users/apilloud/gists{/gist_id}","starred_url":"https://api.github.com/users/apilloud/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/apilloud/subscriptions","organizations_url":"https://api.github.com/users/apilloud/orgs","repos_url":"https://api.github.com/users/apilloud/repos","events_url":"https://api.github.com/users/apilloud/events{/privacy}","received_events_url":"https://api.github.com/users/apilloud/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":2,"created_at":"2018-07-17T15:12:32Z","updated_at":"2018-07-17T22:43:27Z","closed_at":null,"author_association":"CONTRIBUTOR","pull_request":{"url":"https://api.github.com/repos/apache/beam/pulls/5966","html_url":"https://github.com/apache/beam/pull/5966","diff_url":"https://github.com/apache/beam/pull/5966.diff","patch_url":"https://github.com/apache/beam/pull/5966.patch"},"body":"This adds a Nexmark postcommit job for Dataflow. \r\n\r\n------------------------\r\n\r\nFollow this checklist to help us incorporate your contribution quickly and easily:\r\n\r\n - [X] Format the pull request title like `[BEAM-XXX] Fixes bug in ApproximateQuantiles`, where you replace `BEAM-XXX` with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue.\r\n - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.pdf).\r\n\r\nIt will help us expedite review of your Pull Request if you tag someone (e.g. `@username`) to look at it.\r\n\r\nPost-Commit Tests Status (on master branch)\r\n------------------------------------------------------------------------------------------------\r\n\r\nLang | SDK | Apex | Dataflow | Flink | Gearpump | Samza | Spark\r\n--- | --- | --- | --- | --- | --- | --- | ---\r\nGo | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Go_GradleBuild/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Go_GradleBuild/lastCompletedBuild/) | --- | --- | --- | --- | --- | ---\r\nJava | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex_Gradle/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex_Gradle/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink_Gradle/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink_Gradle/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Gearpump_Gradle/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Gearpump_Gradle/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Samza_Gradle/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Samza_Gradle/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark_Gradle/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark_Gradle/lastCompletedBuild/)\r\nPython | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Python_Verify/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Python_Verify/lastCompletedBuild/) | --- | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/lastCompletedBuild/) </br> [![Build Status](https://builds.apache.org/job/beam_PostCommit_Py_ValCont/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Py_ValCont/lastCompletedBuild/) | --- | --- | --- | ---\r\n\r\n\r\n\r\n\r\n"},"comment":{"url":"https://api.github.com/repos/apache/beam/issues/comments/405751879","html_url":"https://github.com/apache/beam/pull/5966#issuecomment-405751879","issue_url":"https://api.github.com/repos/apache/beam/issues/5966","id":405751879,"node_id":"MDEyOklzc3VlQ29tbWVudDQwNTc1MTg3OQ==","user":{"login":"ThatRfernand","id":3813960,"node_id":"MDQ6VXNlcjM4MTM5NjA=","avatar_url":"https://avatars0.githubusercontent.com/u/3813960?v=4","gravatar_id":"","url":"https://api.github.com/users/ThatRfernand","html_url":"https://github.com/ThatRfernand","followers_url":"https://api.github.com/users/ThatRfernand/followers","following_url":"https://api.github.com/users/ThatRfernand/following{/other_user}","gists_url":"https://api.github.com/users/ThatRfernand/gists{/gist_id}","starred_url":"https://api.github.com/users/ThatRfernand/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ThatRfernand/subscriptions","organizations_url":"https://api.github.com/users/ThatRfernand/orgs","repos_url":"https://api.github.com/users/ThatRfernand/repos","events_url":"https://api.github.com/users/ThatRfernand/events{/privacy}","received_events_url":"https://api.github.com/users/ThatRfernand/received_events","type":"User","site_admin":false},"created_at":"2018-07-17T22:43:26Z","updated_at":"2018-07-17T22:43:26Z","author_association":"CONTRIBUTOR","body":"We can concurrently run up to 100 Dataflow jobs. I've seen a peak of 70\nunder heavy ValidatesRunner pressure (three of those running concurrently).\nI think you're safe running < 10 or so.\n\n\n\nOn Tue, Jul 17, 2018 at 3:00 PM Andrew Pilloud <notifications@github.com>\nwrote:\n\n> @ThatRfernand <https://github.com/ThatRfernand> I've been told you are\n> the quota expert. This runs one pipeline at a time on Dataflow. How many\n> concurrent jobs should I cap it at?\n>\n> —\n> You are receiving this because you were mentioned.\n> Reply to this email directly, view it on GitHub\n> <https://github.com/apache/beam/pull/5966#issuecomment-405742423>, or mute\n> the thread\n> <https://github.com/notifications/unsubscribe-auth/ADoySKLE-kAZoISEQXRtryk_bAYf65KHks5uHl6WgaJpZM4VTCm9>\n> .\n>\n"}}
{"actor":{"display_login":"ThatRfernand"}}