{"push_id":2315931721,"size":14,"distinct_size":14,"ref":"refs/heads/fix-flink-splittable-dofn-take-2","head":"4ad6ba70c27f83e193e1a7b9bb3693a2d319057d","before":"d1a82d195ce8718c857f9848047a9c282b9030a6","commits":[{"sha":"fe9d74fdb03c6ace4bca70ca4b3a7f599f797523","author":{"name":"Charles Chen","email":"41f3712429db36b27e1bdf4e09d75ac51a9eba09@google.com"},"message":"Update snippets to fix pickling and clarify encoding issues","distinct":true,"url":"https://api.github.com/repos/aljoscha/beam/commits/fe9d74fdb03c6ace4bca70ca4b3a7f599f797523"},{"sha":"c205be024efaeeb77ba394a1de0a4548a0c4fcde","author":{"name":"Henning Rohde","email":"6f77501b24e1bca0eff62f420af699ec754c2f0d@google.com"},"message":"[BEAM-3457] Add Go Gradle precommit","distinct":true,"url":"https://api.github.com/repos/aljoscha/beam/commits/c205be024efaeeb77ba394a1de0a4548a0c4fcde"},{"sha":"c7bf2792b469e77b3ae54989ec9e076de834595d","author":{"name":"Eugene Kirpichov","email":"1bf369efec60f953368ffebf41b8f6baa5fd8e67@gmail.com"},"message":"Revert \"Update cloud spanner library to 0.29.0\"","distinct":true,"url":"https://api.github.com/repos/aljoscha/beam/commits/c7bf2792b469e77b3ae54989ec9e076de834595d"},{"sha":"7c674050251b39b966711571ec4d5b9145d3d8ef","author":{"name":"Anton Kedin","email":"f324043a50de5ff46b02d2be5fe9ec982d9a3907@google.com"},"message":"[Schema Generation] Generate BeamRecordTypes based on pojos.\n\nThis is needed to avoid manual conversion from PCollection<Pojo> to PCollection<BeamRecord>.\n\nCurrent usecase is Beam SQL and SQL Nexmark.\n\nThis can also be an exmple of how schema generation can be implemented internally for schema-aware PCollections.","distinct":true,"url":"https://api.github.com/repos/aljoscha/beam/commits/7c674050251b39b966711571ec4d5b9145d3d8ef"},{"sha":"0dd007403d94fa742338d83c6a78e0222197aeb1","author":{"name":"Aljoscha Krettek","email":"c8544d459372f968393afb8d6d2063138033b23f@gmail.com"},"message":"Make parameter of DoFnRunners.lateDataDroppingRunner() more specific","distinct":true,"url":"https://api.github.com/repos/aljoscha/beam/commits/0dd007403d94fa742338d83c6a78e0222197aeb1"},{"sha":"4710046ef0239e55934a62f783105249b2dffee5","author":{"name":"Aljoscha Krettek","email":"c8544d459372f968393afb8d6d2063138033b23f@gmail.com"},"message":"Allow overriding DoFnRunners in subclasses of Flink DoFnOperator","distinct":true,"url":"https://api.github.com/repos/aljoscha/beam/commits/4710046ef0239e55934a62f783105249b2dffee5"},{"sha":"2f02bed9913052dedd5abca3df21048d120dbb1a","author":{"name":"Aljoscha Krettek","email":"c8544d459372f968393afb8d6d2063138033b23f@gmail.com"},"message":"Invoke finishBundle() before teardown() in DoFnOperator","distinct":true,"url":"https://api.github.com/repos/aljoscha/beam/commits/2f02bed9913052dedd5abca3df21048d120dbb1a"},{"sha":"6962f7ae9317a304e0da906d3da47b4a8792571e","author":{"name":"Aljoscha Krettek","email":"c8544d459372f968393afb8d6d2063138033b23f@gmail.com"},"message":"[BEAM-2140] Ignore event-time timers in SplittableDoFnOperator\n\nSplittableDoFnOperator is only used for executing ProcessFn, which does\nnot use event-time timers. However, StatefulDoFnRunner does use\nevent-time timers for state cleanup so this change makes sure that they\ndon't end up being forwarded to the ProcessFn.","distinct":true,"url":"https://api.github.com/repos/aljoscha/beam/commits/6962f7ae9317a304e0da906d3da47b4a8792571e"},{"sha":"18ebf6f7a4079e037d5f42bf9fe36afd17a74cf4","author":{"name":"Aljoscha Krettek","email":"c8544d459372f968393afb8d6d2063138033b23f@gmail.com"},"message":"[BEAM-2140] Block DoFnOperator.close() if we have pending timers\n\nIt can happen that the input operation finishes while we still have\npending processing-time timers, for example from processing a Splittable\nDoFn. This change makes sure that we block as long as we have pending\ntimers.\n\nThis change also makes sure that we forward a +Inf watermark in close().\nWe have to do this because it can happen that we get a +Inf watermark on\ninput while we still have active watermark holds (which will get\nresolved when all pending timers are gone). With this change we make\nsure to send a +Inf watermark downstream once everything is resolved.","distinct":true,"url":"https://api.github.com/repos/aljoscha/beam/commits/18ebf6f7a4079e037d5f42bf9fe36afd17a74cf4"},{"sha":"7eca99f34e8362737a15e496acee8bbda1f75753","author":{"name":"Aljoscha Krettek","email":"c8544d459372f968393afb8d6d2063138033b23f@gmail.com"},"message":"[BEAM-2140] Don't use StatefulDoFnRunner when running SDF in FlinkRunner","distinct":true,"url":"https://api.github.com/repos/aljoscha/beam/commits/7eca99f34e8362737a15e496acee8bbda1f75753"},{"sha":"46422983637c586407a318c5bcca71de9fffdecd","author":{"name":"Aljoscha Krettek","email":"c8544d459372f968393afb8d6d2063138033b23f@gmail.com"},"message":"Make ProcessFnRunner constructor public\n\nWe need this to be able to instantiate with the constructor in the Flink\nRunner.","distinct":true,"url":"https://api.github.com/repos/aljoscha/beam/commits/46422983637c586407a318c5bcca71de9fffdecd"},{"sha":"f0345f77e63806dd1b88dc9b1b9e4fa10b80653c","author":{"name":"Aljoscha Krettek","email":"c8544d459372f968393afb8d6d2063138033b23f@gmail.com"},"message":"[BEAM-2140] Use ProcessFnRunner in DoFnRunner for executing SDF\n\nFor this to work, we need to also change how we wrap values in\nKeyedWorkItems, because ProcessFnRunner expects them to be in the\nGlobalWindow.","distinct":true,"url":"https://api.github.com/repos/aljoscha/beam/commits/f0345f77e63806dd1b88dc9b1b9e4fa10b80653c"},{"sha":"463843468d87f6c858611cd9d9fd6c47df5584f3","author":{"name":"Aljoscha Krettek","email":"c8544d459372f968393afb8d6d2063138033b23f@gmail.com"},"message":"[BEAM-2140] Enable SDF tests for Flink Streaming Runner","distinct":true,"url":"https://api.github.com/repos/aljoscha/beam/commits/463843468d87f6c858611cd9d9fd6c47df5584f3"},{"sha":"4ad6ba70c27f83e193e1a7b9bb3693a2d319057d","author":{"name":"Aljoscha Krettek","email":"c8544d459372f968393afb8d6d2063138033b23f@gmail.com"},"message":"[BEAM-2140] Enable SDF tests in gradle for Flink Streaming Runner","distinct":true,"url":"https://api.github.com/repos/aljoscha/beam/commits/4ad6ba70c27f83e193e1a7b9bb3693a2d319057d"}]}
{"actor":{"display_login":"aljoscha"}}