From 8f9db7193bb3c3fdbc4df20969cf9cb7c87982b1 Mon Sep 17 00:00:00 2001 From: Tobias Kaymak Date: Wed, 4 Nov 2026 16:54:35 +0000 Subject: [PATCH 1/2] [#36841] Announce Spark 4 Structured Streaming runner streaming support in CHANGES.md --- CHANGES.md | 1 + 1 file changed, 1 insertion(+) diff --git a/CHANGES.md b/CHANGES.md index 1ff527b87dcd..eccaf751f02d 100644 --- a/CHANGES.md +++ b/CHANGES.md @@ -70,6 +70,7 @@ ## New Features / Improvements * (Java) Flink runner: `Reshuffle` in batch distributes elements round-robin from deterministic start channels instead of random ones, so inputs with few elements per sender stay balanced ([#40607](https://github.com/apache/beam/issues/40607)). +* (Java) Spark 4 runner: the Structured Streaming runner now runs streaming pipelines (`--streaming`), with unbounded and bounded reads, stateless and stateful ParDo with event time timers, windowed GroupByKey and Combine, and PAssert, covered by a streaming ValidatesRunner suite. Side inputs, ParDo with additional outputs ([#40949](https://github.com/apache/beam/issues/40949)), Redistribute ([#40950](https://github.com/apache/beam/issues/40950)), splittable DoFn, processing time timers, merging windows and triggers other than the default and `Never` are rejected at translation ([#36841](https://github.com/apache/beam/issues/36841)). * X feature added (Java/Python) ([#X](https://github.com/apache/beam/issues/X)). * (Python) Added support for Protobuf 7.x ([#40580](https://github.com/apache/beam/issues/40580)). From 272c78c6d16e07b323cdda9a225e628b273d46fd Mon Sep 17 00:00:00 2001 From: Tobias Kaymak Date: Wed, 4 Nov 2026 16:56:29 +0000 Subject: [PATCH 2/2] Shorten the Spark 4 streaming CHANGES.md entry --- CHANGES.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/CHANGES.md b/CHANGES.md index eccaf751f02d..804094dfc5fd 100644 --- a/CHANGES.md +++ b/CHANGES.md @@ -70,7 +70,7 @@ ## New Features / Improvements * (Java) Flink runner: `Reshuffle` in batch distributes elements round-robin from deterministic start channels instead of random ones, so inputs with few elements per sender stay balanced ([#40607](https://github.com/apache/beam/issues/40607)). -* (Java) Spark 4 runner: the Structured Streaming runner now runs streaming pipelines (`--streaming`), with unbounded and bounded reads, stateless and stateful ParDo with event time timers, windowed GroupByKey and Combine, and PAssert, covered by a streaming ValidatesRunner suite. Side inputs, ParDo with additional outputs ([#40949](https://github.com/apache/beam/issues/40949)), Redistribute ([#40950](https://github.com/apache/beam/issues/40950)), splittable DoFn, processing time timers, merging windows and triggers other than the default and `Never` are rejected at translation ([#36841](https://github.com/apache/beam/issues/36841)). +* (Java) Spark 4 runner: the Structured Streaming runner now supports streaming pipelines ([#36841](https://github.com/apache/beam/issues/36841)). * X feature added (Java/Python) ([#X](https://github.com/apache/beam/issues/X)). * (Python) Added support for Protobuf 7.x ([#40580](https://github.com/apache/beam/issues/40580)).