Bounded Splittable DoFn Support Status
| Google Cloud Dataflow | Prism Local Runner | Apache Flink | Apache Spark (RDD/DStream based) | Apache Spark Structured Streaming (Dataset based) | Apache Nemo | Hazelcast Jet | Kafka Streams (experimental, not released) | Twister2 | Python Direct FnRunner | |
|---|---|---|---|---|---|---|---|---|---|---|
| Base | Partially : Only Dataflow Runner V2 supports this. | Yes : fully supported | Partially : Only portable Flink Runner supports this. | : | : | : | : | : | Yes : | No : not implemented |
| Side Inputs | Partially : Only Dataflow Runner V2 supports this. | Yes : fully supported | Partially : Only portable Flink Runner supports this. | : | : | : | : | : | : | No : not implemented |
| Splittable DoFn Initiated Checkpointing | Partially : Only Dataflow Runner v2 supports this. | Yes : fully supported | Partially : Only portable Flink Runner supports this. | : | : | : | : | : | Yes : | No : not implemented |
| Dynamic Splitting | Partially : Only Dataflow Runner V2 supports this. | Yes : fully supported | No : | : | : | : | : | : | Yes : Only with Python SDK | No : not implemented |
| Bundle Finalization | Partially : Only Dataflow Runner V2 supports this. | Yes : fully supported | No : | : | : | : | : | : | Yes : | No : not implemented |
Last updated on 2026/08/28
Have you found everything you were looking for?
Was it all useful and clear? Is there anything that you would like to change? Let us know!