Unbounded Splittable DoFn Support Status
| Base |
|---|
| Side Inputs |
| Splittable DoFn Initiated Checkpointing |
| Dynamic Splitting |
| Bundle Finalization |
| Google Cloud Dataflow | Apache Flink | Apache Spark (RDD/DStream based) | Apache Spark Structured Streaming (Dataset based) | Apache Samza | Apache Nemo | Hazelcast Jet | Twister2 | Python Direct FnRunner | Go Direct Runner |
|---|
Yes : | Partially : Support is either incomplete or broken on portable Flink Runner (#19637) | : | : | : | : | : | : | Yes : | No : |
Yes : fully supported | No : | : | : | : | : | : | : | : | Yes : |
Yes : | Partially : | : | : | : | : | : | : | Yes : | No : |
No : | No : | : | : | : | : | : | : | No : | No : |
Partially : Only Dataflow Runner V2 supports this. | No : | : | : | : | : | : | : | Yes : | No : |
Last updated on 2024/11/14
Have you found everything you were looking for?
Was it all useful and clear? Is there anything that you would like to change? Let us know!