GroupIntoBatches
Pydoc |
Batches the input into desired batch size.
Examples
In the following example, we create a pipeline with a PCollection of produce by season.
We use GroupIntoBatches to get fixed-sized batches for every key, which outputs a list of elements for every key.
Related transforms
For unkeyed data and dynamic batch sizes, one may want to use BatchElements.
|
Pydoc |
Last updated on 2024/11/14
Have you found everything you were looking for?
Was it all useful and clear? Is there anything that you would like to change? Let us know!