apache_beam.runners.direct.helper_transforms module

class apache_beam.runners.direct.helper_transforms.LiftedCombinePerKey(combine_fn, args, kwargs)[source]

Bases: PTransform

An implementation of CombinePerKey that does mapper-side pre-combining.

expand(pcoll)[source]
class apache_beam.runners.direct.helper_transforms.PartialGroupByKeyCombiningValues(combine_fn)[source]

Bases: DoFn

Aggregates values into a per-key-window cache.

As bundles are in-memory-sized, we don’t bother flushing until the very end.

setup()[source]
start_bundle()[source]
process(element, window=WindowParam)[source]
finish_bundle()[source]
teardown()[source]
default_type_hints()[source]
class apache_beam.runners.direct.helper_transforms.FinishCombine(combine_fn)[source]

Bases: DoFn

Merges partially combined results.

setup()[source]
process(element)[source]
teardown()[source]
default_type_hints()[source]