apache_beam.runners.direct.direct_runner module

DirectRunner, executing on the local machine.

The DirectRunner is a runner implementation that executes the entire graph of transformations belonging to a pipeline on the local machine.

class apache_beam.runners.direct.direct_runner.BundleBasedDirectRunner[source]

Bases: PipelineRunner

Executes a single pipeline on the local machine.

static is_fnapi_compatible()[source]

run_pipeline(pipeline, options)[source]: Execute the entire pipeline and returns an DirectPipelineResult.

apache_beam.runners.direct.direct_runner.DirectRunner: alias of SwitchingDirectRunner

class apache_beam.runners.direct.direct_runner.SwitchingDirectRunner[source]

Bases: PipelineRunner

Executes a single pipeline on the local machine.

This implementation switches between using the FnApiRunner (which has high throughput for batch jobs) and using the BundleBasedDirectRunner, which supports streaming execution and certain primitives not yet implemented in the FnApiRunner.

is_fnapi_compatible()[source]

run_pipeline(pipeline, options)[source]