Pipeline

Pipeline#

Backbone#

PipelineExecutor(graph)

Base class for pipeline executors.

PipelineTask(name, func, ...], ...)

Container representing a task and its runtime configuration and dependencies.

PipelineGraph([graph])

Graph of pipeline tasks.

Executors#

StreamingGraphExecutor(graph[, max_batches, ...])

Base class for implementing streaming remote graph execution

Ray Execution#

RayDataPipelineExecutor(graph[, n_batches])

Executor using ray datasets pipelines.

RayStreamGraphExecutor(*args[, ray_poll_timeout])

Ray-based implementation of stream graph executor.