dplutils.pipeline.stream.StreamingGraphExecutor.poll_tasks

abstractmethod StreamingGraphExecutor.poll_tasks(pending_task_list: list[Any]) → None

Wait for any change in status to pending_task_list

This method will be called after submitting as many tasks as possible. It gives a chance for implementations to wait in a io-friendly way, for example by waiting on async futures. The input is a list of objects as returned by task_submit() or split_batch_submit(). The return value is unused.