Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
19.1k
Stars
1.8k
Forks
993
Issues
334
Contributors
163
Watchers
pythonworkflowdata-engineeringdata-scienceworkflow-engineprefectinfrastructureml-opsdata-opsautomationorchestrationdataobservabilitypipeline
Python
{"name":"Apache License 2.0","spdxId":"Apache-2.0"}
Project Description
Python's data stream orchestration platform. If the programs for acquiring, cleaning, and processing data are considered as individual tasks, this project can integrate these tasks into a workflow, enabling their deployment, scheduling, and monitoring on a web platform.