Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
19.7k
Stars
1.9k
Forks
980
Issues
349
Contributors
162
Watchers
pythonworkflowdata-engineeringdata-scienceworkflow-engineprefectinfrastructureml-opsdata-opsautomationorchestrationdataobservabilitypipeline
Python
{"name":"Apache License 2.0","spdxId":"Apache-2.0"}
Project Description
Python's data stream orchestration platform. If the programs for acquiring, cleaning, and processing data are considered as individual tasks, this project can integrate these tasks into a workflow, enabling their deployment, scheduling, and monitoring on a web platform.