Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
20.2k
Stars
1.9k
Forks
1.0k
Issues
359
Contributors
163
Watchers
pythonworkflowdata-engineeringdata-scienceworkflow-engineprefectinfrastructureml-opsdata-opsautomationorchestrationdataobservabilitypipeline
Python
{"name":"Apache License 2.0","spdxId":"Apache-2.0"}
Project Description
Python's data stream orchestration platform. If the programs for acquiring, cleaning, and processing data are considered as individual tasks, this project can integrate these tasks into a workflow, enabling their deployment, scheduling, and monitoring on a web platform.