Code/data-engineering

Community curated code

github.com

Apache Airflow is a platform for authoring, scheduling, and monitoring workflows, enhancing data engineering and automation processes.

airflowapacheapache-airflowautomationdag

data

github.com

Argo Workflows is a powerful open source tool for orchestrating parallel jobs on Kubernetes, ideal for machine learning and CI/CD tasks.

airflowargoargo-workflowsbatch-processingcloud-native

stack