Code/batch-processing

Community curated code

github.com

Firecrawl MCP Server facilitates powerful web scraping and search capabilities for LLM clients, enhancing data collection and interaction.

batch-processingclaudecontent-extractiondata-collectionfirecrawl

wire

github.com

Argo Workflows is a powerful open source tool for orchestrating parallel jobs on Kubernetes, ideal for machine learning and CI/CD tasks.

airflowargoargo-workflowsbatch-processingcloud-native

stack