New/llm

Large language models (LLMs) are commonly used for natural language processing tasks like text generation, translation, and summarization. Find llm links shared by the community.

github.com

Open Source LLM Observability Platform - Helicone

Helicone is an open-source LLM observability platform that enables AI engineers to monitor and evaluate models efficiently.

agent-monitoringanalyticsevaluationgptlangchain

flux

github.com

Lucebox: Optimized LLM Inference for RTX 3090

Lucebox is a hub for optimized LLM inference tailored for specific consumer hardware, enhancing AI performance and efficiency.

apple-siliconcppcudakernelllama-cpp

flux

github.com

AI Pair Programmer Tool for Developers

Forge is an AI-enhanced terminal tool that aids developers in coding tasks through interactive assistance and integration with various AI models.

ai-pair-programmingai-workflowsartifical-intelligenseclaude-3-7-sonnetclaude-4

flux

github.com

Local LLM Interface for Text and Image Generation

Textgen is a local LLM interface for text and image generation, ensuring privacy and ease of use.

llmopen-source-coding-agentpython

flux

github.com

LLM Inference Server for Apple Silicon Management

oMLX is an LLM inference server optimized for Apple Silicon, enabling efficient model management from the macOS menu bar.

apple-siliconinference-serverllmmacosmlx

flux

github.com

OpenAI Agents SDK for Multi-Agent Workflows

A framework for building multi-agent workflows using OpenAI's technology.

agentsaiai-agentsframeworkllm

flux

github.com

High-Performance Framework for Language Models

SGLang is an open-source framework for efficient serving of large language and multimodal models, ensuring low-latency and high-throughput performance.

attentionblackwellcudadeepseekdiffusion