GitHub – unified SDK for seamless LLM integration

Summary: AgentHub provides an asynchronous, stateful, streaming API for multi-turn LLM execution that allows switching models without code changes. It aligns model capabilities like interleaved thinking and caching to maintain performance and enables one-parameter tracing for auditing.

What it does

AgentHub offers a standardized interface that handles provider differences automatically, supporting multi-turn agentic workflows with validated model features and permanent execution tracing.

Who it's for

Developers integrating multiple LLM providers who need consistent performance and simplified API management.

Why it matters

It eliminates manual adjustments and performance loss when switching models, reducing the complexity of working with diverse LLM APIs.