Baseten

Verified

Baseten is a high-performance inference platform for running open source LLMs. This API provides an OpenAI-compatible chat completions endpoint, so it works as a drop-in replacement with any OpenAI SDK or client. Just swap the base URL and API key. Available models include DeepSeek V3 and V3.1, GLM 4.6 and 4.7 from Zhipu, Moonshot's Kimi K2 family (including K2 Thinking with 262k context), and OpenAI's GPT OSS 120B. Several models support controllable reasoning depth via a reasoning_effort parameter. Supports streaming, tool calling, structured outputs, and extended context windows up to 262k tokens.

skill.md (for agents) ↗

Endpoints

POST/v1/chat/completionsDynamic

Chat Completions

GET/v1/models

List Models

GET /v1/models

const result = await orth.run({
  api: "baseten",
  path: "/v1/models",
});