Show HN: We built open OpenRouter that distills usage into a better model

Aug 28, 2026 04:18 AM - 1 hour ago 4

gateway latency

Experiential is an unfastened root gateway and router for supplier workflows:

Use hosted, BYOK, and section models done 1 OpenAI-compatible API.
Control which users and agents tin usage which models, for which usage cases, and really overmuch they tin spend.
Turn accumulation postulation into a civilization router aliases exemplary optimized for quality, speed, and cost.

Experiential workspace usage dashboard showing exemplary traffic, identities, and spend

🌐 Platform | 📚 Docs | Discord

Start a section OpenAI-compatible gateway. On first run, the setup wizard uses the shared provider, model, and reasoning-effort selectors, persists each selected supplier connection, past shows defaults for the nationalist alias, identity, and $50.00 bid fund earlier printing a one-time key:

pip instal experiential exp

Choose a nationalist othername specified arsenic opus-5, seizure the issued key, and nonstop a request:

export EXP_GATEWAY_KEY=... curl http://127.0.0.1:8000/v1/chat/completions \ -H "Authorization: Bearer $EXP_GATEWAY_KEY" \ -H 'Content-Type: application/json' \ -d '{"model":"opus-5","messages":[{"role":"user","content":"Help me"}]}'

Setup / get started pinch the hosted gateway

Prefer a managed gateway to moving 1 locally? The hosted level at platform.experientiallabs.ai serves the same OpenAI-compatible (and Anthropic Messages) API astatine https://api.experientiallabs.ai/v1. See SETUP.md for copy-paste prompts you manus to your coding agent (Claude Code, Cursor, Codex, and similar); the supplier runs the setup for you. It collects 4 prompts:

Upload your LLM traces arsenic telemetry: create an relationship instantly from your email, past propulsion aliases upload your existing LLM traces onto the level arsenic telemetry.
Connect your conclusion supplier keys (BYOK): create an account, past link your ain OpenAI, Anthropic, Gemini, Azure, Bedrock, Fireworks, aliases OpenRouter keys for free pass-through.
Start calling models connected the gateway: make your first /v1 telephone pinch the OpenAI and Anthropic SDKs utilizing an xpl_ key, and optionally repoint your existing coding agents.
Full onboarding: create an relationship instantly from your email, link your keys, import your spend, past repoint each coding supplier (Claude Code, Cursor, Codex, Aider, and similar) aliases Conductor astatine the gateway.

Start the section gateway pinch exp (or exp run); the compiled autochthonal information plane serves each way connected loopback. From Python, load a fitted task router arsenic an official OpenAI customer backed by its ain backstage gateway:

import exp with exp.load_router("my-project") as client: response = client.chat.completions.create( model="my-project", messages=[{"role": "user", "content": "hello"}], )

First, cod OpenTelemetry traces from your existent agent. If you conscionable want to effort it out, grab the nationalist terminal-tasks OTLP dataset:

curl -L -o traces.otel.jsonl \ https://huggingface.co/datasets/experiential-labs/wmo-terminal-tasks-traces/resolve/540883e451dc13d34fb50fdd36b143cb0f1fb0db/traces.otel.jsonl

Then build a project. The build bid walks you done providers, models, and budget, and asks for your trace file:

# Build simulation from your supplier traces and optimize a router against it exp build support-agent

After collecting traces from your router, fine-tune an unfastened root exemplary you ain using Tinker.

exp optimize exemplary support-agent

Anonymous aggregate PostHog merchandise telemetry is enabled by default. It ne'er includes prompts, traces, actions, observations, paths, exemplary names, credentials, aliases earthy customer content.

exp config telemetry status exp config telemetry disable exp config telemetry enable

The penchant is stored locally successful .exp/settings.toml.

uv sync --extra dev uv tally ruff format --check . uv tally ruff cheque . uv tally ty check uv tally pytest -q

Repository and archiving conventions unrecorded successful AGENTS.md.