Context-compression MCP server that shrinks tool outputs, logs, files and RAG chunks before they reach the model, cutting 60-95% of tokens on JSON payloads.
3 views
Braintrust MCP Server
by Braintrust
Released
4 views
v1.0.0
Summary
Query Braintrust evals and production logs in SQL from your editor — compare experiments against a baseline, debug a bad trace, and hand a teammate a permalink.
Features
- sql_query over experiments, datasets and production logs, with infer_schema first
- summarize_experiment with optional baseline comparison
- generate_permalink to share a finding straight out of the editor
- resolve_object and list_recent_objects for navigating projects by name or URL
- search_docs across Braintrust guides and the API reference
- Hosted remote server with a separate EU data plane; API-key or OAuth 2.0 auth
Installation
Set up this MCP server in your favorite AI agent — copy a ready-made configuration below.
Description
Braintrust is an evaluation and observability platform for LLM applications: you run experiments, score them, and ship logs from production into the same place. Its MCP server closes the loop by letting the agent that is writing the code also interrogate the results, without a context switch into the web UI.
The centre of it is sql_query, which runs SQL directly against experiments, datasets and logs, with infer_schema to discover the available fields first so the agent is not guessing at column names. summarize_experiment returns aggregate scores and can diff them against a baseline experiment, which is the question you actually want answered after a prompt change — did this get better, and by how much.
Around that sit the navigation tools: resolve_object converts between names and IDs and parses Braintrust URLs, list_recent_objects surfaces recently touched projects, experiments, datasets, prompts and functions, and generate_permalink produces a shareable link so a finding from an editor session can go straight into a pull request or a Slack thread. search_docs covers Braintrust's own guides and API reference, and search_patterns, new_pattern and update_pattern record recurring project patterns.
It is a hosted remote server at https://api.braintrust.dev/mcp, with an EU data plane at https://api-eu.braintrust.dev/mcp. Authenticate either with an API key as a bearer token or interactively through OAuth 2.0, no key configuration required.
The workflow it enables: debugging a production log without leaving the IDE, comparing two experiment runs, checking cost metrics per model, and sharing the evidence with a link rather than a screenshot.
Related MCP Servers
Persistent memory for coding agents as a single Go binary — SQLite and FTS5 behind MCP, an HTTP API, a CLI and a TUI, with no Node, Python or Docker required.
2 views
Give a coding agent a live feedback loop on real mobile, TV and desktop apps — inspect, tap, type and capture evidence on iOS, Android and HarmonyOS over MCP or a CLI.
3 views
The official W&B MCP server: query experiment runs, Weave LLM traces, artifacts and registries in natural language, and write findings back as a W&B report.
3 views