Braintrust MCP connector

• Search SQL query Query experiments, datasets, and logs using SQL. Supports SELECT, FROM, WHERE, GROUP BY, ORDER BY, and LIMIT.
• Action Infer schema Discover the available fields, data types, and most common values in experiments, datasets, or logs.
• Action Summarize experiment Get aggregated performance metrics for an experiment, optionally compared to a baseline.
• List List recent objects List recently created projects, experiments, datasets, prompts, or functions you have access to.
• Action Resolve object Convert names to IDs or vice versa, and parse Braintrust URLs. For pattern, prompt, and scorer URLs, returns the containing project as object_id and the resource as row_id. App URLs retain their organization scope. Supply org_name to disambiguate name lookups. Ambiguous names…
• Generate Generate permalink Generate a direct web link to a Braintrust object for sharing or bookmarking. For project_logs, project_patterns, project_prompts, and project_functions, supply project_name or the project UUID as object_id. Pass root_span_id as row_id for log entries, or the resource ID as…
• Action Lookup users Resolve Braintrust organization member IDs to names and emails. Pass a batch of user IDs, search by partial name or email, or list every member.
• Action Lookup API keys Resolve API key and service token IDs to their names. Pass a batch of IDs, match an exact name, or list every key visible to you. Results follow existing API key and service token visibility rules.
• Get Get trace work items Return a chronological list of the meaningful LLM and tool spans in a trace, as input for the work sections that Analyze trace produces.
• Update Update trace work report Save those work sections and per-span annotations back to the trace.
• Search Search patterns Search existing project patterns by text, semantic similarity, ID, status, or quality. Pass similar_to with one or more pattern IDs or unreported pattern drafts to catch duplicates that use different wording. For listings and text searches, continue while has_more is true by…
• Action New pattern Record a pattern the agent has identified, with the evidence behind it. The agent decides what counts as a pattern, so asking for one doesn’t guarantee a record is written.
• Update Update pattern Update an existing project pattern, or attach evidence to matching traces.
• Create Create preprocessor Create a versioned preprocessor from inline JavaScript that converts raw trace data into text.
• Test Test preprocessor on trace Run a saved, global, or inline preprocessor on up to 50 span, trace, or group references without writing to the source trace.
• Create Create facet Create a versioned facet that extracts a short summary from spans or traces. Facet extraction always uses Braintrust’s built-in facet model.
• Test Test facet on trace Run an inline facet definition on up to ten span, trace, or group references without writing the result to the source trace.
• Enable Enable topics automation Enable Topics for a project. This seeds processing for new traffic and doesn’t rewind historical data.
• Set Set topics automation Update an existing Topics automation’s facets, scope, filters, sampling, or timing.
• Action Rewind topics automation Rewind an existing Topics automation to process historical data from a start time or a recent window.
• Generate Generate monitor chart Preview a monitor chart for project logs without modifying a saved view.
• List List monitoring views List a project’s saved monitor views and chart IDs.
• Get Get monitoring view Inspect a saved monitor view, including its options and ordered chart definitions.
• Create Create monitoring view Create a project-scoped monitor view, optionally containing charts you already previewed.
• Update Update monitoring view Insert, update, or remove charts in an existing monitor view, one edit at a time or several in bulk.
• List List automations List a project’s automations, including online scoring rules, alerts, exports, retention policies, and Topics automations. Filter by automation_id, name, or kind. Returns complete configurations, so you can inspect an automation before updating it.
• Set Set automation status Pause or activate an alert, scheduled job, or online scoring rule.
• Create Create log alert Create an alert for individual matching project logs. Use config.interval_seconds to throttle repeated notifications.
• Create Create environment update alert Create an alert for environment updates. Use config.environment_filter to limit notifications to specific environment slugs.
• Create Create threshold alert Create an alert for an aggregate over a recent window of project data, evaluated on a schedule. Use it for averages, counts, rates, percentages, percentiles, and distributions.
• Create Create scheduled loop job Create a Loop job that runs on an interval or cron schedule over a recent window of project data.
• List List slack channels List connected Slack workspaces and public channels for a project to resolve workspace and channel IDs before configuring Slack delivery.
• Create Create prompt Create a versioned prompt from a completion-style prompt or chat messages. Set if_exists to replace to save a new version, or ignore to leave an existing prompt unchanged.
• Create Create evaluator Create a versioned LLM or inline code evaluator. Set output_type to score for numeric scores or classification for categorical labels.
• Create Create human review score Create a categorical, slider, or free-form human review score for a project. Fails if the name already exists.
• Test Test evaluator Run a saved, global, or inline evaluator against span, trace, or group references without writing results to the source trace.
• Update Update online scoring rule Save or rewind an online scoring rule that runs saved evaluator functions. New rules default to paused.
• Run Run eval Run an experiment with a hosted dataset, inline rows, or a prior experiment as input data, any saved or inline task, and zero or more saved or inline scorers. When a prior experiment supplies the data, its outputs become expected values unless an expected value was already…
• Action Edit dataset rows Insert, update, or delete up to 100 dataset rows. Target a dataset by ID or name, and set create_if_missing to create a new named dataset.
• Get Get project settings Return a project’s typed settings, including the effective default preprocessor. An unset default resolves to the built-in thread preprocessor.
• Set Set project default preprocessor Set or clear a project’s default preprocessor. Pass null to restore the built-in default. This changes the default used by facets and other project functions that don’t select a preprocessor explicitly. Expects the braintrust/topics-workflow skill to be loaded first.
• Search Search docs Search Braintrust documentation to find relevant guides, API references, and code examples.
• Action Load Braintrust skill Load a Braintrust workflow guide before using the tools it covers. Available skills are braintrust/automations-workflow, braintrust/evaluator-workflow, and braintrust/topics-workflow.

No tools match your search.