Manage model configurations

Manage model configurations and control their availability across LangSmith features.

Model configurations define the model and parameters that LangSmith features use when calling an AI provider. A single shared library of configurations spans your entire workspace, so any configuration you create is available across features without duplication.

• Playground
• Evaluators
• Agent Builder
• Polly
• Insights

Workspace admins can create, edit, and delete configurations and control which providers and models are available per feature. Non-admin members can view configurations but cannot modify them.

Feature Access

The Feature Access table controls provider and model availability independently for each LangSmith feature.

Feature	Model selection experience
Playground	Full model controls—view and adjust all parameters. No built-in models; relies on workspace configurations.
Evaluators	Full model controls—view and adjust all parameters. No built-in models; relies on workspace configurations.
Agent Builder	Choose from a curated list.
Polly	Choose from a curated list.
Insights (Thinking)	Model used for deep analysis. Choose from a curated list with provider recommendations.
Insights (Summarization)	Model used for lightweight summarization. Choose from a curated list with provider recommendations.

All features can also use workspace configurations alongside the built-in options, giving admins the flexibility to add custom model setups from any supported provider.

Insights uses two separate rows—one for analysis and one for summarization. The UI displays a warning if you select incompatible providers or non-recommended models for either row.

To configure feature access in the UI:

1. Navigate to Settings > Model configurations.
2. In the Feature Access table, find the feature you want to configure.
3. Click Enabled Providers and toggle providers on or off for that feature.
4. Click Available Models and select which models users can choose from.
5. Use the Default Model dropdown to set the model pre-selected when users open the feature.

Configurations

The Configurations table is a shared library of named model configurations for your workspace. Configurations you create in LangSmith — including from the Playground—appear here and you can reuse them across all features.

Create a configuration

1. Navigate to Settings > Model configurations.

2. Under Configurations, click + Create.

3. Select a Provider and Model.

4. Enter the API Key Name—the name of the secret in your workspace that stores the provider API key.

5. Adjust parameters as needed. Parameters are grouped into sections for:

   • Standard sampling settings: temperature, top P, top K, presence penalty, frequency penalty, max output tokens
   • Reasoning: reasoning effort, service tier
   • Provider config: provider API, base URL
   • Options: stop sequences, seed, JSON mode, extra headers, requests per second, extra parameters

   Available parameters vary by provider — refer to your provider’s documentation for details.

6. Click Save.

Edit a configuration

1. In the Configurations table, click the overflow menu next to the configuration.
2. Select Edit.
3. Update the configuration and click Save.

Delete a configuration

1. In the Configurations table, click the overflow menu next to the configuration.
2. Select Delete and confirm.

---

Edit this page on GitHub or file an issue.

Connect these docs to Claude, VSCode, and more via MCP for real-time answers.