Skip to main content

LLM Settings

Default Settings​

LLM Settings

The Default Settings section lets you choose which LLM and embedding model Codebolt uses across the application by default.

Default Application LLM​

Select the provider and model that agents use when no agent-specific override is set.

  1. Choose a Provider from the dropdown — only providers with a valid API key appear here.
  2. Click the Model field to open the searchable model picker and select a model.
  3. Click Update Settings to save.

Models are tagged Chat (for conversational/instruction models) or UC (Unified Capability).

Embedding Model​

Select the provider and model used for vector embeddings (memory ingestion, knowledge retrieval, etc.).

  1. Choose a Provider — includes cloud providers and a built-in Local option.
  2. Select a Model. Local models show a Download button with size and progress indicator. A Ready badge appears once a model is downloaded; Available means it can be downloaded.
  3. Click Update Settings to save.

LLM Providers​

LLM Providers

The LLMs section is where you add API keys and browse the models available from each provider.

Providers tab​

All supported providers are listed in an accordion. Expand a provider to enter its credentials. A checkmark appears next to providers that already have a key configured.

ProviderNotes
CodeBolt AIBuilt-in; no key required
OpenAIAPI key
AnthropicAPI key
GeminiAPI key
GroqAPI key
MistralAPI key
DeepSeekAPI key
AWS BedrockAccess key + secret + region
Cloudflare AIAccount ID + API token
HuggingFaceAPI token
OllamaLocal URL (default http://localhost:11434)
LM StudioLocal URL
OpenRouterAPI key
PerplexityAPI key
ReplicateAPI key
LocalNo key — uses locally downloaded models
Plugin providersOAuth login/logout buttons

After adding or updating a key, Codebolt validates it immediately and shows a toast notification.

Models tab​

Use the Provider filter to see models from a specific provider, or select All Models for the full list. Each row shows the provider name and model ID. This tab is read-only — use the Default Settings or Agent Settings sections to assign models.