Build
Models and Providers
Connect a provider, select a model, and tune model behavior in agent YAML.
Last updated
Model format
Models must include a provider prefix: provider/model-name. Configure the provider credentials in Project Settings before using it in an agent.
Model controls
agents/assistant.yaml
model: openai/gpt-5.2
fallback_model: gemini/gemini-2.5-pro
temperature: 0.7
reasoning_effort: medium # minimal | low | medium | high | xhigh | off | automodelselects the primary model and is required for LLM agents.fallback_modelis used when the primary provider is unavailable because of an outage, rate limit, authentication error, or timeout.temperaturecontrols output randomness. Lower values are more deterministic.reasoning_effortmaps a shared effort level to each provider's native parameter. Useautofor the provider default oroffwhere supported. Captured reasoning appears in run traces when the provider returns it.reasoning_budgetis deprecated and only works with legacy models that accept raw token budgets.
Supported providers
Connic supports the providers below. Add their credentials in Project Settings, then use the matching prefix in your agent configuration.
| Provider | Prefix | Configuration |
|---|---|---|
| OpenAI | openai/ | API key only |
| Azure OpenAI | azure/ | API key + base URL + API version |
| Anthropic | anthropic/ | API key only |
| Google Gemini | gemini/ | API key only |
| OpenRouter | openrouter/ | API key only |
| AWS Bedrock | bedrock/ | Access key ID + secret access key + region |
| Google Vertex AI | vertex_ai/ | GCP project ID + location + service account JSON |
| Custom OpenAI-compatible | your_prefix/ | API base URL + optional API key |
Custom OpenAI-compatible providers
You can connect any OpenAI-compatible endpoint, including self-hosted models and inference proxies. In Project Settings > LLM Provider, select Add Custom Provider and configure:
- Model prefix — a unique lowercase prefix, such as
ollama - API base URL — the endpoint, such as
https://my-llm.example.com/v1 - API key — optional; leave it empty if the endpoint does not require authentication
agents/agent.yaml
# Custom provider configured with prefix "ollama"
model: ollama/llama3
# Custom provider configured with prefix "vllm"
model: vllm/mistral-7bConnic routes requests for that prefix to the configured endpoint. The prefix must not collide with a built-in provider name.
Example model identifiers
agents/agent.yaml
# Using OpenAI
model: openai/gpt-5.2
# Using Anthropic
model: anthropic/claude-opus-4-7
# Using Google Gemini
model: gemini/gemini-2.5-pro
# Using Azure OpenAI (use your deployment name)
model: azure/my-gpt5-deployment
# Using OpenRouter (provider/model format)
model: openrouter/anthropic/claude-sonnet-4.5
# Using AWS Bedrock
model: bedrock/us.anthropic.claude-opus-4-7-v1:0
# Using Google Vertex AI
model: vertex_ai/gemini-2.5-pro
# Using a custom OpenAI-compatible provider
model: ollama/llama3