Skip to main content
Connic
Build

Models and Providers

Connect a provider, select a model, and tune model behavior in agent YAML.

Last updated
Model format

Models must include a provider prefix: provider/model-name. Configure the provider credentials in Project Settings before using it in an agent.

Model controls

agents/assistant.yaml
model: openai/gpt-5.2
fallback_model: gemini/gemini-2.5-pro
temperature: 0.7
reasoning_effort: medium  # minimal | low | medium | high | xhigh | off | auto
  • model selects the primary model and is required for LLM agents.
  • fallback_model is used when the primary provider is unavailable because of an outage, rate limit, authentication error, or timeout.
  • temperature controls output randomness. Lower values are more deterministic.
  • reasoning_effortmaps a shared effort level to each provider's native parameter. Use auto for the provider default or off where supported. Captured reasoning appears in run traces when the provider returns it.
  • reasoning_budget is deprecated and only works with legacy models that accept raw token budgets.

Supported providers

Connic supports the providers below. Add their credentials in Project Settings, then use the matching prefix in your agent configuration.

ProviderPrefixConfiguration
OpenAIopenai/API key only
Azure OpenAIazure/API key + base URL + API version
Anthropicanthropic/API key only
Google Geminigemini/API key only
OpenRouteropenrouter/API key only
AWS Bedrockbedrock/Access key ID + secret access key + region
Google Vertex AIvertex_ai/GCP project ID + location + service account JSON
Custom OpenAI-compatibleyour_prefix/API base URL + optional API key

Custom OpenAI-compatible providers

You can connect any OpenAI-compatible endpoint, including self-hosted models and inference proxies. In Project Settings > LLM Provider, select Add Custom Provider and configure:

  • Model prefix — a unique lowercase prefix, such as ollama
  • API base URL — the endpoint, such as https://my-llm.example.com/v1
  • API key — optional; leave it empty if the endpoint does not require authentication
agents/agent.yaml
# Custom provider configured with prefix "ollama"
model: ollama/llama3

# Custom provider configured with prefix "vllm"
model: vllm/mistral-7b

Connic routes requests for that prefix to the configured endpoint. The prefix must not collide with a built-in provider name.

Example model identifiers

agents/agent.yaml
# Using OpenAI
model: openai/gpt-5.2

# Using Anthropic
model: anthropic/claude-opus-4-7

# Using Google Gemini
model: gemini/gemini-2.5-pro

# Using Azure OpenAI (use your deployment name)
model: azure/my-gpt5-deployment

# Using OpenRouter (provider/model format)
model: openrouter/anthropic/claude-sonnet-4.5

# Using AWS Bedrock
model: bedrock/us.anthropic.claude-opus-4-7-v1:0

# Using Google Vertex AI
model: vertex_ai/gemini-2.5-pro

# Using a custom OpenAI-compatible provider
model: ollama/llama3