- Ship
- Observability
See every step
your agent took
Every LLM call, every tool invocation, every MCP step. Latency, token cost, and failure mode for each one. Built around the questions you have when something breaks.
Read the observability docsRun details
#a1b2c3d4- Runinvoice-processor2,341msok
- LLMgemini-2.5-pro · 1,203 tokens1,892msok
- Tooldocuments.parse234msok
- MCPlinear.create_issue156msok
- Tooldatabase.store_invoice59msok
Every step. Every token. Every dollar.
The trace tree shows what your agent did, why, and what it cost. Click any row to inspect it.
Run details
#a1b2c3d4- Runinvoice-processor2,341msok
- LLMgemini-2.5-pro · 1,203 tokens1,892msok
- Tooldocuments.parse234msok
- MCPlinear.create_issue656msok
- Tooldatabase.store_invoice59msok
system_prompt + invoice text + tool schemas
tool_call: documents.parse(s3://invoices/...) followed by tool_call: database.store_invoice(...)
First LLM hop. Token cost dominates the run.
See the shape of production
One trace tells you what happened once. Aggregates show the patterns: drift, regressions, runaway cost.
98.5% · selected range
$0.018 · across all runs
completed vs. failed
claude / gemini tokens
Debugging flows, not dashboards
A dashboard answers questions you've already asked. Connic observability is built around the questions you have when something breaks.
Tag runs from middleware with stable keys, then filter the Logs tab by status, deployment, date, or context. The bad slice surfaces in seconds.
Logs search: customer_id=abc123Anomaly detection compares each run against the agent's 30-day rolling cost average and pings you when one breaks out. Spend limits pause the agent if a daily or monthly threshold is crossed.
Anomaly: run cost > 3× rolling avgOpen one failing run and one healthy run side by side. Walk down both traces. The first span where they diverge is almost always the real cause.
First-divergence: LLM, Tool, or MCP spanWhat you'd otherwise stitch together
Connic observability vs. building it on top of a generic APM
| Feature | Connic | LangSmith | Helicone | DIY OTel |
|---|---|---|---|---|
| Per-run OpenTelemetry trace tree | Included | Included | Partial | Partial |
| Cost per run / per agent | Included | Included | Included | Not included |
| Token breakdown (input / output / thinking / cached) | Included | Partial | Partial | Not included |
| Captured logs from tools & middleware | Included | Partial | Not included | Partial |
| Custom dashboards in-product | Included | Partial | Partial | Partial |
| Spend alerts & hard limits | Included | Not included | Partial | Not included |
| Cost anomaly detection | Included | Not included | Not included | Not included |
| Re-run any execution from the dashboard | Included | Partial | Not included | Not included |
| Wired to A/B testing | Included | Not included | Not included | Not included |
| Wired to judges | Included | Partial | Not included | Not included |