Smart Detection
AI-powered automatic selection of agents and optimization profiles based on your input.
What It Is
Smart Detection is Vocoding's AI-powered system that automatically selects the best agent and optimization profile based on your input. Instead of manually choosing "React Expert" or "architect" profile every time, Smart Detection analyzes what you say and picks the right combination.
It goes beyond simple keyword matching -- Smart Detection uses AI to understand context, domain signals, and your project stack to find the best match.
How It Works
- You speak or type your input.
- Smart Detection analyzes the content in real-time.
- It evaluates: keywords, domain signals, project context, tech stack.
- The best-matching agent and profile are selected with a confidence score.
- If confidence exceeds the Auto-Apply threshold, they are applied automatically.
- If confidence is below the Hard Abstain threshold, no auto-selection occurs.
- Between the two thresholds, Vocoding suggests but does not auto-apply.
Scope Options
| Scope | What Gets Auto-Detected |
|---|---|
| All | Both agents and profiles |
| Agents | Only agents (profiles stay manual) |
| Profiles | Only profiles (agents stay manual) |
Configuration
Settings > Smart Detection
| Setting | Description | Default |
|---|---|---|
| Enable | Turn Smart Detection on/off | ON |
| Scope | What to detect (all/agents/profiles) | All |
| Agentic | Use AI for detection (vs. keyword only) | ON |
| Provider mode | Auto or manual provider | Auto |
| Timeout | Maximum time for detection (ms) | 3000 |
| Auto-Apply Confidence | Above this, auto-apply | 0.82 |
| Hard Abstain Confidence | Below this, never apply | 0.55 |
Detection Methods
Smart Detection supports three detection methods:
- Keyword matching -- Fast, deterministic, based on trigger words defined in agent configurations.
- Agentic detection -- Uses a lightweight LLM call to understand context deeply.
- Combined -- Keyword match first, then agentic for disambiguation when multiple agents match.
"Why This Agent" Panel
In the agent detail drawer, the "Why This Agent" section shows exactly why a particular agent was selected:
- Matched triggers -- Which words in your input triggered this agent.
- Detection method -- Keyword match, smart detection, or manual selection.
- Confidence score -- How confident the system is in this match.
Open the agent detail drawer by clicking any agent card in the Agents view.
When to Disable
- You always use the same agent and don't want suggestions changing.
- You are working on a very specific task and want full control.
- Detection is too slow for your workflow (try increasing the timeout first).
Tips
- Lock your agent if you want it to stay fixed for a session. Click the lock icon on the agent badge in the header bar.
- Higher Auto-Apply confidence = fewer automatic switches (more conservative).
- Lower Hard Abstain = more suggestions even when confidence is moderate.
- The "Why This Agent" panel is your best tool for understanding and tuning detection behavior.
- Add specific trigger keywords to your custom agents to improve Smart Detection accuracy.