MICROSOFT FOUNDRY SHIPS TOOL SEARCH TO SHRINK TOOL SCHEMA COSTS
Microsoft Foundry introduced Tool Search so agents don’t ship huge tool catalogs every turn, cutting token spend and reducing tool misfires in large setups. A ...
Microsoft Foundry introduced Tool Search so agents don’t ship huge tool catalogs every turn, cutting token spend and reducing tool misfires in large setups.
A DEV post breaks down the hidden cost: every tool’s full JSON schema rides with each request, crushing input tokens and confusing selection as catalogs grow. Foundry’s new flow adds a retrieval hop — describe intent, get a small ranked set, then call — trading one round-trip for removing the catalog tax Your Agent Pays a Tax on Every Tool It Never Calls.
This pairs well with hybrid designs that keep strict workflow rails but let an agent adapt inside certain stages, so you only surface the tools relevant to that pocket of work Put the Agent Inside the Workflow.
Large agent catalogs were burning tokens on unused tool schemas and lowering selection accuracy.
Shifting to retrieval-based tool exposure aligns cost with need and simplifies scaling MCP-heavy agents.
-
terminal
Benchmark input tokens/turn and total task cost before vs. after Tool Search across 30, 100, and 200+ tool catalogs.
-
terminal
Measure tool-call precision/recall on near-duplicate tools (e.g., customer lookups) with and without retrieval.
Legacy codebase integration strategies...
- 01.
Start by indexing tools per domain and route via retrieval; keep legacy flat lists only for small (<=30) catalogs.
- 02.
Log schema-bytes sent per turn and add guardrails to block near-duplicate tools until de-duplicated.
Fresh architecture paradigms...
- 01.
Design a tool registry first: strong names, concise descriptions, and retrieval-friendly embeddings.
- 02.
Keep agents stateless but store tool metadata server-side; plan telemetry for tool ranking and call outcomes.
Get daily MICROSOFT-FOUNDRY + SDLC updates.
- Practical tactics you can ship tomorrow
- Tooling, workflows, and architecture notes
- One short email each weekday