narration="Two ways to pay for tool schemas. Load them eagerly and every schema sits in the fixed prefix ahead of your prompt; as the catalog grows from four schemas to forty, that block swells toward 180 of the window's 260 units and drags the prompt down toward the weak middle. Defer them and you protect the prompt, but you buy a decision: the model has to search, pick a candidate, load its schema, then call it. A near match is the expensive case — the wrong schema, the false call, and its result land in the middle and stay for the rest of the run. Deferring protects the prompt but prices discovery, so small high-frequency toolsets favor eager loading and broad catalogs favor deferred."
0 commit comments