OptimizeIRIS8
Send each request to the right-sized model
Caching, budgets and routing at the gateway, set by rules you control, with no change to your apps.
CachingIRIS8
Repeat requests come from cache
Repeat and near-duplicate requests are answered without a new model call.
- Request Amodel
- Request A, repeatedcache
Tunable match thresholdOpt out per route
BudgetsIRIS8
Spend this month against the cap
Budgets that stop at your cap
Set a monthly budget per team and choose between an alert and a hard stop.
RoutingIRIS8
Routine work goes to smaller models
Each request goes to the smallest model that clears the quality bar you set for that task.
Gateway · live requests
- Summarise loan fileyour model
- Extract KYC fieldsyour model
- Repeat questioncache
- Draft credit memofrontier model
Account number masked before sendEvery request logged
Your model takes routine work. A frontier model you choose takes the rest.
AttributionIRIS8
- Lendingshowback
- Contact centreshowback
- Engineeringchargeback
Spend shown by team
Usage is attributed to teams and products, so finance sees who spent what.
RulesIRIS8
Your rules at the gateway
Compress long prompts, cap output length and A/B route between models, all in configuration.
- Compress verbose prompts
- On
- Maximum output tokens
- Set per route
- A/B route between models
- On
- Fallback when a provider fails
- On
LibraryIRIS8
Specialist model library
A library of small models for classification, extraction, summaries and triage is in development.
Classification
Extraction
Summaries
Triage
CostIRIS8
Check the cost on your own volume
The calculator shows both monthly totals and the break-even point.
QuestionsIRIS8
Questions
Talk to usQ1Do our apps need to change?
No. Routing, caching and budgets are set in the gateway configuration.
Q2Who decides the quality bar?
You do, per task. A request only moves to a smaller model that clears it.
Q3Does caching risk stale answers?
Match thresholds and expiry are set per route, and any route can opt out. Routes that need a fresh answer stay live.
Next stepIRIS8