← systems · level 2
llm-cost-gateway
Scoping. It will sit between an app and the model providers.
planned line — nothing here is built yet
- app callthe request an app would send anyway
- cache lookuphas something close enough been asked?
- budget checkrefuse before the bill, not after
- providerone interface, several providers behind it
- metercost recorded per feature
runs on
undecidedscoping phase
- payments-rag calls the models directly today. This is the piece that would sit between.