[{"data":1,"prerenderedAt":73},["ShallowReactive",2],{"term-t\u002Ftoken-burn":3,"related-t\u002Ftoken-burn":59},{"id":4,"title":5,"acronym":6,"body":7,"category":40,"description":41,"difficulty":42,"extension":43,"letter":44,"meta":45,"navigation":46,"path":47,"related":48,"seo":53,"sitemap":54,"stem":57,"subcategory":6,"__hash__":58},"terms\u002Fterms\u002Ft\u002Ftoken-burn.md","Token Burn",null,{"type":8,"value":9,"toc":33},"minimark",[10,15,19,23,26,30],[11,12,14],"h2",{"id":13},"eli5-the-vibe-check","ELI5 — The Vibe Check",[16,17,18],"p",{},"Token burn is how fast your AI bill climbs because the model keeps re-reading the same context. Every turn of a long chat costs more. Every agent retry is token burn. Monitor it or the invoice will surprise you.",[11,20,22],{"id":21},"real-talk","Real Talk",[16,24,25],{},"Token burn is the rate of token consumption in LLM-based systems, driving API cost. Factors: conversation length (context grows each turn), retries, tool-use loops, and uncached prompts. Mitigations: prompt caching, context compaction, token budgets, and eval-driven prompt optimization. Unmonitored token burn is a common startup cost-overrun.",[11,27,29],{"id":28},"when-youll-hear-this","When You'll Hear This",[16,31,32],{},"\"Our token burn tripled after the agent rollout — caching saved us.\" \u002F \"Set token-burn alerts before prod.\"",{"title":34,"searchDepth":35,"depth":35,"links":36},"",2,[37,38,39],{"id":13,"depth":35,"text":14},{"id":21,"depth":35,"text":22},{"id":28,"depth":35,"text":29},"ai","Token burn is how fast your AI bill climbs because the model keeps re-reading the same context. Every turn of a long chat costs more.","beginner","md","t",{},true,"\u002Fterms\u002Ft\u002Ftoken-burn",[49,50,51,52],"Token Budget","Token Tax","Cost Per Token","Prompt Caching",{"title":5,"description":41},{"changefreq":55,"priority":56},"weekly",0.7,"terms\u002Ft\u002Ftoken-burn","TqVRA22NVjqAY4xqzuH0Yw44xBrGONdjC4c_tw2ZyPw",[60,63,67,70],{"title":51,"path":61,"acronym":6,"category":40,"difficulty":42,"description":62},"\u002Fterms\u002Fc\u002Fcost-per-token","Cost per token is how much each token (input or output) costs with a given AI provider. Flagship models cost more per token than cheap ones.",{"title":52,"path":64,"acronym":6,"category":40,"difficulty":65,"description":66},"\u002Fterms\u002Fp\u002Fprompt-caching","intermediate","Prompt caching is a speed and cost optimization where the AI remembers the beginning of your prompt so it doesn't have to re-process it every time.",{"title":49,"path":68,"acronym":6,"category":40,"difficulty":42,"description":69},"\u002Fterms\u002Ft\u002Ftoken-budget","A token budget is the cap on how many tokens a request, session, or user can consume. Like a food budget but for AI.",{"title":50,"path":71,"acronym":6,"category":40,"difficulty":42,"description":72},"\u002Fterms\u002Ft\u002Ftoken-tax","Token tax is the ongoing cost of running AI features in production. Every API call costs tokens. Every request the user makes. It never sleeps.",1776518319338]