# What to do when a conversation outgrows its context window > When a conversation outgrows its window you truncate or summarise. A modelled summarise costs $0.20 once and saves $0.16 on every call after. URL: https://getculpa.com/context-overflow-cost Last reviewed: 2026-08-05 Rates effective: 2026-07-02 ## Answer A conversation that fills its window has to lose something, and the two options cost differently. Truncating is free and loses information. Summarising costs one call and cuts every later one. Culpa, a local-first LLM cost, margin, and forecast ledger, prices each call so the break-even is measured rather than guessed. ## Why this happens Long-running conversations grow until they hit a limit, and something has to give. Truncating drops the oldest turns, costs nothing to do, and loses whatever was in them, which tends to be the setup the later turns depend on. Summarising compresses the history into a shorter form, keeps most of the meaning, and costs a model call to produce. Teams usually pick by instinct, and instinct says the free option is cheaper. It generally isn't, because the summary is paid once and the saving repeats on every subsequent call in the conversation. The break-even is low enough to be worth computing rather than debating, and it gets lower the more expensive the model serving the conversation is, because the summary can be produced on a cheap model while the saving accrues at the expensive one's input rate. That asymmetry is the whole trick and it's rarely used deliberately. ## What this usually looks like - Conversations hit the window limit and the handling was never designed. - You truncate because it's free and nobody priced the alternative. - Cost per call climbs through a long session with no ceiling. - Summaries are generated on the same expensive model serving the conversation. - Users report the assistant forgetting things it was told earlier. ## Common mistakes - Truncating because it costs nothing to do. Why it hurts: It costs nothing once and loses context permanently, while a summary pays for itself in a call or two. Do instead: Compute the break-even for your own conversation lengths and pick deliberately. - Summarising on the model serving the conversation. Why it hurts: The summary is a mechanical task that a cheap model does well, so an expensive one wastes the saving. Do instead: Produce the summary on the cheapest capable model and keep the saving. - Waiting for the window to fill before acting. Why it hurts: Every call before the limit already carried the full history at full input rates. Do instead: Compress on a threshold you choose, not on the one the provider enforces. - Summarising once and letting it grow again. Why it hurts: The problem recurs, and a second overflow costs the same as the first. Do instead: Treat compression as a recurring step with its own budget, not a one-off repair. ## Self-check - Find how many of your conversations reach the window limit. - Work out the average number of calls that happen after a conversation passes your threshold. - Compare that to the break-even for summarising at your own token counts. - Check which model your summaries are generated on. ## Summarise once, save on every call after (illustrative) A modelled 100,000-token conversation compressed to 20,000, with the summary produced on Claude Haiku 4.5 and the conversation itself served by Claude Sonnet 5. Real rates from the price book effective 2026-07-02: Haiku at $1.00 and $5.00 per million, Sonnet 5 at its introductory $2.00 input. Token counts and the compression ratio are modelled, the rates are published. the summary call: 100,000 x $1.00/M + 20,000 x $5.00/M = $0.1000 + $0.1000 = $0.2000 input saved on every later call: 100,000 - 20,000 = 80,000 tokens at Sonnet 5's $2.00/M: 80,000 x $2.00/M = $0.1600 a call break-even: $0.2000 / $0.1600 = 1.25 calls so the summary has paid for itself before the second call after it completes One and a quarter calls. Any conversation that continues past a second turn after compressing is already ahead, and the saving repeats for as long as the session runs. Producing the summary on the cheap model is what makes the break-even that low: the same summary generated on Sonnet 5 would cost more and recover it more slowly. ## Cost figures Every figure carries its confidence and its source. No figure on this page is provider-reported. - 1.25 calls, modelled break-even for summarising a 100,000-token conversation rather than truncating it [calculated] Source: A modelled 100,000-token conversation compressed to 20,000 on Claude Haiku 4.5 at real rates of $1.00 and $5.00 per million from the price book effective 2026-07-02 costs $0.1000 + $0.1000 = $0.2000. The 80,000 tokens saved on each later call, served by Claude Sonnet 5 at its real introductory $2.00 per million, is worth $0.1600 a call. $0.2000 / $0.1600 = 1.25 calls. Rates are published, the token counts and compression ratio are modelled. ## FAQ Q: Is it cheaper to truncate or to summarise? A: Summarising, in most cases, and the break-even is low. In the modelled example a summary costs $0.2000 once and saves $0.1600 on every later call, so it pays for itself after 1.25 calls. Truncating costs nothing and loses the context permanently. Q: Which model should generate the summary? A: The cheapest one that does it well. Summarising is mechanical, and the saving accrues at the expensive model's input rate regardless of what produced the summary. In the modelled example generating on Haiku 4.5 while serving on Sonnet 5 is what puts the break-even at 1.25 calls. Q: When should I compress? A: At a threshold you choose rather than the one the window enforces. Every call before you act already carried the full history at full input rates, so waiting for the limit means paying for the problem the whole way up to it. Q: Does compressing ever lose money? A: Yes, on conversations that end immediately after. The summary is paid once and recovers over subsequent calls, so a session that stops before the break-even is pure cost. Whether that happens often enough to matter is measurable on your own sessions and not guessable from anything else. ## Sources - Anthropic pricing: https://platform.claude.com/docs/en/docs/about-claude/pricing Run the free Cost Leak Scan: https://app.getculpa.com/scan?source=pseo&slug=context-overflow-cost&cluster=problem Machine-readable index of every guide: https://getculpa.com/api/pages Human-readable index of every guide: https://getculpa.com/guides Site overview: https://app.getculpa.com/llms.txt Privacy: Culpa runs on your infrastructure. Your prompts and responses never leave it. Culpa counts calls to run your plan, and it fails open, so if it ever breaks your app keeps running.