Page token budget
A page that does not fit an agent's context window gets truncated, so some of its content may be missed.
- Category
- Agent experience
- Standard
- Recommended
Who supports it
ClaudeSupported (announced)
Undated · last checked 9 Oct 2026: Claude API docs: Web fetch toolmax_content_tokens: 'If the fetched content exceeds this limit, the tool truncates it.' Docs give ~25,000 tokens for a 100 kB page. Browser use tool also caps read_page output at 50,000 characters.
GeminiPartial support
Published 23 Sept 2026 · last checked 9 Oct 2026: Gemini API docs: URL contextGemini API URL context: 'The maximum size for content retrieved from a single URL is 34MB'; up to 20 URLs per request; retrieved content counts toward input tokens. API tool, not necessarily the consumer Gemini app.
Claude CodeSupported (announced)
Published 5 Oct 2026 · last checked 9 Oct 2026: Claude Code CHANGELOG.md (anthropics/claude-code)v2.1.290 (npm release 2026-10-05): 'Fixed WebFetch silently dropping page text past 100,000 characters; it now says how much was unread and takes an offset to read on.' Matches this check's 100,000-character threshold.
24 others: no evidence yet. See every agent and browser
What it checks
The extension counts the characters of text on the page. It uses the rendered page when it can read it, and falls back to the text in the server’s HTML when it cannot. The check passes at 100,000 characters or fewer, which is roughly 25,000 tokens at four characters per token.
Past that point, an agent working within a context limit is likely to truncate the page, and whatever falls after the cut-off never gets read.
Results
| Status | When |
|---|---|
| Pass | The page has 100,000 characters of text or fewer |
| Warn | The page has more than 100,000 characters of text |
| Unmeasured | The rendered page could not be read and the HTML could not be fetched |
The result shows the character count and an approximate token count either way.
How to fix
Split oversized pages into focused documents, one topic each, and link them from an index page. Long reference pages, full changelogs and single-page documentation are the usual cases.
If you publish an llms.txt, list the smaller pages there so an agent can fetch only the one it needs.
Support by agent and browser
Announced means the vendor’s own docs or announcement say so. Published is the date on the vendor’s own page, where it has one. Checked is the last time our weekly research found that page still saying so.
| Agent | Status | Source |
|---|---|---|
| AI assistants | ||
| Claude Anthropic | Supported (announced) | Claude API docs: Web fetch tool Undated · Checked max_content_tokens: 'If the fetched content exceeds this limit, the tool truncates it.' Docs give ~25,000 tokens for a 100 kB page. Browser use tool also caps read_page output at 50,000 characters. |
| Gemini Google | Partial support | partial Gemini API docs: URL context Published · Checked Gemini API URL context: 'The maximum size for content retrieved from a single URL is 34MB'; up to 20 URLs per request; retrieved content counts toward input tokens. API tool, not necessarily the consumer Gemini app. |
| Coding agents | ||
| Claude Code Anthropic | Supported (announced) | Claude Code CHANGELOG.md (anthropics/claude-code) Published · Checked v2.1.290 (npm release 2026-10-05): 'Fixed WebFetch silently dropping page text past 100,000 characters; it now says how much was unread and takes an offset to read on.' Matches this check's 100,000-character threshold. |
No evidence yet24
- ChatGPT
- Perplexity
- Copilot
- Meta AI
- ChatGPT Atlas
- Comet
- Dia
- Gemini in Chrome
- Edge Copilot Mode
- Cursor
- Codex
- GitHub Copilot
- Windsurf
- CCBot
- Applebot
- Amazonbot
- Bytespider
- Cohere
- Mistral
- DuckAssist
- Chrome
- Edge
- Firefox
- Safari
Names and marks belong to their owners and are used only to identify products. None of these vendors is affiliated with Sitebulb. Spotted something out of date? Send a correction.
Adoption on the top 100 sites
97 of 97 measured sites implement it
Sites implementing it97
- #1 google.com
- #2 cloudflare.com
- #3 aws.amazon.com (via amazonaws.com)
- #4 facebook.com
- #5 gstatic.com
- #8 googleapis.com
- #9 microsoft.com
- #11 youtube.com
- #12 apple.com
- #13 instagram.com
- #15 mail.ru
- #16 x.com (via twitter.com)
- #18 linkedin.com
- #20 dzen.ru
- #23 googletagmanager.com
- #24 azure.microsoft.com (via azure.com)
- #26 m365.cloud.microsoft (via office.com)
- #27 outlook.live.com (via live.com)
- #32 github.com
- #33 wikipedia.org
- #37 fastly.com (via fastly.net)
- #39 whatsapp.com (via whatsapp.net)
- #42 bing.com
- #43 netflix.com
- #44 triplinkintl.com
- #45 googleusercontent.com
- #48 gandi.net
- #50 marketingplatform.google.com (via doubleclick.net)
- #52 uk.pinterest.com (via pinterest.com)
- #53 icloud.com
- #55 wordpress.org
- #56 teams.live.com (via skype.com)
- #57 cloudflare.net
- #59 goo.gl
- #60 digicert.com
- #61 adobe.com
- #63 tiktok.com
- #67 domains.google (via googledomains.com)
- #68 zoom.com (via zoom.us)
- #69 uk.yahoo.com (via yahoo.com)
- #70 sso.myfritz.net (via myfritz.net)
- #71 endpoints.news
- #75 roblox.com
- #76 opera.com
- #77 open.spotify.com (via spotify.com)
- #80 baidu.com
- #81 tiktokv.com
- #83 ya.ru (via yandex.net)
- #84 nginx.org
- #85 ntp.org
- #86 msn.com
- #87 qq.com
- #90 vimeo.com
- #91 primevideo.com (via amazonvideo.com)
- #93 bunny.net (via b-cdn.net)
- #94 blogger.com (via blogspot.com)
- #95 mozilla.org
- #96 f5.com
- #98 telegram.org (via t.me)
- #99 store.epicgames.com (via epicgames.com)
- #101 wordpress.com
- #103 reddit.com
- #106 sentry.io
- #107 letsencrypt.org (via lencr.org)
- #109 ui.com
- #110 european-union.europa.eu (via europa.eu)
- #112 chatgpt.com
- #114 st.okcdn.ru (via okcdn.ru)
- #116 bitly.com (via bit.ly)
- #117 ipify.org
- #119 nic.ru
- #120 samsung.com
- #121 office365.com
- #122 intuit.com
- #123 aliyuncs.com
- #127 openai.com
- #128 one.one.one.one (via cloudflare-dns.com)
- #130 registrar-servers.com
- #131 pages.github.com (via github.io)
- #132 dropbox.com
- #133 skybridge.click
- #135 discord.com (via discord.gg)
- #136 developer.adobe.com (via adobe.io)
- #139 apache.org
- #140 android.com
- #141 nih.gov
- #144 vk.ru
- #147 reg.ru
- #150 t-online.de
- #151 archive.org
- #152 forms.gle
- #153 webex.com
- #154 snapchat.com
- #156 godaddy.com
- #158 kaspersky.co.uk (via kaspersky.com)
- #159 firebase.google.com (via crashlytics.com)
- #160 tumblr.com
Overview
How this rating is worked out5 of 9 points
| Factor | Points | Why |
|---|---|---|
| Vendor support | 1 / 3 | 1 vendor supporting, 1 partly or planned |
| Top-100 adoption | 3 / 3 | 100% of measured sites |
| Spec maturity | 1 / 3 | Single-vendor spec |
8 or more points is Established, 5 to 7 is Gaining traction, 2 to 4 is Speculative and under 2 is Stalled. A feature is also Stalled when more vendors have said no than yes. Read the spec.
Community insights
No community insights for this feature yet.
Quotes are from public posts, checked against the original before they appear here. Suggest an insight, or ask for yours to be removed.