Logo
Explore Help
Register Sign In
admin/1Cat-vLLM
Watch 1
Star 0 Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
Files
main
1Cat-vLLM/docs/serving
T
History
yangzhuxinyzxandClaude Opus 5.5 4d57473db6 [Frontend][SM70] Report cached prompt tokens in the Qwen3.8 release profile (#1299)
Enable --enable-prompt-tokens-details so responses carry
usage.prompt_tokens_details.cached_tokens and agent clients can see their
prefix-cache hits.

Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-29 01:56:36 +08:00
..
integrations
…
online_serving
[Bugfix] Report Anthropic prompt cache read statistics
2026-10-03 22:13:48 +08:00
context_parallel_deployment.md
…
data_parallel_deployment.md
…
distributed_troubleshooting.md
…
expert_parallel_deployment.md
…
offline_inference.md
…
parallelism_scaling.md
…
sm70_release_profile.md
[Frontend][SM70] Report cached prompt tokens in the Qwen3.8 release profile (#1299)
2026-10-29 01:56:36 +08:00
Powered by Gitea Version: 28.3.0 Page: 2101ms Template: 198ms
Auto
English
Bahasa Indonesia Deutsch English Español Français Gaeilge Italiano Latviešu Magyar nyelv Nederlands Polski Português de Portugal Português do Brasil Suomi Svenska Türkçe Čeština Ελληνικά Български Русский Українська فارسی മലയാളം 日本語 简体中文 繁體中文(台灣) 繁體中文(香港) 한국어
Licenses API