arXiv cs.AI· Lars Krupp, Daniel Gei{\ss}ler, Francisco M. Calatrava-Nicolas, Stefan Gerd Fritsch, Paul Lukowicz, Jakob Karolus·· 2 小时前AI 评分39
LLM 预填充与解码阶段计算时间和能耗的真实成本研究
The Real Cost of Context: Predicting Compute Time and Energy Consumption in LLM Prefill and Decode Phases
AI 导读
一项 arXiv 研究系统测量了大语言模型在不同 prefill（输入）与 decode（输出）token 长度下的计算时间和能耗。结果表明 decode 的计算时间与能耗随输出长度线性增长，而 prefill 呈现线性和二次混合增长，说明长上下文工作负载中输入上下文是重要能耗因素。
正文 · 原文
Abstract:The integration of Large Language Models (LLMs) into agentic architectures has substantially increased token consumption, raising concerns about their energy footprint. Yet, estimating the energy consumption of proprietary API-based models remains challenging, and existing approaches focus primarily on generated output tokens while overlooking the impact of the large input contexts characteristic of agentic workflows. To address this gap, we systematically profile compute time and energy consumption across a wide range of prefill (input) and decode (output) token lengths. Using generalized linear models, we show that decode compute time and energy scale linearly with output length, whereas prefill compute time and energy exhibit both linear and quadratic scaling with input length. These findings demonstrate that input context becomes a relevant factor for large-context workloads. Furthermore, we show that compute time serves as a reliable proxy for energy consumption when direct energy measurements are unavailable. Our mapping framework enables precise energy estimation and supports more sustainable deployment decisions for agentic AI.
| Subjects: | Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2610.39621 [cs.AI] |
| (or arXiv:2610.39621v1 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2610.39621 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Lars Krupp [view email]
[v1]
Thu, 29 Oct 2026 08:50:32 UTC (186 KB)
来源：arXiv cs.AI · arxiv.org