arXiv cs.AI· Antonio Manjavacas, David Su\'arez-Caro, Alejandro Campoy-Nieves, Guillermo Rey, Gonzalo Satr\'ustegui, Miguel Molina-Solana·· 2 小时前AI 评分33
深度强化学习用于热泵与地暖控制:端到端案例研究
Deep Reinforcement Learning for Heat Pump and Underfloor Heating Control: An End-to-End Case Study
AI 导读
一项研究展示了面向地暖(UFH)与热泵(HP)集成系统的深度强化学习(DRL)控制器的端到端案例研究,覆盖开发、评估与实际部署。研究者先在仿真中比较不同 DRL 算法与控制策略,再基于真实住宅建筑构建数字孪生训练智能体,并将表现最佳的智能体直接部署到真实建筑、无需额外在线微调。
正文 · 原文
Abstract:Efficient control of underfloor heating (UFH) systems coupled with heat pumps (HPs) is challenging due to the high thermal inertia of buildings and the slow dynamic response of UFH systems. Deep Reinforcement Learning (DRL) offers a data-driven control approach capable of simultaneously optimizing energy consumption and thermal comfort. However, the application of DRL-based controllers in occupied buildings under real operating conditions remains limited. This work presents and end-to-end case study (development, evaluation, and real-world deployment) of a DRL-based controller for an integrated UFH-HP system. First, a simulation-based pilot study was conducted to assess different DRL algorithms, control strategies, and configurations. Subsequently, a digital twin of a real residential building was developed and used to train DRL agents under simulated operating conditions. The best-performing agent was then deployed in the physical building without additional online fine-tuning. The results show that the controller successfully maintained indoor temperatures within the prescribed comfort limits while dynamically adjusting the HP supply temperature and UFH valve positions. These findings demonstrate the feasibility of deploying DRL controllers in occupied buildings and highlight their robustness and the practical challenges associated with transferring control policies from digital environments to real heating systems.
| Comments: | Preprint submited to journal |
| Subjects: | Artificial Intelligence (cs.AI); Systems and Control (eess.SY) |
| ACM classes: | I.2.8; J.2 |
| Cite as: | arXiv:2611.23063 [cs.AI] |
| (or arXiv:2611.23063v1 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2611.23063 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Antonio Manjavacas [view email]
[v1]
Tue, 17 Nov 2026 16:54:25 UTC (6,989 KB)
来源:arXiv cs.AI · arxiv.org