PCGRL 用于复杂平台游戏:通过膨胀包络与前向课程合成可玩且多样的关卡
PCGRL for Complex Platformers: Synthesizing Playable and Diverse Levels via Inflated Envelopes and Forward Curricula
AI 导读
一项 arXiv 研究提出物理感知、课程引导的 PCGRL 框架,用于自动生成复杂平台游戏关卡。该框架引入“Inflated Volume Envelope”机制将连续运动学可行性融入 MDP 离散状态空间,并通过中间状态转移反馈与多阶段前向扩展课程缓解长序列稀疏奖励问题,合成阶段还启用高熵随机推理配合事后并行拒绝过滤以提升地图多样性。
正文 · 原文
Abstract:Procedural Content Generation via Reinforcement Learning (PCGRL) has emerged as a promising paradigm for automated game development. However, existing PCGRL frameworks still suffer from severe exploration bottlenecks and scaling limitations when faced with long-sequence generation tasks governed by strict rigid-body rules and non-linear kinematic boundaries (e.g., platformer constraints). Consequently, traditional approaches frequently fail to maintain reliable level solvability on large-scale canvases. To address these challenges, we present a physics-aware, curriculum-guided PCGRL framework. First, we construct an "Inflated Volume Envelope" mechanism, which provides a physics-constrained representation that incorporates continuous kinematic feasibility into the discrete state space of the MDP. Second, to alleviate the sparse reward challenge induced by extremely long decision sequences, we introduce intermediate state-transition feedback and a multi-stage forward extension curriculum learning framework, enabling informative value estimation and stable credit assignment over long-horizon trajectories. Finally, to resolve the issue where deterministic policies after convergence generate highly monotonous map paths with a lack of diversity, we activate high-entropy stochastic inference during the synthesis phase, regularized by a post-hoc parallel rejection filtering mechanism. Experimental results demonstrate that our framework significantly enhances structural diversity while maintaining high physical playability across multi-scale environments. Comparative evaluations across multi-scale canvases demonstrate that our framework maintains superior convergence stability and dimensional scalability, reliably synthesizing solvable levels where traditional PCGRL baselines degrade.
| Comments: | 9 pages, 6 figures, 1 table |
| Subjects: | Machine Learning (cs.LG); Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2611.22250 [cs.LG] |
| (or arXiv:2611.22250v1 [cs.LG] for this version) | |
| https://doi.org/10.48550/arXiv.2611.22250 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Di Wu [view email]
[v1]
Tue, 17 Nov 2026 05:55:23 UTC (220 KB)
来源:arXiv cs.AI · arxiv.org