arXiv cs.AI· Asiri Gawesha Lindamulage, Sanka Mohottala, Dharshana Kasthurirathna, Nuwan Kodagoda·· 4 小时前AI 评分33
STAG-Net：基于关键点组的结构感知注意力实现轻量级头部姿态估计
STAG-Net: Structure-Aware Attention over Landmark Groups for Lightweight Head Pose Estimation
AI 导读
研究者提出 STAG-Net，一种基于面部关键点组的结构感知注意力轻量级头部姿态估计方法，在 300W-LP、AFLW2000 和 BIWI 的跨数据集与受试者独立评测中，所有设置下误差均为关键点类方法最低。
正文 · 原文
Abstract:Head pose estimation is important for human computer interaction and driver monitoring, but many image based methods remain too costly for resource constrained deployment. We propose STAG-Net, a structure-aware attention over landmark groups for lightweight head Pose estimation that estimates head pose from facial landmarks using movement aware selection, spatial clustering, compact DeepSet encoders, self attention, and a global geometry descriptor. We develop variants using FaceMesh and Face Alignment Network landmarks and evaluate them under cross dataset and subject independent protocols on 300W-LP, AFLW2000, and BIWI. STAG-Net achieves the lowest mean absolute error among all compared landmark based methods in every evaluated setting. On BIWI frames with valid detections, the FAN variant also records the lowest overall error among all compared methods, reaching $3.51^\circ$ under cross dataset evaluation and $2.39^\circ$ under subject independent evaluation. The regressors use only 0.012 to 0.043 million parameters and 24.1 to 83.6 thousand FLOPs, about three orders of magnitude fewer FLOPs than FSA-Net. Despite including landmark extraction and regression, the FaceMesh pipeline reaches 322.9 frames per second on a Tesla T4 GPU, nearly twice the 164.5 frames per second of the fastest measured image based baseline, and 111.0 frames per second on CPU. After normalization by dataset size, STAG-Net processes training samples seven to eight times faster than FSA-Net and more than one hundred times faster than HopeNet and TokenHPE, while complete training finishes within 28 minutes. These results show that STAG-Net combines leading landmark based accuracy with substantially lower training and inference cost.
| Subjects: | Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC) |
| Cite as: | arXiv:2611.07828 [cs.CV] |
| (or arXiv:2611.07828v1 [cs.CV] for this version) | |
| https://doi.org/10.48550/arXiv.2611.07828 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Asiri Gawesha Lindamulage [view email]
[v1]
Thu, 5 Nov 2026 11:09:34 UTC (4,508 KB)
来源：arXiv cs.AI · arxiv.org