基于多模态注意力的人脸属性编辑算法
首发时间:2025-03-14
摘要:针对人脸属性编辑任务中的全局语义控制与局部精准调整的矛盾问题,本文提出了一种基于多模态注意力的人脸属性编辑算法。通过引入梯度加权类激活映射动态关联文本语义与特征图,实现编辑区域的自适应定位;设计多目标损失函数,联合优化图像-文本语义对齐损失、身份控制损失及局部注意力约束损失,平衡全局语义控制与局部细节调整。实验表明,该方法能够在保持非目标区域不变的前提下实现局部属性的精准调整,在黄种人脸数据集上的图像-文本语义相似度、身份保持率与学习感知图像块相似度指标均优于基线模型,验证了其在细粒度五官编辑中的有效性与鲁棒性。
For information in English, please click here
Face Attribute Editing Algorithm Based on Multimodal Attention
Abstract:To address the conflict between global semantic control and local precise adjustment in facial attribute editing tasks, this paper proposes a facial attribute editing algorithm based on a multimodal attention mechanism. By introducing gradient-weighted class activation mapping (Grad-CAM) to dynamically associate textual semantics with generator feature maps, adaptive localization of editing regions is achieved. A multi-objective loss function is designed to jointly optimize image-text semantic alignment loss, identity preservation loss, and local attention constraint loss, balancing the contradiction between global semantic control and local detail adjustment. Experiments demonstrate that the proposed method enables precise adjustment of local attributes while maintaining unchanged non-target regions. On the Yellow race face dataset, the algorithm outperforms baseline models in terms of image-text semantic similarity, identity retention rate, and learned perceptual image patch similarity (LPIPS), validating its effectiveness and robustness in fine-grained facial feature editing.
Keywords: Artificial Intelligence; Facial Attribute Editing; Multimodal; Attention
基金:
引用

No.****
同行评议
勘误表
基于多模态注意力的人脸属性编辑算法
评论
全部评论