HASM:空间结构预测结合线描稿辅助引导下的敦煌壁画修复

HASM: Restoration of dunhuang murals with spatial structure prediction and line drawing assisted guidance

  • 摘要: 为解决敦煌壁画修复难的问题,尤其是对于洞窟顶部曲面壁画破损修复,提出了空间结构预测结合线描稿辅助引导下的敦煌壁画修复算法(holistic attraction sketch model, HASM)。为突出壁画的空间结构,首次考虑壁画的空间结构以及洞窟曲面信息,采用线框解析器,引入了简约形式的4D几何向量空间来编码线框中的线段,提取线段并采用连接生成、匹配、验证算法,使用线段遮掩算法,结合空间结构预测模块和壁画边缘提取,并配合完整壁画线描稿数据集引导,设计了壁画图像的空间框辅助解析网络(L-HAT)。为减少修复过程中对壁画边缘信息的损失,引入空间结构注意力,设计了壁画修复模型。使得模型不仅可以修复平面破损,而且对破损面积较大的壁画依旧有较好的修复效果。实验结果表明,该模型较好地保留了修复过程中洞窟的结构信息,还原了洞窟曲面结构信息,解决了曲面洞窟壁画修复难的问题。

     

    Abstract: To solve the problem of difficult restoration of Dunhuang murals, especially for the damaged surface murals on the top of caves, a Dunhuang mural restoration algorithm (HASM) based on spatial structure prediction combined with line drawing assisted guidance is proposed. To highlight the spatial structure of the mural, the spatial structure of the mural and the surface information of the cave were considered for the first time. A wireframe parser was used, and a simplified 4D geometric vector space was introduced to encode the line segments in the wireframe. The line segments were extracted and connected using connection generation, matching, and verification algorithms. The line segment masking algorithm was used, combined with the spatial structure prediction module and mural edge extraction, and guided by the complete mural line drawing dataset. A spatial box assisted parsing network (L-HAT) for mural images was designed. To reduce the loss of mural edge information during the restoration process and bring in spatial structure attention, this paper designs a mural restoration model. This allows the model to not only repair flat damages, also maintain a good repair effect on murals with large damaged areas. The experimental results show that this model effectively preserves the structural information of the cave during the restoration process, restores the surface structure information of the cave, and solves the problem of difficult restoration of cave murals on curved surfaces.

     

/

返回文章
返回