基于相似图像配准的图像修复算法

Image Inpainting Approach Using Similar Image Registration

  • 摘要: 传统基于纹理合成的图像修复算法只能从破损图像中提取有用信息,不能修复复杂结构;基于深度学习的修复算法训练时间长,纹理合成效果不理想。为解决上述问题,该文提出了一种基于相似图像配准的图像修复算法。首先提出一种破损图像的相似度计算方法,利用图像的深度学习特征,在数据库中寻找与之最为相近的图像,为修复过程提供更多的有效信息;然后对破损图像和相似图像进行配准,利用单应性变换实现图像空间位置的自动粗纠正;最后使用改进的最佳匹配块搜索方法和匹配准则来改善纹理合成效果,实现图像的最终修复。仿真实验结果表明,该方法可以获得较多的有用信息,产生良好的纹理合成效果,克服了传统算法和深度学习方法的缺点,即使对于具有复杂纹理信息和结构的破损图像,也能够得到良好的修复效果。

     

    Abstract: The traditional texture synthesis image inpainting approaches can only extract useful information from the damaged image, but cannot deal with the complex structures. In the meanwhile, the deep-learning-based ones usually have long training time and unsatisfactory texture synthesis effects. To solve the problems, this paper proposes an image inpainting approach based on similar image registration. First, a similarity calculation method of damaged image is proposed by using the deep learning features of images, thus the most similar image of the damaged ones in dataset can be found to provide more useful information for the image inpainting process. Second, this paper matches the damaged image with its similar ones and use the homography transform to realize the automatic rough correction of image space position. At last, the texture synthesis effects are improved by using the improved optimal patch searching method and the relative matching criteria, then the image inpainting is performed. Simulation results demonstrate that the approach can obtain more useful information, yield perfect texture synthesis effect, and overcome the shortcomings of the traditional deep-learning-based and texture synthesis approaches. Besides that, the proposed approach can also obtain ideal inpainting effects even for the damaged images with complex textural information and structures.

     

/

返回文章
返回