双特征引导超相关性的少样本分割网络

Dual-feature guided hypercorrelation few-shot segmentation network

  • 摘要: 少样本语义分割旨在仅有少数支持图像注释样本情况下学习从给定类的查询图像中分割目标对象,最近基于特征匹配的方法面对这一任务取得了显著成功。然而,多匹配关系带来更多的类间和类内噪声,为缓解高维卷积的运算压力而对权重进行稀疏化也导致了特征相关性的细粒度匹配精度损失。为了缓解上述问题,提出了双特征引导超关性的少样本分割网络(DFGHNet)。DFGHNet采用更加高效的4D卷积核以减少权重稀疏化导致的特征细粒度匹配精度损失,同时引入双特征掩码策略和采用不含可学习参数的非局部均值特征映射模块,在学习到的匹配模式进行相关性引导。在数据集PASCAL-5i、COCO-20i的标准少样本分割基准测试中,该方法的最大精度提升分别为4.8%和6.5%,验证了其有效性。

     

    Abstract: Few-shot semantic segmentation aims to learn to segment target objects from query images of a given category when only a few samples support image annotation. Recently, matching-based methods establish correlation matching of dense features through 4D convolution and introducing background correlation. However, multiple matching relationships bring more inter-class noise and intra-class noise, and the sparse weights to alleviate the computational pressure of high-dimensional convolution also led to the loss of fine-grained matching accuracy of feature correlation. To alleviate the above problems, A Dual-Feature Guided Hypercorrelation Few-shot Segmentation Network (DFGHNet) is proposed. DFGHNet uses a more efficient 4D convolution kernel to reduce the loss of feature fine-grained matching accuracy caused by weight sparsification. At the same time, it introduces a dual feature mask strategy and adopts a non-local mean feature mapping module without learnable parameters to guide the correlation in the learned matching pattern. In the standard few-shot segmentation benchmarks of PASCAL-5i and COCO-20i datasets, the performance of this method achieved the maximum accuracy improvement of 4.8% and 6.5% respectively, verifying the effectiveness of this method.

     

/

返回文章
返回