IIG-VSAD:基于实例信息引导的视频流行为检测方法

IIG-VSAD: Instance information-guided video stream action detection

  • 摘要: 视频流时序行为检测要求在仅观测到历史及当前时空信息的条件下,于在线视频流中准确检测当前时刻的行为类别。现有方法主要通过设计网络并利用帧级信息进行监督学习,对单帧信息过度敏感,缺乏时序一致性,导致检测准确性不足。针对以上问题,提出实例信息引导的视频流行为检测方法,在单帧检测基础上扩增实例信息,提出实例图推理策略生成导引,融合时序特征提升检测性能。于公开视频数据验证实验结果,证明了该方法的有效性且具备高效的检测效率。

     

    Abstract: Action detection in video streams requires accurately identifying the action category at the current moment within an online video stream, given only the historical and current spatiotemporal information observed up to that point. The existing methods mainly conduct supervised learning by designing networks and using frame-level information, which are overly sensitive to single-frame information and lack temporal consistency, resulting in insufficient detection accuracy. To address the aforementioned issues, an instance-guided video stream action detection method is proposed. Building upon frame-level detection, instance information is augmented, an instance graph reasoning strategy is proposed for generating guidance, and temporal features are then integrated to enhance detection performance. Finally, the proposed algorithm is validated on publicly available video datasets, and experimental results demonstrate the effectiveness of the method and its high detection efficiency.

     

/

返回文章
返回