IIG-VSAD:基于实例信息引导的视频流行为检测方法

IIG-VSAD: Instance information-guided video stream action detection

  • 摘要: 视频流时序行为检测要求在仅观测到历史及当前时空信息的条件下,于在线视频流中准确检测当前时刻的行为类别。现有方法主要通过设计网络并利用帧级信息进行监督学习,对单帧信息过度敏感,缺乏时序一致性,导致检测准确性不足。针对以上问题,提出实例信息引导的视频流行为检测方法,在单帧检测基础上扩增实例信息,提出实例图推理策略生成导引,融合时序特征提升检测性能。于公开视频数据验证实验结果,证明了该方法的有效性且具备高效的检测效率。

     

    Abstract: Action detection in video streams requires accurately identifying the action category at the current moment within an online video stream, given only the historical and current spatiotemporal information observed up to that point. These approaches are overly sensitive to single-frame information and lack temporal consistency, resulting in insufficient detection accuracy. Existing methods primarily design networks and use frame-level information for supervised learning, which makes them overly sensitive to single-frame information and lacks temporal consistency, resulting in insufficient detection accuracy. To address the aforementioned issues, we propose an instance-guided video stream action detection method. Building upon frame-level detection, we augment the instance information and introduce an instance graph reasoning strategy to generate guidance. Temporal features are then integrated to enhance detection performance. The proposed algorithm is validated on publicly available video datasets, and experimental results demonstrate the effectiveness of the method and its high detection efficiency.

     

/

返回文章
返回