结合混合特征选择和Transformer的网络数据流异常检测

Network data anomaly detection combined with hybrid feature selection and transformer

  • 摘要: 智能学习方法在网络数据异常分析中发挥着重要作用,但传统智能化异常分析方法难以在网络数据分析结果的可解释性、异常分析的计算资源消耗量、网络数据流序列数据分析准确度上寻得平衡。为克服以上问题,提出了一种结合混合特征选择和Transformer的网络数据流异常检测模型,基于混合特征选择方法进行数据预处理,基于改进的Transformer进行异常检测。采用树模型与互信息的混合特征选择算法对网络数据特征进行降维。采用Transformer的Encoder部分作为分类任务的核心,并融入卷积操作来增强对网络数据流序列数据的局部感知能力,通过分类头进行输出。对所提方法进行了仿真实验,在公共入侵检测数据集CICIDS2017上进行验证,实验结果表明,本模型能对网络数据流异常进行有效检测,优于所对比的基于神经网络的现有入侵检测方法。

     

    Abstract: The intelligent learning method plays a crucial role in network data anomaly analysis. However, traditional intelligent anomaly analysis methods often struggle to strike a balance among the interpretability of network data analysis results, the consumption of computing resources for anomaly analysis, and the accuracy of analyzing network data stream sequences. To address these challenges, a novel network data flow anomaly detection model combining hybrid feature selection and Transformer is proposed. This model conducts data preprocessing via a hybrid feature selection method and performed anomaly detection based on an enhanced Transformer model. A hybrid feature selection algorithm, utilizing both tree models and mutual information, is employed to reduce the dimensionality of network data features. The Encoder part of the Transformer serves as the core of the classification task, and convolution operations are integrated to enhance the local perception ability of network data stream sequences. Classification is then performed using a classification header. The proposed method has been simulated and validated using the publicly available intrusion detection dataset CICIDS2017. Experimental results demonstrate that the proposed model effectively detects network data flow anomalies, outperforming existing intrusion detection methods based on neural networks.

     

/

返回文章
返回