神经架构搜索研究进展与未来展望

Research progress and future prospects of neural architecture search

  • 摘要: 针对人工设计神经网络架构效率低、寻优困难等问题,梳理了神经架构搜索(NAS)领域近几年的研究进展,不同于传统综述逐一分析NAS核心组件的方式,该文基于2017年以来的NAS文献,构建了一个包含“核心方法−多目标优化−跨领域协同”的三维综述框架。通过分析,归纳出NAS基于强化学习、进化算法、梯度优化、零成本代理以及单次训练的5种核心方法,分析了这些方法对应的多目标优化策略,同时从硬件架构与领域知识融合两个层面探讨了跨领域协同机制。利用该三维分析框架,阐述了NAS技术的演进规律,指出了NAS在核心方法、多目标优化、跨领域协同方面面临的技术挑战和未来研究方向,为解决现有方法的问题提供了参考,有助于NAS技术的进一步发展。

     

    Abstract: To address the challenges of low efficiency and difficulty in optimizing manually designed neural network architectures, this paper reviews the research progress in neural architecture search (NAS) in recent years. Different from traditional reviews that often analyze NAS components individually, this paper builds a three-dimensional review framework based on NAS literature published since 2017, which includes core methods, multi-objective optimization, and cross-domain collaboration. Through analysis, five core NAS methods are identified: Reinforcement learning, evolutionary algorithms, gradient-based optimization, zero-cost proxies, and one-shot training. The corresponding multi-objective optimization strategies for these methods are analyzed, and cross-domain collaboration mechanisms are discussed from two aspects: hardware architecture integration and domain-specific knowledge fusion. Using this three-dimensional analysis framework, the paper describes the evolutionary patterns of NAS technologies, identifies technical challenges and future research directions in core NAS methods, multi-objective optimization, and cross-domain collaboration, and provides references for solving the problems of existing approaches. This contributes to the further development of NAS technologies.

     

/

返回文章
返回