Abstract: According to side-bias characteristics of motion perception towards random-dot video stimuli among some middle temporal cortex (MT) cells in the experiment, a model for motion feature extraction of random-dot video sequences with the visual cortex mechanism is proposed for exploring the visual cortex mechanism underlying multi-direction motion information processing. First, Von Mises function is used to model receptive fields of simple cells in primary visual cortex (V1). A nonlinear energy model unturned and tuned normalization operation is adopted to simulate the direction perception of V1 complex cells; then, with the feedforward and cascade method, the responses of V1 model are pooled through a set of linear weights, thus giving rise to the responses of MT cells. The simulation results are generally consistent with the experimental data of rhesus monkeys. It can model the motion perception and feature extraction mechanism underlying multi-direction random-dot video sequences at different direction separations in visual cortex. So that it can provide new ideas for extracting features of complex motion sequences and lay the foundation for the visual brain-like computation for the further step.