This paper briefly introduced the development of video face detection and point out the shortage of current face detection system that may produce much of false alarms. Then we detail the classic Viola face detector which using integral image, Haar-like features and AdaBoost algorithm for training. Compared with Viola face detector, we proposed an available multi-model fusion method to reduce false alarms in video face detection that is combining head-shoulder detector with HOG features. After introduced the related knowledge of HOG features, we proposed a fusion detector structure which can improve the accuracy and efficiency of detection. © 2013 Trans Tech Publications Ltd, Switzerland.