Generally, the performance of endpoint detection is affected by the noise. In this paper, we propose a novel two-layer decision model based on noise classification to detect the activity voice robustly. The training processing mainly contains two steps: firstly, we employ the noisex-92 database, which consists of different types of pure noise, to train a BP neural network in order to classify the noise type precisely, secondly, we train BP neural networks for each noise type covering large range of signal noise ratio (SNR). In the testing phase, we assume that the short period of silence at the beginning of the signal contains features for noise and utilize them to get the noise type. Then, we use the classifier corresponding to the noise type to detect activity voice. We conduct experiments on TIMIT corpus for 5 noise types under 7 SNR conditions. And experimental results show that our method outperforms global classifier, especially in low SNR condition.