Real-time and accurate short-term traffic prediction can effectively improve traffic efficiency, reduce accidents, and facilitate relevant departments to take reasonable traffic guidance measures. Therefore, we propose a two-level data driven model for short-term traffic prediction in an edge computing environment. Firstly, a Deep Belief Network (DBN) is developed to extract the traffic characteristics between the road occupancy and road flow collected by the deployed detectors. Then, we predict the developed future road flow of each road segment based on the output of the DBN, which would be used as one of the inputs of a Hidden Markov Model (HMM). Finally, a HMM is developed to predict the future road speed of each road segment characterizing the statistical relationship between the road flow and road speed. To validate the effectiveness of our proposed model, the data from the Performance Measurement System (PeMS) of the California Department of Transportation is applied. Simulation results show that our proposed model has better prediction performance in short-term traffic prediction than other models.