This paper discusses a leader-following consensus problem of second-order multi-agent systems with nonlinear dynamics and directed communication topology based on quantized information. The communication signals between the neighbor agents are quantized and sent over communication channels. A new consensus controller based on the quantized information is proposed. Based on Lyapunov theory and sliding mode control strategy, it is proved that the proposed distributed controller can drive the states of multi-agent systems to reach the leader-following consensus. Two simulation examples are given to illustrate the effectiveness of the proposed approach.