Various sparsity-based methods have been widely used in hyperspectral image (HSI) classification. To determine the class label of a test sample, traditional sparsity-based frameworks mainly use the sparse vectors to compute the residual error for classification. In this paper, a novel sparsity-based framework is proposed, which adopts the max pooling operation for HSI classification. Compared with the traditional sparsitybased frameworks using residual error, sparse vectors in our proposed framework are utilized to generate the feature vectors using max pooling operation. Experimental results demonstrate that our proposed framework can achieve the state-of-the-art classification performance.