Hyperspectral image (HSI) denoising is a prevalent research topic in the remote sensing area. In general, HSIs are inevitably impaired by different types of noise during the data acquisition. To fully characterize the underlying structures of clean HSI and remove mixed noises, we introduce a novel HSI denoising method named total variation-regularized bilinear factorization (BFTV) model. Specifically, we first utilize the bilinear factorization term to explore the globally low-rank structure of the clean HSI and suppress a certain degree of Gaussian noise, so as to make BFTV free to the singular value decomposition. Then the l-norm is applied to detect and separate the mixed sparse noise including impulse noise, deadlines, and stripes. Besides, the TV regularization is introduced to describe the locally piecewise smoothness property of the clean HSI both in spatial and spectral domains. To solve this optimization problem, we devise an effective algorithm based on the augmented Lagrange multiplier method. Numerical experiments on five different kinds of mixed noise scenarios and one real world data have tested and demonstrated the superior denoising power of the proposed BFTV model compared with three state-of-the-art low-rank-based approaches.