Histone methylation plays a key function in modulating gene expression, and preserving genome integrity and epigenetic inheritance. However, aberrations of histone methylation are commonly observed in human diseases, especially cancer. Lysine methylation mediated by histone methyltransferases can be reversed by lysine demethylases (KDMs), which remove methyl marks from histone lysine residues. Currently, drug resistance is a main impediment for cancer therapy. KDMs have been found to mediate drug tolerance of many cancers via altering the metabolic profile of cancer cells, upregulating the ratio of cancer stem cells and drug-tolerant genes, and promoting the epithelial-mesenchymal transition and metastatic ability. Moreover, different cancers show distinct oncogenic addictions for KDMs. The abnormal activation or overexpression of KDMs can alter gene expression signatures to enhance cell survival and drug resistance in cancer cells. In this review, we describe the structural features and functions of KDMs, the KDMs preferences of different cancers, and the mechanisms of drug resistance resulting from KDMs. We then survey KDM inhibitors that have been used for combating drug resistance in cancer, and discuss the opportunities and challenges of KDMs as therapeutic targets for cancer drug resistance.