The subject of this study is to explore the role of cardinality of hesitant fuzzy element (HFE) in distance measures on hesitant fuzzy sets (HFSs). Firstly, three parameters, i.e., credibility factor, conservative factor, and a risk factor are introduced, thereafter, a series of novel distance measures on HFSs are proposed using these three parameters. These newly proposed distance measures handle the relationship between the cardinal number and the element values of hesitant fuzzy set well, and are suitable to combine subjective and objective decision-making information. When using these functions, decision makers with different risk preferences are allowed to give different values for these three parameters. In particular, this study transfers the hesitance degree index to a credibility of the values in HFEs, which is consistent with people's intuition. Finally, the practicability of the newly proposed distance measures is verified by two examples.