Herbs serve primary healthcare needs and some herbs are widely used as functional foods. Analysis of carbohydrates is essential to understand their structure–function relationships in food science and herbal medicine. However, accurately defining chemical structures of glycans is a challenge due to their chemical heterogeneity and diversity. We review and discuss carbohydrates as new functional ingredients in herbs and functional foods, and their analysis, a novel aspect in quality control and herbal glycomics.