Rabdosia serra (R. serra), an important component of Chinese herbal tea, has traditionally been used to treat hepatitis, jaundice, cholecystitis, and colitis. However, the chemical composition of R. serra and its effect against colitis remain unclear. In this study, the chemical composition of the water extract of R. serra was analyzed using ultra performance liquid chromatography coupled with a hybrid linear ion trap quadrupole-orbitrap mass spectrometer (UPLC-LTQ-Orbitrap-MS). A total of 46 compounds, comprising ent-kaurane diterpenoids, flavonoids, phenolic acids, and steroids, were identified in the water extract of R. serra, and the extract could significantly alleviate dextran sulfate sodium salt-induced colitis by improving colon length, upregulating anti-inflammatory factors, downregulating proinflammatory factors, and restoring the balance of T helper 17/T regulatory cells. R. serra also preserved intestinal barrier function by increasing the level of tight junction proteins (zonula occludens 1 and occludin) in mouse colonic tissue. In addition, R. serra modulated the gut microbiota composition by increasing bacterial richness and diversity, increasing the abundance of beneficial bacteria (Muribaculaceae, Bacteroides, Lactobacillus, and Prevotellaceae_UCG-001), and decreasing the abundance of pathogenic bacteria (Turicibacter, Eubacterium_fissicatena_group, and Eubacterium_xylanophilum_group). Gut microbiota depletion by antibiotics further confirmed that R. serra alleviated colitis in a microbiota-dependent manner. Overall, our findings provide chemical and biological evidence for the potential application of R. serra in the management of colitis.