We report here an acidic polysaccharide, namely RSP-3, which ameliorates acute kidney injury and is obtained from Sanguisorba officinalis. We extracted and purified two polysaccharides from this herb based on the acidity and screened them for their effect in regulating the immunological activity of macrophages. Among them, RSP-3 exhibited significant anti-inflammatory activity against lipopolysaccharide (LPS)-stimulated macrophages by decreasing TNF-α and IL-6 levels. Subsequently, we found that RSP-3 suppressed ER stress, reduced ROS production and blocked NF-κBp65 translocation. After fully characterizing RSP-3 with a series of analytical technologies, we tested its anti-acute kidney injury (AKI) effect in vivo. In a murine AKI model induced by LPS, treatment with RSP-3 effectively ameliorated renal function. Besides, it decreased the levels of TNF-α and IL-6 in serum and reduced macrophage infiltration in injured kidney tissue. In sum, RSP-3, with a significant protective effect against AKI by showing anti-inflammatory activity, may become a meaningful drug candidate for treatment of AKI.