Oplopanax horridus is a plant native to North America. Previous reports have demonstrated that this herb has antiproliferative effects on cancer cells but study mostly focused on its extract or fractions. Because there has been limited phytochemical study on this herb, its bioactive compounds are largely unknown. We recently isolated and identified 13 compounds, including six polyynes, three sesquiterpenes, two steroids, and two phenolic acids, of which five are novel compounds. In this study, we systemically evaluated the anticancer effects of compounds isolated from O. horridus. Their antiproliferative effects on a panel of human colorectal and breast cancer cells were determined using the MTS assay. Cell cycle distribution and apoptotic effects were analyzed by flow cytometry. The in vivo antitumor effect was examined using a xenograft tumor model. Among the 13 compounds, strong antiproliferative effects were observed from falcarindiol and a novel compound oplopantriol A. Falcarindiol showed the most potent antiproliferative effects, significantly inducing pro-apoptosis and cell cycle arrest in the S and G2/M phases. The anticancer potential of falcarindiol was further verified in vivo, significantly inhibiting HCT-116 tumor growth in an athymic nude mouse model at 15 mg/kg. We also analyzed the relationship between polyyne structures and their pharmacological activities. We observed that both the terminal hydroxyl group and double bond obviously affected their anticancer potential. Results from this study supplied valuable information for future semi-synthesis of polyyne derivatives to develop novel cancer chemopreventive agents.