The prevalence of workaholism has negative consequences on human health. Lack of sleep, a well-known problem among adults in modern society, is often attributed to overwork as a result of workaholism. Yet there is a lack of empirical research examining how and when workaholism will lead to sleep problems. To answer this question and to examine the longitudinal effect of workaholism on sleep in China, we investigate the mediating role of perceived evening responsibilities of work and the moderating effect of work autonomy. Two hundred and five Chinese working adults (58.0% female) voluntarily completed the online questionnaires at Time 1 (T1) and Time 2 (T2; 1-month later). Results showed that workaholism at T1 had a significant and positive correlation with sleep problem at T2. Further analysis suggested that perceived evening responsibilities of work fully mediated the relationship between workaholism and sleep problem. Work autonomy was shown to buffer the positive effect of workaholism on perceived evening responsibilities of work and attenuate the indirect effect of workaholism on sleep problem. While workers should be made aware of the negative impact of workaholism on sleep, organizations should also consider interventions to enhance employees’ autonomy and control of their work.