Interference from task-irrelevant stimuli can occur during the semantic and response processing stages. Previous studies have shown both common and distinct mechanisms underlying semantic conflict processing and response conflict processing in the visual domain. However, it remains unclear whether common and/or distinct mechanisms are involved in semantic conflict processing and response conflict processing in the cross-modal domain. Therefore, the present electroencephalography study adopted an audiovisual 2-1 mapping Stroop task to investigate whether common and/or distinct mechanisms underlie semantic conflict and response conflict. Behaviorally, significant cross-modal semantic conflict and significant cross-modal response conflict were observed. Electroencephalography results revealed that the frontal N2 amplitude and theta power increased only in the semantic conflict condition, while the parietal N450 amplitude increased only in the response conflict condition. These findings indicated that distinct neural mechanisms were involved in cross-modal semantic conflict and response conflict processing, supporting the domain-specific cognitive control mechanisms from a cross-modal multistage conflict processing perspective.