In order to improve the security of watermark image, a scheme of quantum watermarking algorithm which is based on chaotic affine scrambling is proposed and it includes scrambling, embedding and extracting procedures. In the embedding process, the position and the color of the watermark image are scrambled by chaotic affine and the size of the scrambled watermark image is extended from 2n-1×2n-1 to 2n×2n. Meanwhile, the color value of the pixel is changed from 24-bits to 3-(1-bit per channel) bits. The extended watermark image is embedded into the carrier image through a two-bit embedding strategy, and the extraction process is the inverse one of the embedding process. The simulation results show that the proposed scheme is superior to the comparison scheme in terms of visual quality, peak signal-to-noise ratio (PSNR).