In recent times, there has been a tremendous advancement in Quantum computing and quantum-based secure algorithms. This paper suggested a secure image encryption scheme using chaotic maps and quantum gate operators. The proposed quantum image encryption comprises quantum image scrambling and qubit diffusion stages. The suggested framework introduces an adaptive plain image-related secret key generation mechanism to ensure resistance toward differential attacks. The strength of the proposed scheme is evaluated under standard images and the simulation results indicate that the proposed system has resistance to cryptanalytic attacks. This proves the effectiveness and security of the proposed quantum-based image encryption.