This paper presents a novel multimodal model that integrates both image and large language model capabilities to enhance hate intensity prediction, traditionally a purely text-based task. Accurately assessing hate speech intensity is crucial for moderating and regulating vast online communities by normalizing hate speech [1], while ensuring a balance between free expression and responsible communication. Our approach leverages insights from both the visual and language domains, resulting in the novel Multimodal Model for Hate Speech (MMHS). We demonstrate that MMHS achieves state-of-the-art performance on the NACL dataset, surpassing previous benchmarks by scoring 0.350 lower in Root Mean Squared Error (RMSE) and 0.132, and 0.012 higher in Pearson, and Cosine metrics, respectively. Additionally, user preference surveys indicate a significant favoring of our predictions over those of Masud et al. [1] by 16.67%. This work advances the technical landscape of hate speech detection and enriches our understanding of online discourse, enabling more effective moderation strategies. (Disclaimer: This paper includes examples of hate speech which contain some profane words. These examples are only included for contextual understanding. We tried our best to censor vulgar, offensive, or hateful words. We assert that we do not support these views in any way.)