In recent years, the use of large language models (LLMs) for information retrieval has become as ubiquitous as using search engines like Google. However, the widespread adoption of these sophisticated AI models, such as Gab AI, introduces significant risks due to their open-source nature and massive scale. Gab AI promotes itself as an unbiased platform, yet it provides an opportunity for users to exploit the LLM for malicious purposes. This paper explores the literature surrounding the malevolent use of LLMs and investigates how open-source platforms like Gab AI can be manipulated to generate harmful content, orchestrate attack plans, and more. By examining the potential misuse of readily accessible LLMs like Gab AI, which, unlike many nefarious tools, do not require access via the dark web, this study aims to foster awareness and prompt discussions on mitigating the risks associated with these powerful technologies.