The advent of Generative Pre-trained Transformers (GPT) has significantly advanced artificial intelligence across various global sectors, offering transformative potential and diverse possibilities for personalized learning at different educational levels. While GPT enables educators to leverage technology for enhanced teaching quality and efficiency, a substantial gap remains between the envisioned and actual implementation of this technology in STEM higher education environments. This study aims to focus on the application of the GPT in diverse educational contexts and the challenges encountered in its implementation. By conducting a systematic literature review, the researcher will critically examine and analyze the current state of GPT applications in higher education, especially with STEM-related subjects. Furthermore, the researcher will discuss concepts related to digital technology and educational equity through the analysis of peer-reviewed articles and relevant research reports. Importantly, this research seeks to address the existing gaps in GPT research within STEM higher education across different national contexts, providing innovative perspectives on leveraging AI to improve educational outcomes. The study is driven by two primary research questions: What are the primary applications of ChatGPT in STEM higher education? What challenges and limitations are encountered in the implementation of ChatGPT in STEM higher education? The research findings will identify the key applications of the ChatGPT language model in the field of STEM higher education and its impact on student learning outcomes, teaching efficiency, and educational equity. In addition, the researchers will also explore major challenges like possible technical limitations and ethical issues in the use of GPT by students. The findings from this study will offer valuable insights and practical recommendations to educators, policymakers, and researchers, guiding them in effectively integrating GPT into higher education and supporting the sustainable development of STEM education and digital education.