The global emphasis on energy efficiency and sustainability has underscored the importance of retrofitting existing buildings to reduce energy usage and carbon emissions. Academic facilities, such as university buildings, are key in this regard, as they often house large populations and are old buildings. However, retrofitting such old buildings can be difficult due to the lack of data and knowledge. To alleviate this challenge, this study proposes a novel energy retrofits-focused scan-to-building information modeling (BIM) process framework based on a comprehensive literature review and case study. This study aims to answer the research question: How should a scan-to-BIM process be developed to support the energy retrofit processes of academic facilities? The proposed framework has four main components: (1) terrestrial laser scanning (TLS), (2) point cloud processing, (3) BIM modeling, and (4) incorporation of energy retrofits-specific attributes. A real-life case study of an academic facility is performed to illustrate the application and usefulness of the framework. Challenges associated with the framework are identified, including data collection, noise reduction, manual intervention, interoperability, and cost challenges. Theoretically, the outcomes of this study provide new insights into how to develop an energy retrofits-ready scan-to-BIM model and the associated challenges. Practically, the study offers practitioners a framework to guide the implementation of energy retrofit-focused scan-to-BIM processes.