Due to its relatively high terrain (with an elevation ranging from 433 to 468 m) and the prevalence of mountains, the Loess Plateau in Shaanxi Province, China, gives rise to a unique tableland climate, characterized by frequent heavy rains and significant temperature differences. Therefore, the people living here have resorted to cave dwellings to mitigate the adverse impacts brought about by extreme weather conditions. However, due to the inherent drawbacks of cave dwellings, they gradually fail to meet people’s needs for a happy life. At the same time, with the advent of the low-carbon era, the use of “high-performance” devices such as air conditioners is not advocated. Hence, we look back at the excellent “low-tech” traditional architectural methods in this region and hope to find buildings that are not only energy-efficient but also adaptable to the harsh local climate. Taking the local residential types as the research objects, we conducted thermal simulations of the indoor environment, and carried out qualitative analysis and on-site measurements. It was found that the “two-story cave building” in Fenghuo Village, Xianyang City, Shaanxi Province, can better adapt to the local climate compared with the surrounding traditional buildings. This research can be used to guide the energy-efficient architectural design in the surrounding areas.