Environmental conditions affect the accuracy of field measurements used to monitor civil structures. Previous studies have shown that measured dynamic responses often lack the sensitivity needed for effective localized damage detection. To address this issue, our study focuses on distinguishing environmental effects from damage related effects in measured data to enhance vibration-based damage identification methods. Experimentally, the problem of prestress loss in a prestressed concrete bridge model was examined. By adjusting the prestressing force in a large-scale concrete bridge model, cracking phenomena were observed. To demonstrate field monitoring of a large-scale prestressed structure, noise recording was performed and the measurement data was analyzed with operational modal analysis. Additionally, ultrasonic testing, known for its high sensitivity in damage localization, was used to cross-check the structural damage. Seismic and coda wave interferometry were also employed to estimate wave velocities, providing insights into the level of prestress loss and temperature sensitivity. Ultimately, these measurable wave properties help to overcome the uncertainties associated with traditional vibration-based damage detection methods.