Advancements of immersive technologies like virtual reality (VR) have created a possibility to virtualize desktop workspaces, allowing users to work on their desktop computers with more flexibility rather than being constrained to certain physical spaces. However, current virtual screen interaction methods, which rely on controllers or mid-air gestures, often result in user fatigue. Aiming to solve this issue, we propose a new system that leverages only consumer-grade devices to let users perceive and interact with tangible objects like mouses, keyboards, and users’ hands in VR. We implemented and evaluated two ways of representing physical objects on physical desktop workspaces and users’ interactions with them in VR. Furthermore, we developed an exemplary application which integrates our system into a VR control tower, which can be used for training air-traffic controllers as well as can serve as an experimental environment for air-traffic control and management research.