Traditional on-site and remote cultural visits face challenges such as geographical constraints, limited accessibility, and difficulties in promoting presence and social engagement for remote visitors. Hybrid cultural visits, integrating physical and virtual elements, offer a promising solution to enhance accessibility and inclusivity while combining the strengths of both formats. To explore future design directions, we conducted a usability study to evaluate user experiences during hybrid gallery visits, focusing on communication, engagement, and emotional connectivity. The study employed a two-round methodology: one participant engaged with the gallery while interacting with a researcher via video, and vice versa. Quantitative data, collected through questionnaires, assessed mental immersion and social richness. The findings revealed that remote participants (RPs) experienced diminished control, passive engagement, and weaker emotional connections with both exhibits and on-site participants (OPs) compared to their on-site counterparts. These results highlight the limitations of current hybrid models for creating immersive and interactive remote experiences. The study contributes to research on hybrid cultural spaces, suggesting avenues for future studies and more inclusive frameworks for the Galleries, Libraries, Archives, and Museums (GLAM) sector.