The quantum dimer magnet, with antiferromagnetic intradimer and interdimer Heisenberg exchange between spin-1/2 moments, is known to host an \((\left|\uparrow \downarrow \right\rangle -\left|\downarrow \uparrow \right\rangle )/\sqrt{2}\) singlet ground state when the intradimer exchange is dominant. Rare-earth-based quantum dimer systems with strong spin-orbit coupling offer the opportunity for tuning their magnetic properties by using magnetic anisotropy as a control knob. Here, we present bulk characterization and neutron scattering measurements of the quantum dimer magnet Yb2Be2SiO7. We find that the Yb3+ ions can be described by an effective spin-1/2 model at low temperatures and the system does not show signs of magnetic order down to 50 mK. The magnetization, heat capacity, and neutron spectroscopy data can be well-described by an isolated dimer model with highly anisotropic exchange that stabilizes a singlet ground state with a wavefunction \((\left|\uparrow \uparrow \right\rangle -\left|\downarrow \downarrow \right\rangle )/\sqrt{2}\) or \((\left|\uparrow \uparrow \right\rangle+\left|\downarrow \downarrow \right\rangle )/\sqrt{2}\) . Our results show that strong spin-orbit coupling can induce unusual entangled states of matter in quantum dimer magnets.