<p>Composite materials are the basic materials in contemporary engineering. A great body of research publications covers the composite materials based on polymer, metal, and ceramic matrices; however, data are scarce on the specific application of mineral binding materials as matrices. On the one hand, this review paper is aimed at analyzing the information available about the appropriate universal patterns that can be used to form composites with pre-determined properties, which would be common for a great variety of matrices and reinforcing components; and, on the other hand, this study is a research effort to provide convincing arguments for the prospects of using gypsum materials as composite building components. In the first part of this research, classification of composite materials is given in view of the structure and the geometry of their components along with the requirements for them. Examples are presented of the matrix, framed, laminated, and combined composites with gypsum-based matrices. The second part of the work shows that gypsum binders, depending on the degree of hydration, have different hardening mechanisms that ensure the unification of reinforcing elements (fillers) to a single conglomerate with more than 100&#xa0;MPa strength. The raw material sources for production include natural and synthesized materials, and the production technology is known to be one of the most eco-friendly among the processes used for manufacturing artificial materials. These methods allow increasing the strength of the matrix by two or more times. An informed choice of the reinforcing components makes it feasible to obtain high-performance, durable gypsum matrix-based composites for functional and constructional applications. Both pure gypsum and gypsum–cement composite materials have great potential for various construction applications, for 3D printing and more.</p>