Carbon-based membranes have garnered significant interest in recent years due to their incredible thermal and chemical stability, molecular selectivity, and potential for use in extreme operating conditions. This report provides a comprehensive review of the historical development of carbon membranes, from early graphite-based structures to nanostructured forms such as carbon nanotubes (CNTs), graphene, and carbon molecular sieves (CMS). The report also outlines the main types of carbon materials used in membrane technology, exploring their fabrication methods, structural features, and separation performance in applications like gas separation, water purification, and solvent nanofiltration. A particular focus is given to the physical and chemical properties that contribute to membrane performance, including their pore structure, surface chemistry, and mechanical integrity. The excellent durability of carbon membranes is also explored, such as their ability to maintain performance in the presence of aggressive compounds like hydrogen sulfide (H2S). Despite these advantages, challenges such as capillary condensation, structural fragility, and scalability issues remain. This report aims to consolidate existing knowledge surrounding carbon-based membrane materials, thereby contributing to a better understanding of their unique advantages and current limitations.