Climate change is a worldwide phenomenon that affects life on our planet. The United Nations defines it as “a change of climate that is attributed directly or indirectly to human activity that alters the composition of the global atmosphere.” The consequences of these changes are felt in all aspects of the environment, which will jeopardize the ecological balance, leading to intense droughts, devastating fires, increasing sea levels, flooding, and catastrophic storms. Therefore, actions should be taken to alleviate carbon emissions and resource depletion in different industries. The construction industry is one of the most polluting industries worldwide. In addition, it is one of the most contributing sectors to carbon emissions. Aggregates and cement, the main constituents of the concrete mix, are responsible for large amounts of the planet’s resource depletion and total emissions. Different approaches were investigated and adopted throughout the years to mitigate or prevent adverse impacts on the construction industry. However, these approaches are scattered and lack comprehensive implementation. Therefore, the objective of this work is to present different potential green materials that could partially replace aggregates and cement in the concrete mix. Then, this work discusses the barriers to wide implementation of these green alternatives and recommendations for overcoming these obstacles.