Olive oil is a highly valued product associated with the Mediterranean diet associated with higher levels of production where both olive oil mill wastewater and olive mill solid waste represent major environmental concerns. Counteracting this issue, new solutions are emerging for the valorization of these residues including adsorption materials for water treatment. Water is an essential resource for all living beings, but its contamination is one of the major causes of environmental and human health concerns. Adsorption is considered very efficient and attractive and the development of green fabrication for sustainable adsorbent materials through the production of eco-friendly materials is nowadays a mode of action. In this regard, the application of olive oil production residues as adsorbent materials for the removal of a diversity of pollutants has been investigated since the beginning of the century. Nevertheless, an overview of the already tested materials and target pollutants is missing. The aim of this work was to collect this information regarding the olive oil residues used as adsorbents for water treatment and the target pollutants investigated. A review of the literature was performed and the olive pomace (OP) was found to be the residue most investigated as adsorbent material. In this sense, the work focused on this residue and understand for which target pollutants it has been investigated. Heavy metals is the pollutants’ category for which the OP was most tested as adsorbent. Finally, the study also points for works applying OP as adsorbent in real environments and how this upcycling solution can impact water quality.