Asphalt pavements are affected by a number of factors that deteriorate them. The impact of individual factors, or combinations of two or three factors, on pavement deterioration is typically investigated through costly and time-consuming laboratory and field experiments. However, it is challenging to evaluate all factors at once. Therefore, there is a lack of a study that covers all of these factors. A comprehensive assessment of how these factors affect the durability of asphalt pavements is a complex task that can be solved using expert opinion-based methods. In this paper, 18 criteria, which assess climate conditions, traffic loads, and the effects of winter maintenance materials and pollutants from vehicles, have been identified as factors deteriorating asphalt pavements at some level. The survey was conducted to identify the most significant criteria (factors), which have the greatest effect on asphalt pavement deterioration. Each of the 52 experts evaluated the significance of the criteria with ranks and percentage points. The high concordance of experts’ opinions allowed to use the averages of criteria normalized weights calculated by the ARTIW-L, ARTIW-N, and DPW methods to identify the most significant criteria (factors). Changes in ambient air temperature, high annual average daily traffic flow, precipitation, high ground water level and percentage of heavy vehicles were determined to be the most important factors for the durability of asphalt pavements. The values of the criteria weights show how much one factor is more important than another.