<p>The advancement in pavement construction techniques is the pressing priority, keeping in mind the increasing traffic loading as well as the use of new and complex materials. The reckless construction and exploitation of natural rocks demand a sustainable solution that can be served by waste fillers. This study focuses on assessing the influence of waste fillers from the construction and industrial sectors on the rutting and fatigue performance of asphalt mixtures. Two fillers, namely jarosite, JT (industrial waste) and construction &amp; demolition waste, CDW (construction waste), were incorporated for the preparation of asphalt mixtures, whereas stone dust was selected as the control filler. The effect of the type of binder was also studied by considering virgin and crumb rubber modified binder. The performance of the mixtures was evaluated by dynamic creep test and IDEAL-CT test and the statistical significance was determined via a three-way analysis of variance (ANOVA) test considering filler type, filler content, and binder type as the reference variables. Moreover, the environmental impact and economic analysis were done considering the change in green house gas (GHG) emissions and cost savings by incorporating waste fillers. The results revealed that the waste fillers outperformed the control filler in rutting, with jarosite being the best filler. However, the mixtures prepared with construction and demolition waste were found to have the best fatigue performance, and the rank of jarosite was the lowest. The three way ANOVA results showed that the effect of each individual parameter was statistically significant on both dynamic creep and CT-Index values.</p>