Aiming at solving the problems that the traditional teaching effect evaluation method is subjective, the weighted value is difficult to determine, and the evaluation result is inaccurate, this paper actively discusses the need to evaluate the teaching effect of this course from three main aspects including course paper, classroom performance, daily assignment and experiment as the unified consideration and evaluation. Taking the course “Management System Engineering” as the research object, this paper studies the three-level evaluation index system according to its characteristics and its implementation of educational reform, applies the analytic hierarchy process (AHP) and fuzzy comprehensive evaluation method, and obtains the evaluation result of educational reform effect, which can be used as a new pattern to evaluate the effect of curriculum education reform, and has certain popularization and application value and reference value.