In university English teaching, listening and speaking courses are a very important part of improving students’ speaking and listening. If we want to fix the problems with education, we need to evaluate how good teachers are. The quality of university-level audiovisual speaking courses in English cannot be adequately assessed using the conventional assessment criteria. As a result, we suggest using a fuzzy clustering technique to assess and analyze educational programs. First, in order to decrease interference elements in teaching assessment, indicators are classified according to the needs of teaching. Computer technology is utilized to examine the teaching of English audiovisual speaking courses. Next, a teaching assessment system is built using computer technology for university English audiovisual speaking classes. A teaching evaluation plan is then formed, and the outcomes of the evaluation are thoroughly analyzed. Based on the results of the MATLAB simulation, the fuzzy clustering method outperforms the conventional evaluation system for the teaching accuracy and authenticity of teaching English audiovisual speaking course teaching.