Knowledge graphs (KGs) are extensively utilized in numerous applications, including question-answering systems and recommender systems. However, knowledge graphs are often constructed through web crawling or crowdsourcing, leading to errors in the data. The task of knowledge graph error detection aims to identify inaccurate triplets in KGs and has received substantial attention in recent years. However, the majority of current error detection methods overlook the semantic information of the triplets, which can be vital for accurate error detection. In this paper, we introduce a Flexible Knowledge Graph Error Detection Framework that integrates Semantic Information (FKED), which combines both structural and semantic information to detect errors within the knowledge graph. FKED first extracts the structural information of KGs using a graph embedding model. Next, FKED employs a pre-trained language model (PLM) to extract semantic information from the triplets. Then the structural and semantic information are combined to detect errors within the knowledge graph. FKED can be flexibly added to other structure-based error detection models, enhancing their capabilities in downstream tasks of knowledge graphs. We assess FKED using two benchmark datasets: FB15k-237 and WN18RR. Experimental results indicate that our method is both superior and effective, substantially improving the performance of the base models.