Ontologies are foundational to conceptual modeling and semantic systems across diverse domains, yet evaluating and improving their quality remains a complex challenge. Existing tools often focus on syntactic correctness or complex metric reporting, lacking actionable and interpretable feedback, which is not very intuitive. We present an ontology quality evaluation tool, named OntoInsight, that caters to different types of users, from beginners to advanced, with custom recommendations, basic (simple suggestions), and advanced (involving deep technical insights) recommendations. It can handle ontologies of varying size with full ontology evaluation and modular evaluation (useful for large and complex ontologies). The pipeline automates all the stages in the tool, from metric computation (via frameworks such as OQuaRE) and seed-term-based modularization to controlled natural language (CNL) translation and targeted prompt generation for Large Language Models (LLMs). The user has the freedom to configure their own LLM API key and choose the type of evaluation and suggestions they want, according to their needs and expertise. The source code of OntoInsight is available under Apache 2.0 license at https://github.com/kracr/onto-insight .

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

OntoInsight - A Metric-Guided Tool for Ontology Quality Evaluation with LLM-Powered Recommendations

  • Daksh Sammi,
  • Lakshay Bhushan,
  • Raghava Mutharaju,
  • Cogan Shimizu

摘要

Ontologies are foundational to conceptual modeling and semantic systems across diverse domains, yet evaluating and improving their quality remains a complex challenge. Existing tools often focus on syntactic correctness or complex metric reporting, lacking actionable and interpretable feedback, which is not very intuitive. We present an ontology quality evaluation tool, named OntoInsight, that caters to different types of users, from beginners to advanced, with custom recommendations, basic (simple suggestions), and advanced (involving deep technical insights) recommendations. It can handle ontologies of varying size with full ontology evaluation and modular evaluation (useful for large and complex ontologies). The pipeline automates all the stages in the tool, from metric computation (via frameworks such as OQuaRE) and seed-term-based modularization to controlled natural language (CNL) translation and targeted prompt generation for Large Language Models (LLMs). The user has the freedom to configure their own LLM API key and choose the type of evaluation and suggestions they want, according to their needs and expertise. The source code of OntoInsight is available under Apache 2.0 license at https://github.com/kracr/onto-insight .