Improving Causal Inference of Large Language Models with SCM Tools
摘要
Many previous studies have shown that Large Language Models (LLMs) are highly competent on many Natural Language Processing (NLP) tasks. However, a recent study showed the poor ability of LLMs to perform causal inference based on causal graphs and data. In this paper, we propose a method to enhance LLMs based on Structure Causal Model (SCM) tools. We constructed 10 causal inference tools based on SCM theory for solving 10 different types of causal questions. LLMs help to extract the information needed for causal inference tools in the causal questions, select the appropriate causal inference tools, and combine the inference results of the causal inference tools to generate the final causal question answers. The experimental results show that the method proposed in this paper outperforms the best existing methods.