Infusing Syntax and Semantics into LLMs
摘要
Despite impressive success, Large Language Models (LLMs) sometimes generate outputs with flawed linguistic structure. We analyze the effect of directly infusing syntactic and semantic information into LLMs. To demonstrate the value of our proposals, we focus on the translation of natural language queries to SQL — in particular dealing with languages with less resources than English, to better investigate how much help we can get from low-cost syntactic and semantic information. We show that linguistic analysis can significantly boost language models and even surpass existing best systems for some languages.