Facilitating meta-analysis inclusion decisions with Elicit AI
摘要
Artificial intelligence (AI) is a plausible tool for enhancing and expediting multivariable, large-scale meta-analyses, yet little is known about its effectiveness at the inclusion/exclusion stage. We randomly assigned 1,200 papers from a three-variable mediation meta-analysis to be screened with or without the assistance of Elicit. Elicit reduced the time it took to make inclusion/exclusion decisions by 20.6%. The effect of Elicit condition on decision time remained significant after controlling for five variables that could explain variance in decision time. Coders could evaluate over 93% of low- and medium-inference criteria and over 82% of high-inference criteria based entirely on information provided by Elicit. Our findings suggest Elicit is a viable AI tool for keeping meta-analyses tractable to researchers.