Third Workshop on Augmented Intelligence in Technology-Assisted Review Systems (ALTARS)

In this third edition of the workshop on Augmented Intelligence in Technology-Assisted Review Systems (ALTARS), we focus on the capacity of building test collections for the evaluation of High-recall Information Retrieval (IR) systems which tackle challenging tasks that require the finding of (nearly) all the relevant documents in a collection. During the workshop, the organizers as well as the participants will discuss the problems of how to build and evaluate these types of systems and prepare a set of guidelines for a correct evaluation of those systems according to the current and future available datasets.