Twease/tasks/AutomatedEvaluation

From Icbwiki

Jump to: navigation, search

This project aims to develop objective and automated methods for the evaluation of information retrieval effectiveness.

Testing the evaluation method.

We compare to the results of past TREC evaluations. Since we work in the genomics domain, we focus on the TREC genomics track.

We test 23 different flavors of retrieval methods on TREC-gen 2005 (corpus from 2004, topics from 2005). We compare the retrieval effectiveness with MAP and bpref for the TREC evaluation and the no-title (NT) evaluation methodologies.

Image:N=23-bpref.png Image:N=23-MAP.png

Personal tools