CLEF NewsREEL 2014, 18 September 2014, Sheffield, UK

Author: Benjamin Kille

On Thursday, 18 September 2014, the first session of NewsREEL in the scope of the CLEF initiative took place in Sheffield, UK. Participants had the chance to present their findings. Likewise, they found a forum to discuss issues and suggest possible improvements. I enjoyed receiving plenty of feedback.

In NewsREEL, we defined three periods for evaluation. The system recorded each participant’s performance during these periods. The picture below shows individual performances recorded during the first half of February, 2014.

NewsREEL results Feb 2014

The chart relates the number of clicks to the number of requests. Consequently, we observe click-through-rates (CTR) as linear functions. We assess performance in terms of the number of clicks as well as the CTR. The chart shows that MaxTesting2 achieved the highest CTR. Conversely, andreas obtained most clicks. In the evaluation periods in April and May, individual participants managed to perform best with respect to both criteria. In April, MaxTesting2 performed best as AL did in May.

We are happy to announce that NewsREEL has been accepted for the next cycle of CLEF. We are looking forward to new participants as well as those who participated in the first run.

Leave a Reply

You can use these HTML tags

<a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <s> <strike> <strong>