Something for the weekend

Google presented a great demo to play a piano duet with a computer. So if you have time on the weekend and no company, maybe Tensorflow is a good match.

Check out Magenta

NewsREEL 2017

Author: Benjamin Kille

We are excited to announce the start of another edition of CLEF NewsREEL. This year’s challenge continues with both tasks:

NewsREEL Live: interact with an operating news recommender systems and real users
NewsREEL Replay: analyze a comprehensive data set to determine the best recommender

Our partners at plista are currently busy revising the Open Recommendation Platform (ORP). The new systems will be more stable and equipped with a new UI for a much better user experience. Until the new systems has been released, we encourage participants to engage in NewsREEL Replay.

We released a new data set of more than 168 million events recorded over the stretch of four weeks. The data set provides a representative picture of what your recommender will encounter in NewsREEL Live. The following charts gives you an impression on what the data looks like.




If you want to join us in the pursuit of news recommender systems evaluation, please register at here and make sure to check the boxes for NewsREEL. You will receive information about how to access the data shortly after successful registration.

6th Recommender Meetup Amsterdam

Author: Andreas Lommatzsch

The Recommender Meetup Amsterdam ( is meetup focusing on innovative recommender algorithms and AI methods. The meetup is organized by the TU Delft and hosted by different companies in the Netherlands. The 6th RecSys:NL Meetup was held on September 28th at ORTEC Amsterdam.

There were three talks: First, Alexandros Karatzoglou (Telefonica Research, Barcelona, Spain) gave a talk about Deep Learning Methods and the use of Deep Leaning approaches in Recommender Systems. In his talk, he discussed the state of the art of Deep Learning methods and explained current trends and application scenarios in the Deep Learning methods are used.

The second talk was given by Andreas Lommatzsch (TU Berlin, Berlin, Germany). In his talk "NewsREEL challenge: Online evaluation of recommender systems" he explained the CLEF NewsREEL challenge and the challenges of online evaluation methods. The CLEF NewsREEL challenge allows researchers to evaluate algorithms for recommending online news articles. The talk explained the NewsREEL scenario in detail. The specific challenges have been discussed such as the continuous changes in the set of relevant items, the influence of context parameters, and the variance in the user behavior. In addition, the talk presented different algorithmic approaches as well as the experiences gained organizing the challenge. The slides are available here.

Daniel Kohlsdorff (XING, Hamburg, Germany) explained the challenges of providing high-quality job recommendations. He presented selected components of the XING’s recommender system explaining content based recommendations with latent spaces, and outlier filtering. In addition, Daniel presented the results of the RecSys challenge 2016 (co-organized by XING) and gave an outlook on the RecSys challenge 2017.

After the talks there has been a lively discussion accompanied by pizza and beer.

LWDA conference 2016, Potsdam, Germany

Author: Andreas Lommatzsch

The LWDA ("Lernen Wissen Daten Analysen") conference is a conference organized by the Gesellschaft für Informatik (German Informatics Society). The 2016 edition was held in Potsdam, 12-14 September 2016.
The conference is organized in 4 tracks focusing on Information Retrieval (IR), Knowledge Discovery and Machine Learning (KDML), Databases (DB) and Knowledge Management (WM).
CC IRML contributes to the conference in three different tracks.

The paper "An Interactive e-Government Question Answering System" presents a Question-Answering system developed for the specific requirements of an e-government scenario. The system combines information retrieval and AI methods for providing direct answers to questions concerning governmental services. The systems has been developed in the master course "Semantic Search Project".

The paper "Topical Video-On-Demand Recommendations based on Event Detection" presents an event-based recommender system for art house movies Based on semantic sources and social media events are identified that are used for computing movie recommendations related to specific days and events.

The poster "Applying Topic Model in Context-Aware TV Programs Recommendation" presents our approach for learning context aware recommendations combining topic models and model built based on a user data-based Latent-Dirichlet Allocation.

The very active poster session and the high-quality keynote talks as well as the modern venue (HPI, Campus Griebnitzsee) inspired valuable discussion and new research ideas.

CrowdRec: Topical Semantic Recommendations for Auteur Films @RecSys 2016

Author: Till Plumbaum

At this years RecSys we presented a demo system that collects topics of interest from Twitter and RSS-Feeds, extracts relevant Named Entities, and uses semantic relations for recommending movies closely related to these topics.
During the poster session, which was running for 3 1/2 hours, we were constantly in discussion with the great RecSys crowd.

You can get the poster here. If you are interested in the topic, we are happy to get in touch with you, just send a mail to the authors and we will get back to you.

The research leading to these results was performed in the CrowdRec project, which has received funding from the EU 7th Framework Programme FP7/2007-2013 under grant agreement No. 610594.

NewsREEL 2016 in Evora

Author: Andreas Lommatzsch

The NewsREEL challenge allows researchers to test recommender algorithms in a real-world scenario. The NewsREEL challenge provides an online task (Living Lab) in that news articles recommendations must be provided in real time. The recommendation quality is evaluated based on real user feedback using the Click-Through-Rate as performance metric. In the offline task the task organizers provide components for re-playing datasets collected in the online task. This allows researchers to investigate recommender algorithms in detail in an exactly reproducible setting. Since the online and the offline task use the same data format, researchers can analyze implemented algorithms both online and offline as well as investigate the correlation of the measured results. The main research focus lies on the multi-dimensional benchmarking of recommender algorithms based on dynamic, stream-based data. A detailed summary of NewsREEL lab can be found in the CLEF 2016 proceedings.

The NewsREEL runs 2016 as a lab of the CLEF conferences (Conference and Labs of the Evaluation Forum). Beside the NewsREEL challenge, there are several other challenges covering a broad spectrum of topics ranging from advanced text analysis in PAN (uncovering Plagiarism, Authorship and Social Software Misuse) to multi-media analysis in LifeCLEF to the social media analysis in the Cultural Microblog workshop. There has been a lot a very fruitful discussion giving ideas for new research approaches. CLEF 2017 will be held in Dublin (Ireland), 11-14 September 2017. NewsREEL will also run in 2017 as a CLEF lab.

The CLEF 2016 conference has been organized by the University of Évora, being the second oldest university in Portugal. Évora is a UNESCO World Heritage Site, known for the well-preserved old town center and a large number of historical monuments such as the Roman Temple. The following photos give a visual impression of the town and the conference.

GamifIR 2016 – What happened in Pisa?

You can find all the answers on:

NewsReel at the Algorithms & Data Challenges Meetup

Author: Till Plumbaum

We presented our CLEF Newsreel Challenge at the Algorithms with Friends II Meetup in Berlin with around 100 participants. Andreas talked about the challenges and findings of the third year of NewsReel, which focused on offline vs online evaluation and stream recommendations. We got very positive feedback from the crowd and are now encouraged to actively plan the 4th incarnation of the challenge.

You can find the slides here – NewsReel_Meetup.pdf

And some impressions from the meetup:

Algorithms & Data Challenges Meetup

Author: Till Plumbaum

In March I presented the Deutsche Bahn Digital Header Challenge at the Algorithms & Data Challenges meetup.

On July 11th, the next Algorithms & Data Challenges meetup is hosted by Zalando and we are returning to present results. I will present results from the DB Challenge and Andreas Lommatzsch will present results from the CLEF challenge that we are also organizing with focus on news recommendation in a streaming scenario.

You can find more information about the meetup here

And a few impressions from the last meetup:




Third International Workshop on Gamification for Information Retrieval (GamifIR 2016)

Held in conjunction with SIGIR 2016
Pisa, Italy
21 July 2016

Call for Papers – Deadline: May 29, 2016


Many research challenges in the field of IR rely on tedious manual labour. Canonical examples include the manual feedback required to assess the relevance of documents to a given search task or the evaluation of interactive IR approaches. Performing these tasks through Crowdsourcing techniques can be useful, but often fail when motivated users are required to perform a task for reasons other than just being paid per click. A promising approach to increase user motivation is by employing Gamification methods which has been applied in various environments and for different purposes, such as marketing, education, pervasive health care, enterprise workplaces, e-commerce, human resource management and many more.

The Third International Workshop on Gamification for Information Retrieval (GamifIR 2016) focuses on the challenges and opportunities that Gamification can present for the IR community. The workshop, organized in conjunction with SIGIR 2016, aims to bring together researchers and practitioners from a wide range of areas including game design, information retrieval, human-computer interaction, computer games, and natural language processing.

Topics of Interest

In this workshop we want to discuss and learn from planned and already executed studies and utilization of Gamification. Therefore we invite the submission of position papers as well as novel research papers and demos addressing problems related to Gamification in IR. Topics of interest include but are not limited to:

  • Gamification approaches in a variety of contexts, including document annotation and ground-truth generation; interface design; information seeking; user modelling; knowledge sharing
  • Gamification in Crowdsourcing
  • Gamification to IR teaching
  • Gamification in recommender systems and apps
  • User engagement and motivational factors of Gamification
  • Player types, contests, cooperative Gamification
  • Long-term engagement
  • Search challenges
  • Gamification design
  • Applied game principles, elements and mechanics

Submissions from outside the core IR community and from industry are actively encouraged.

Submission Details

All papers should be 2-6 pages long (in PDF format) following the ACM proceedings format. LaTeX and Word templates are available at: Submissions will be peer-reviewed by at least three members of the program committee. We plan to publish the papers as CEUR Workshop Proceedings.

Please submit your papers in PDF format through:

We aim for an interactive and dynamic full-day workshop that will be a mix of keynotes, paper and demo presentations as well as discussion sessions.

Previous GamifIR

Program Committee

  • Omar Alonso, Microsoft Research (USA)
  • Raian Ali, Bournemouth University (UK)
  • Leif Azzopardi, University of Glasgow (UK)
  • Jon Chamberlain, University of Essex (UK)
  • Sebastian Deterding, Northeastern University (USA)
  • Carsten Eickhoff, ETH Zurich (CH)
  • Christopher G Harris, State University of New York (USA)
  • Hideo Joho, University of Tsukuba (JP)
  • Till Plumbaum, TU Berlin (GER)
  • Ashok Ranchod, University of Southampton (UK)
  • Thomas Springer, TU Dresden (GER)
  • Susanne Strahringer, TU Dresden (GER)
  • Albert Weichselbraun, University of Applied Sciences Chur (CH)
  • Lincoln Wood, The University of Auckland (NZ)

Organizing Committee

  • Frank Hopfgartner, University of Glasgow (United Kingdom)
  • Gabriella Kazai, Semion Ltd. (United Kingdom)
  • Udo Kruschwitz, University of Essex (United Kingdom)
  • Michael Meder, TU Berlin (Germany)

Important Dates

  • Submission deadline: May 29, 2016
  • Notification date: June 19, 2016
  • Camera-ready due: July 3, 2016
  • Workshop date: July 21, 2016