LL4IR Challenge

The Living Labs for Information Retrieval (LL4IR) Challenge provides research teams the opportunity to evaluate their systems with real users in production environments.

The LL4IR CLEF 2015 Lab represents the “first round” of the challenge. The second round will take place from Jun 15 to Jun 30 (using the exact same setup and even the same set of test queries as the CLEF Lab).

Participants who submitted runs to the CLEF 2015 Lab will automatically take place in round #2. Nevertheless, it is strongly advised that they update their rankings with more recent documents. CLEF participants will also get the opportunity to include late-breaking results from round #2 in the camera-ready version of their working notes papers.

Event Start End Status
CLEF LL4IR 2015, Round #1 May 1, 2015 May 15, 2015 Results
LL4IR Round #2 Jun 15, 2015 Jun 30, 2015 Results
LL4IR Round #3 July 15, 2015 July 30, 2015 Results
LL4IR Round #4 Aug 15, 2015 Aug 30, 2015 Results
LL4IR Round #5 Sep 15, 2015 Sep 30, 2015
LL4IR Round #6 Oct 15, 2015 Oct 30, 2015
LL4IR Round #7 Nov 15, 2015 Nov 30, 2015
LL4IR Round #8 Dec 15, 2015 Dec 30, 2015
LL4IR Round #9 Jan 15, 2015 Jan 30, 2015
LL4IR Round #10 Feb 15, 2015 Mar 2, 2015
LL4IR Round #11 Mar 15, 2015 Mar 30, 2015
LL4IR Round #12 Apr 15, 2015 Apr 30, 2015
CLEF LL4IR 2016, Round #13 May 15, 2015 May 30, 2015