The LL’14 workshop has been cancelled!

The 2nd Living Labs for Information Retrieval Evaluation Workshop @ CIKM 2014

7 November, 2014, Shanghai, China

We are pleased to announce that the second in the series of living labs for information retrieval (IR) evaluation workshops will be held at this year’s ACM International Conference on Information and Knowledge Management (CIKM 2014). Our goal with the second edition of the workshop is to continue our community building efforts around living labs for IR and to pursue the directions set out at LL’13. As part of this, we are organizing a challenge with shared tasks in the e-commerce space and local domain search.

Challenge registration now open

Registration for the living labs challenge is now open. See the challenge page for details.  The challenge runs from August 1 – October 1.

Call for papers & demos

The workshop is now accepting paper and demo submissions. Short papers and demos (4 pages), and position papers and posters (2 pages) should be submitted electronically through the EasyChair system, in PDF format and formatted using the ACM SIGS format (http://www.acm.org/sigs/publications/proceedings-templates; for LaTeX, use the “Option 2″ style). See Call for Papers for full details.

Submission deadline (extended): August 16, 2014 (midnight Pacific Daylight Time).

Call for challenge papers

We are also soliciting “work-in-progress” challenge papers, describing approaches, early stage ideas, and preliminary results related to our challenge. Challenge papers may be between 1 and 4 pages long. (Formatting and submission guidelines are the same as for regular submissions.) We strongly encourage all challenge participants to submit a paper!

Submission deadline: August 30, 2014 (midnight Pacific Daylight Time).

All accepted papers will be published in the workshop proceedings, indexed in the ACM Digital Library.