There has been a silence on the site over the last few weeks (months), but things have been progressing. The web search use case is operational and running in full swing for some weeks now. We will have more updates on the other two use cases very soon.
You can still sign up for CLEF until April 30. Note that the deadline for submitting official runs is April 15.
We have also prepared a guide specifically for CLEF participants; this should help you to get started right away.
We are happy to announce that Living Labs for IR Evaluation (LL4IR) will run as a Lab at CLEF 2015. The first edition of the lab will focus on three specific use-cases: (1) product search (on an e-commerce site), (2) local domain search (on a university’s website), (3) web search (through a commercial web search engine). See futher details here.
“Give us your ranking, we’ll have it clicked!”
The LL’14 workshop at CIKM’14 has unfortunately been cancelled. Note that the challenge platform remains available and continues to be developed. We will soon be back with better news, hopefully.
The submission deadline for our LL’14 workshop at CIKM’14 has been extended to Aug 16. We are particularly interested to receive position papers (2 pages ACM) on the living labs experimental paradigm.
Our living labs challenge is underway since Aug 1. We are also soliciting “work-in-progress” challenge papers for the workshop, describing approaches, early stage ideas, and preliminary results. These may be submitted until Aug 30.
To receive updates on the challenge, please subscribe to our mailing list.
In preparation for the challenge we are organising for LL’14, a dedicated Living Labs Challenge workshop will be held in Amsterdam on the 6th of June. The programme includes invited talks from CLEF NEWSREEL organisers and a “hackathon”. We are kindly inviting prospective challenge participants as well as potential industrial partners to attend this event!
We thank the ELIAS programme of ESF for their financial support, and the University of Amsterdam, and the ILPS group in particular, for hosting the event.
We just sent out our call for papers to several mailing lists. You may have received, or you can find the call here: http://living-labs.net/ll14/call-for-papers/. This year, we accept 3 types of submissions: papers, demos, and challenge submissions.
We celebrate the International Workers’ Day by launching the site. Information about the upcoming workshops, LLC in Amsterdam and LL’14 at CIKM’14 will be posted soon. The old LL’13 site has already been moved here.