TREC 2010 summary

The 19th Text REtrieval Conference (TREC) took place at the “usual” time and place: Gaithersburg, MD, in the second half of November. Seven tracks ran in 2010: Blog, Chemical IR, Entity, Legal, Relevance Feedback, Session, and Web.
The Entity track was very popular both in terms of the number of participants and the number of posters presented. The proposed approaches displayed a great degree of diversity and made the presentations very interesting. I don’t want to repeat myself, so I refer to the posts on the Entity website for the conference summary and plans for 2011.
As to TREC 2011, the Chemical IR, Entity, Session, Legal, and Web tracks will continue. The Blog track will migrate to a new Microblog track and will investigate social search, especially search over Twitter data. Two more new tracks will be added: Crowdsourcing (as a means of evaluation) and Medical records (content-based access to the free text fields of medical records, e.g., find patients with disease X treated with Y). Finally, CMU is planning another Web crawl, successor to ClueWeb09; one idea is to have a smaller set of pages, but crawled regularly over a period of time.

TREC 2008, 2009

The ILPS group of the University of Amsterdam participated in three tracks at TREC 2008: blog, enterprise, and relevance feedback. The working notes paper describing our approaches is available online.
Results for the Enterprise track were not available at the time of writing, therefore the paper only reports the runs we submitted.
I will present some interesting findings we came across, concerning the expert finding task, at the conference (November 19-21, Gaithersburg, USA). I hope that the title of my talk sounds promising: Now that you’ve bought into Model 2, we’ll tell you why to get Model 1.

After four successful years, the Enterprise track is coming to an end. Personally, I am extremely grateful for the TRECENT Organizers (Peter Bailey, Nick Craswell, Ian Soboroff, Paul Thomas, and Arjen P. de Vries, strictly in alphabetical order) for coordinating the track, and making this platform available to the research community!

A new track, Entity Ranking will run from 2009 that I’m co-organizing with Arjen P. de Vries, Paul Thomas, and Thijs Westerveld. I’m not supposed to share details about it at this point, but it’ll has something to do with searching entities (such as people) in web data. We hope to attract participants that would have performed expert finding at the Enterprise track… specifics should follow after TREC.