User Simulation and Large Language Models Invited talk, IRLab seminar, University of AmsterdamAmsterdam, The Netherlands, March 2024.
Tutorial on User Simulation for Evaluating Interactive Intelligent Systems Half-day tutorial with CX. Zhai, 38th Annual AAAI Conference on Artificial Intelligence (AAAI ’24) Vancouver, Canada, February 2024. [Tutorial website]
2023
From Queries to Conversations: The Evolution of Search and Assistants Invited talk, Faculty AI seminar, University of StavangerStavanger, Norway, December 2023.
25 Years of Search Innovations from Google Invited talk, Student event by Stavanger AI LabStavanger, Norway, October 2023.
Towards Filling the Gap in Conversational Search: From Passage Retrieval to Conversational Response Generation 32nd ACM International Conference on Information and Knowledge Management (CIKM ’23) Birmingham, UK, October 2023. [SlideShare]
Tutorial on User Simulation for Evaluating Information Access Systems Half-day tutorial with CX. Zhai, 32nd ACM International Conference on Information and Knowledge Management (CIKM ’23) Birmingham, UK, October 2023. [Tutorial website]
User Simulation for Evaluating Search and Recommender Systems Hungarian Machine Learning Conference Budapest, Hungary, August 2023
On the Role of Human Annotations in the Era of Large Language Models Invited talk, NorwAI Forum Trondheim, Norway, March 2023
2022
On Natural Language User Profiles for Transparent and Scrutable Recommendation 45th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’22) Madrid, Spain, July 2022
2021
Toward more Natural Interactions with Conversational AI Systems Keynote talk, International Conference on Artificial Intelligence and its Applications (icARTi ’21) Virtual event, December 2021.
Conversational AI from an Information Retrieval Perspective: Remaining Challenges and a Case for User Simulation 2nd International Conference on Design of Experimental Search & Information REtrieval Systems (DESIRES ’21) Padua, Italy (remote attendance), September 2021. [SlideShare]
POINTREC: A Test Collection for Narrative-driven Point of Interest Recommendation 44th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’21) Virtual event, July 2021. [Recording]
Entities for Augmented Intelligence Invited talk, Adobe Research Virtual event, June 2021.
Toward More Natural Interactions with Conversational Recommender Systems Invited talk, Norwegian Artificial Intelligence Research Consortium (NORA) & Norwegian Open AI Lab (NAIL) webinar Virtual event, June 2021. [Recording]
Toward More Natural Interactions with Conversational Recommender Systems Invited talk, Huawei Technologies (Netherlands) Virtual event, May 2021.
Toward More Natural Interactions with Conversational Recommender Systems Invited talk, Google Virtual event, April 2021.
What Does Conversational Information Access Exactly Mean and How to Evaluate It? Invited talk, University of Glasgow, IR seminar series Virtual event, March 2021. [SlideShare]
Conversational Information Access Invited talk, Norwegian Open AI Lab Virtual event, March 2021.
What Does Conversational Information Access Exactly Mean and How to Evaluate It? Invited talk, University of Massachusetts Amherst, CIIR talk series Virtual event, Jan 2021. [Recording]
2020
ArXivDigest: A Living Lab for Personalized Scientific Literature Recommendation 29th ACM International Conference on Information and Knowledge Management (CIKM ’20) Virtual event, October 2020.
Measuring Recommendation Explanation Quality: The Conflicting Goals of Explanations 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’20) Virtual event, July 2020.
2019
Personal Knowledge Graphs Invited talk, Dagstuhl Seminar on Conversational Search Dagstuhl, Germany, November 2019. [SlideShare]
Conversational AI Invited talk, Digital Transformasjon and AI Symposium Trondheim, Norway, October 2019.
Personal Knowledge Graphs: A Research Agenda 5th ACM SIGIR International Conference on the Theory of Information Retrieval (ICTIR ’19) Santa Clara, CA, USA, October 2019.
Unsupervised Context Retrieval for Long-tail Entities 5th ACM SIGIR International Conference on the Theory of Information Retrieval (ICTIR ’19) Santa Clara, CA, USA, October 2019.
Entities for Augmented Intelligence Keynote talk, 23rd International Conf. on Theory and Practice of Digital Libraries (TPDL ’19) Oslo, Norway, September 2019. [SlideShare]
Questions around Transparency in Information Retrieval Invited talk, FACTS-IR Workshop atSIGIR ’19 Paris, France, July 2019.
Transparent, Scrutable and Explainable User Models for Personalized Recommendation 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’19) Paris, France, July 2019.
Web Table Extraction, Retrieval and Augmentation Half-day tutorial with S. Zhang, 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’19) Paris, France, July 2019. [Tutorial website]
Evaluation in Information Retrieval Invited talk, Department of Computer Science, Norwegian University of Science and Technology Trondheim, Norway, June 2019.
On Entities and Evaluation Keynote talk, 41st European Conference on Information Retrieval (ECIR ’19) Cologne, Germany, April 2019. [SlideShare]
Personal Knowledge Graphs Invited talk, Signal AI London, UK, March 2019.
2018
Table Retrieval and Generation Invited talk, Universidade NOVA Lisboa Lisbon, Portugal, November 2018.
Structured Data & Digital Assistants Invited talk, ConocoPhillips Stavanger, Norway, Aug 2018.
Table Retrieval and Generation Keynote talk, SIGIR’18 workshop on Data Search (DATA:SEARCH’18) Ann Arbor, Michigan, USA, July 2018. [Slides (10-up)|SlideShare]
SmartTables : Supporting Work with Tables Invited talk, Bloomberg London, UK, May 2018.
From Search Engines to Intelligent Assistants University of Stavanger Stavanger, Norway, April 2018.
2017
SmartTables: Supporting Work with Tables Invited talk, Search Engines Amsterdam Meetup Amsterdam, The Netherlands, December 2017.
Artificial Intelligence Forskningsdagene 2017 Stavanger, Norway, September 2017.
TREC OpenSearch SIGIR 2017 Workshop on Neural Information Retrieval (NeuIR ’17) Tokyo, Japan, August 2017.
Living Labs for IR Evaluation Invited talk, University of Fribourg Fribourg, Switzerland, May 2017.
Living Labs for IR Evaluation Invited talk, ELIAS iTREC workshop at CHIIR 2017 Oslo, Norway, March 2017.
2016
Overview of the TREC 2016 Open Search track: Academic Search Edition 25th Text REtrieval Conference (TREC ’16) Gaithersburg, Maryland, USA, November 2016. [Slides (10-up)|SlideShare]
Overview of the Living Labs for IR Evaluation (LL4IR) CLEF Lab 7th International Conference of the CLEF Association (CLEF ’16) Évora, Portugal, September 2016. [Slides (8-up)|SlideShare]
Towards an Understanding of Transactional Tasks 7th International Conference of the CLEF Association (CLEF ’16) Évora, Portugal, September 2016. [Poster]
Entity Linking Tutorial, 10th Russian Summer School in Information Retrieval (RuSSIR ’16) Saratov, Russia, August 2016. [Slides (10-up)|SlideShare]
Entity Search: The Last Decade and the Next Keynote talk, 10th Russian Summer School in Information Retrieval (RuSSIR ’16) Saratov, Russia, August 2016. [SlideShare]
Artificial Intelligence: From Search Engines to Digital Personal Assistants Invited talk, Art Science & Cocktails Stavanger, Norway, August 2016.
Entity Linking and Retrieval for Semantic Search As part of the PhD course “Advanced Information Retrieval and Web-indexing”, Oslo and Akershus University College of Applied Sciences (HiOA) Oslo, Norway, May 2016.
Living Labs for Online Evaluation Invited talk, University of Lugano Lugano, Switzerland, April 2016
Living Labs for Online Evaluation: From Theory to Practice Half-day tutorial with A. Schuth, 38th European Conference on Information Retrieval (ECIR ’16) Padua, Italy, March 2016. [Slides|Complete tutorial material]
2015
Task-Completion Engine Innovation seminar Stavanger, Norway, November 2015.
Probabilistic Field Mapping for Product Search Sixth International Conference of the CLEF Association (CLEF ’15) Toulouse, France, September 2015. [Slides (8-up)|Poster]
Evaluation Initiatives for Entity-oriented Search Keynote talk, KEYSTONE Spring WG Meeting 2015 Kosice, Slovakia, May 2015. [Slides (8-up)|SlideShare]
Task-completion Engines: A Vision with a Plan ECIR ’15 workshop on Supporting Complex Search Tasks (SCST ’15) Vienna, Austria, March 2015. [Poster]
Living Labs for Information Retrieval Evaluation Evaluation-as-a-Service (EaaS) expert workshop Sierre, Switzerland, March 2015.
How Search Engines Work Open day, University of Stavanger Stavanger, Norway, March 2015.
2014
Head First: Living Labs for Ad-hoc Search Evaluation 23rd ACM International Conference on Information and Knowledge Management (CIKM ’14) Shanghai, China, November 2014. [Poster]
How Search Engines Work Open day, University of Stavanger Stavanger, Norway, September 2014.
How Search Engines Work Randaberg videregående skole Stavanger, Norway, September 2014.
How Search Engines Work St. Olav videregående skole Stavanger, Norway, September 2014.
Semantic and Entity-oriented Search Stavanger Aftenblad Stavanger, Norway, September 2014.
Entity Retrieval As part of the full-day tutorial “Entity Linking and Retrieval for Semantic Search” with E. Meij and D. Odijk, Tutorial organized by Radialpoint Inc. Montreal, Canada, June 2014. [Slides (8-up)|SlideShare|Complete tutorial material]
Entity-oriented and Semantic Search As part of the PhD course “Advanced Information Retrieval and Web-indexing”, Oslo and Akershus University College of Applied Sciences (HiOA) Oslo, Norway, June 2014.
The Life of a Query Open day, University of Stavanger Stavanger, Norway, March 2014.
Entity Retrieval As part of the half-day tutorial “Entity Linking and Retrieval for Semantic Search” with E. Meij and D. Odijk, 7th ACM International Conference on Web Search and Data Mining (WSDM ’14) New York City, NY, USA, February 2014. [Slides (8-up)|SlideShare|Complete tutorial material]
2013
Knowledge Base Acceleration: A First Round of TEA Invited talk, ILPS, University of Amsterdam Amsterdam, The Netherlands, November 2013.
Time-aware Evaluation of Cumulative Citation Recommendation Systems SIGIR ’13 workshop on Time-aware Information Access (#TAIA2013) Dublin, Ireland, August 2013. [Slides (8-up)|SlideShare]
Cumulative Citation Recommendation: Classification vs. Ranking 36th international ACM SIGIR conference on Research and development in Information Retrieval (SIGIR ’13) Dublin, Ireland, July 2013. [Poster]
A Test Collection for Entity Search in DBpedia 36th international ACM SIGIR conference on Research and development in Information Retrieval (SIGIR ’13) Dublin, Ireland, July 2013. [Poster]
Entity Retrieval As part of the full-day tutorial “Entity Linking and Retrieval” with E. Meij and D. Odijk, 36th international ACM SIGIR conference on Research and development in Information Retrieval (SIGIR ’13) Dublin, Ireland, July 2013. [Slides (8-up)|SlideShare|Complete tutorial material]
Multi-step Classification Approaches to Cumulative Citation Recommendation 10th Conference on Open Research Areas in Information Retrieval (OAIR ’13) Lisbon, Portugal, May 2013. [Slides (8-up)|SlideShare]
KBAAA: A Web-based Toolkit for the Assessment and Analysis of Knowledge Base Acceleration Systems 10th Conference on Open Research Areas in Information Retrieval (OAIR ’13) Lisbon, Portugal, May 2013. [Demo]
Entity Retrieval As part of the half-day tutorial “Entity Linking and Retrieval” with E. Meij and D. Odijk, 22nd International World Wide Web Conference (WWW ’13) Rio de Janeiro, Brazil, May 2013. [Slides (8-up)|SlideShare|Complete tutorial material]
The Life of a Query Open day, University of Stavanger Stavanger, Norway, March 2013.
Semistructured Data Search Invited lecture, PROMISE Winter School 2013, Bridging between Information Retrieval and Databases Bressanone, Italy, February 2013. [Slides (8-up)|SlideShare]
2012
On the Use of Semantic Knowledge Bases for Temporally-aware Entity Retrieval CIKM ’12 workshop on Exploiting Semantic Annotations in Information Retrieval (ESAIR ’12) Maui, Hawaii, USA, November 2012. [Poster]
Hierarchical Target Type Identification for Entity-oriented Queries 21st ACM Conference on Information and Knowledge Management (CIKM ’12) Maui, Hawaii, USA, November 2012. [Poster]
Collection Ranking and Selection for Federated Entity Search 19th International Symposium on String Processing and Information Retrieval (SPIRE ’12) Cartagena de Indias, Colombia, October 2012. [Slides (8-up)|SlideShare]
Semantic Entity Search Invited talk, Department of Electrical and Computer Engineering, University of Stavanger Stavanger, Norway, June 2012.
Semantic Entity Search Invited talk, Department of Computer Science, University College London London, UK, May 2012.
2011
Overview of the TREC 2011 Entity track The Twentieth Text REtrieval Conference (TREC ’11) Gaithersburg, Maryland, USA, November 2011. [Slides (8-up)]
Finding Related Entities Keynote talk, CIKM ’11 workshop on Search and Mining Entity-Relationship Data (SMER) Glasgow, UK, October 2011. [Slides (8-up)]
Towards a Living Lab for Information Retrieval Research and Development. A proposal for a living lab for product search tasks CLEF 2011: Conference on Multilingual and Multimodal Information Access Evaluation Amsterdam, The Netherlands, September 2011. [Slides (8-up)]
The Sindice-2011 Dataset for Entity-Oriented Search in the Web of Data SIGIR ’11 workshop on Entity-Oriented Search (EOS) Beijing, China, July 2011. [Slides (8-up)]
On the Investigation of Similarity Measures for Product Resolution IJCAI ’11 workshop on Discovering Meaning On the Go in Large Heterogeneous Data (LHD-11) Barcelona, Spain, July 2011. [Slides (8-up)]
2010
Entity Search Invited talk, Department of Computer and Information Science, Norwegian University of Science and Technology Trondheim, Norway, November 2010.
Overview of the TREC 2010 Entity track The Nineteenth Text REtrieval Conference (TREC ’10) Gaithersburg, Maryland, USA, November 2010. [Slides (8-up)|Poster]
Entity Search: Building Bridges between Two Worlds WWW ’10 workshop on Semantic Search (SemSearch ’10) Raleigh, NC, USA, April 2010. [Slides (6-up)]
Retrieving Entities Invited talk, Department of Computing Science, University of Glasgow Glasgow, UK, April 2010.
Category-based Query Modeling for Entity Search 32nd European Conference on Information Retrieval (ECIR ’10) Milton Keynes, UK, March 2010. [Poster]
Beyond document search: Finding entities Invited talk, Microsoft Research Cambridge, UK, March 2010.
Beyond document search: Finding entities Invited talk, TripleTalk Semantic Web Meetings, Vrije Universiteit Amsterdam, The Netherlands, March 2010.
2009
Overview of the TREC 2009 Entity track The Eighteenth Text REtrieval Conference (TREC ’09) Gaithersburg, Maryland, USA, November 2009. [Slides (6-up)]
SaHaRa: Discovering Entity-Topic Associations in Online News 8th International Semantic Web Conference (ISWC ’09) Chantilly, Virginia, USA, October 2009. [Poster]
Retrieving Entities Advanced SIKS-Course: Probabilistic Methods for Entity Resolution and Entity Ranking Zeist, The Netherlands, April 2009. [Slides (6-up)]
2008
Now that you’ve bought into Model 2, we’ll tell you why to get Model 1 The Seventeenth Text REtrieval Conference (TREC ’08) Gaithersburg, Maryland, USA, November 2008. [Slides (6-up)]
Non-Local Evidence for Expert Finding ACM 17th Conference on Information and Knowledge Managment (CIKM ’08) Napa Valley, California, USA, October 2008. [Slides (6-up)]
A Few Examples Go A Long Way: Constructing Query Models from Elaborate Query Formulations 31th Annual International ACM SIGIR Conference on Research & Development on Information Retrieval (SIGIR ’08) Singapore, Singapore, July 2008. [Slides (6-up)]
Bloggers as Experts 31th Annual International ACM SIGIR Conference on Research & Development on Information Retrieval (SIGIR ’08) Singapore, Singapore, July 2008. [Poster]
Personal Name Resolution of Web People Search WWW ’08 workshop on NLP Challenges in the Information Explosion Era (NLPIX ’08) Beijing, China, April 2008. [Slides (6-up)]
Associating People and Documents 30th European Conference on Information Retrieval (ECIR ’08) Glasgow, Scotland, April 2008. [Slides (6-up)]
2007
Query and Document Models for Enterprise Search Sixteenth Text REtrieval Conference (TREC ’07) Gaithersburg, Maryland, USA, November 2007. [Slides (6-up)]
Broad Expertise Retrieval in Sparse Data Environments 30th Annual International ACM SIGIR Conference on Research & Development on Information Retrieval (SIGIR ’07) Amsterdam, The Netherlands, July 2007. [Slides (6-up)]
Finding Similar Experts 30th Annual International ACM SIGIR Conference on Research & Development on Information Retrieval (SIGIR ’07) Amsterdam, The Netherlands, July 2007. [Poster]
People Search in the Enterprise Doctoral Consortium, SIGIR ’07 Amsterdam, The Netherlands, July 2007. [Slides (6-up)]
Tracking User Generated Content Invited talk, Kickoff meeting of new mastertrack HAIT (Human Aspects of Information Technology) University of Tilburg, The Netherlands, May 2007. [Slides (6-up)]
How to Overcome Tiredness: Estimating Topic-Mood Associations International Conference on Weblogs and Social Media (ICWSM ’07) Boulder, Colorado, USA, March 2007. [Slides (6-up)]
Determining Expert Profiles (With an Application to Expert Finding) 20th International Joint Conference on Artifical Intelligence (IJCAI ’07) Hyderabad, India, January 2007. [Slides (6-up)]
2006
Why Are They Excited? Identifying and Explaining Spikes in Blog Mood Levels Scientific ICT Research Event Netherlands (SIREN ’06) Utrecht, The Netherlands, October 2006. [Poster]
Formal Models for Expert Finding in Enterprise Corpora 29th Annual International ACM SIGIR Conference on Research & Development on Information Retrieval (SIGIR ’06) Seattle, USA, August 2006. [Slides (6-up)]
Decomposing Bloggers’ Moods WWW ’06 workshop on the Weblogging Ecosystem Edinburgh, Scotland, May 2006. [Slides (6-up)]
Finding Experts and their Details in E-mail Corpora 15th International World Wide Web Conference (WWW ’06) Edinburgh, Scotland, May 2006. [Poster]
Why Are They Excited? Identifying and Explaining Spikes in Blog Mood Levels 11th Meeting of the European Chapter of the Association for Computational Linguistics (EACL ’06) Trento, Italy, April 2006. [Poster]