Talks

2024

  • PKG API: A Tool for Personal Knowledge Graph Management
    2024 ACM Web Conference (WWW ’24)
    Singapore, May 2024.
    [Poster]
  • Tutorial on User Simulation for Evaluating Information Access Systems on the Web
    Half-day tutorial with CX. Zhai, 2024 ACM Web Conference (WWW ’24)
    Singapore, May 2024.
    [Tutorial website]
  • User Simulation and Large Language Models
    Invited talk, IRLab seminar, University of Amsterdam
    Amsterdam, The Netherlands, March 2024.
  • Tutorial on User Simulation for Evaluating Interactive Intelligent Systems
    Half-day tutorial with CX. Zhai, 38th Annual AAAI Conference on Artificial Intelligence (AAAI ’24)
    Vancouver, Canada, February 2024.
    [Tutorial website]

2023

  • From Queries to Conversations: The Evolution of Search and Assistants
    Invited talk, Faculty AI seminar, University of Stavanger
    Stavanger, Norway, December 2023.
  • 25 Years of Search Innovations from Google
    Invited talk, Student event by Stavanger AI Lab
    Stavanger, Norway, October 2023.
  • Towards Filling the Gap in Conversational Search: From Passage Retrieval to Conversational Response Generation
    32nd ACM International Conference on Information and Knowledge Management (CIKM ’23)
    Birmingham, UK, October 2023.
    [SlideShare]
  • Tutorial on User Simulation for Evaluating Information Access Systems
    Half-day tutorial with CX. Zhai, 32nd ACM International Conference on Information and Knowledge Management (CIKM ’23)
    Birmingham, UK, October 2023.
    [Tutorial website]
  • User Simulation for Evaluating Search and Recommender Systems
    Hungarian Machine Learning Conference
    Budapest, Hungary, August 2023
  • On the Role of Human Annotations in the Era of Large Language Models
    Invited talk, NorwAI Forum
    Trondheim, Norway, March 2023

2022

  • On Natural Language User Profiles for Transparent and Scrutable Recommendation
    45th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’22)
    Madrid, Spain, July 2022

2021

  • Toward more Natural Interactions with Conversational AI Systems
    Keynote talk, International Conference on Artificial Intelligence and its Applications (icARTi ’21)
    Virtual event, December 2021.
  • Conversational AI from an Information Retrieval Perspective: Remaining Challenges and a Case for User Simulation
    2nd International Conference on Design of Experimental Search & Information REtrieval Systems (DESIRES ’21)
    Padua, Italy (remote attendance), September 2021.
    [SlideShare]
  • POINTREC: A Test Collection for Narrative-driven Point of Interest Recommendation
    44th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’21)
    Virtual event, July 2021.
    [Recording]
  • Entities for Augmented Intelligence
    Invited talk, Adobe Research
    Virtual event, June 2021.
  • Toward More Natural Interactions with Conversational Recommender Systems
    Invited talk, Norwegian Artificial Intelligence Research Consortium (NORA) & Norwegian Open AI Lab (NAIL) webinar
    Virtual event, June 2021.
    [Recording]
  • Toward More Natural Interactions with Conversational Recommender Systems
    Invited talk, Huawei Technologies (Netherlands)
    Virtual event, May 2021.
  • Toward More Natural Interactions with Conversational Recommender Systems
    Invited talk, Google
    Virtual event, April 2021.
  • What Does Conversational Information Access Exactly Mean and How to Evaluate It?
    Invited talk, University of Glasgow, IR seminar series
    Virtual event, March 2021.
    [SlideShare]
  • Conversational Information Access
    Invited talk, Norwegian Open AI Lab
    Virtual event, March 2021.
  • What Does Conversational Information Access Exactly Mean and How to Evaluate It?
    Invited talk, University of Massachusetts Amherst, CIIR talk series
    Virtual event, Jan 2021.
    [Recording]

2020

  • ArXivDigest: A Living Lab for Personalized Scientific Literature Recommendation
    29th ACM International Conference on Information and Knowledge Management (CIKM ’20)
    Virtual event, October 2020.
  • Measuring Recommendation Explanation Quality: The Conflicting Goals of Explanations
    43rd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’20)
    Virtual event, July 2020.

2019

  • Personal Knowledge Graphs
    Invited talk, Dagstuhl Seminar on Conversational Search
    Dagstuhl, Germany, November 2019.
    [SlideShare]
  • Conversational AI
    Invited talk, Digital Transformasjon and AI Symposium
    Trondheim, Norway, October 2019.
  • Personal Knowledge Graphs: A Research Agenda
    5th ACM SIGIR International Conference on the Theory of Information Retrieval (ICTIR ’19)
    Santa Clara, CA, USA, October 2019.
  • Unsupervised Context Retrieval for Long-tail Entities
    5th ACM SIGIR International Conference on the Theory of Information Retrieval (ICTIR ’19)
    Santa Clara, CA, USA, October 2019.
  • Entities for Augmented Intelligence
    Keynote talk, 23rd International Conf. on Theory and Practice of Digital Libraries (TPDL ’19)
    Oslo, Norway, September 2019.
    [SlideShare]
  • Questions around Transparency in Information Retrieval
    Invited talk, FACTS-IR Workshop at SIGIR ’19
    Paris, France, July 2019.
  • Transparent, Scrutable and Explainable User Models for Personalized Recommendation
    42nd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’19)
    Paris, France, July 2019.
  • Web Table Extraction, Retrieval and Augmentation
    Half-day tutorial with S. Zhang, 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’19)
    Paris, France, July 2019.
    [Tutorial website]
  • Evaluation in Information Retrieval
    Invited talk, Department of Computer Science, Norwegian University of Science and Technology
    Trondheim, Norway, June 2019.
  • On Entities and Evaluation
    Keynote talk, 41st European Conference on Information Retrieval (ECIR ’19)
    Cologne, Germany, April 2019.
    [SlideShare]
  • Personal Knowledge Graphs
    Invited talk, Signal AI
    London, UK, March 2019.

2018

  • Table Retrieval and Generation
    Invited talk, Universidade NOVA Lisboa
    Lisbon, Portugal, November 2018.
  • Structured Data 
& Digital Assistants
    Invited talk, ConocoPhillips
    Stavanger, Norway, Aug 2018.
  • Table Retrieval and Generation
    Keynote talk, SIGIR’18 workshop on Data Search (DATA:SEARCH’18)
    Ann Arbor, Michigan, USA, July 2018.
    [Slides (10-up)|SlideShare]
  • SmartTables
: Supporting Work with Tables
    Invited talk, Bloomberg
    London, UK, May 2018.
  • From Search Engines to Intelligent Assistants
    University of Stavanger
    Stavanger, Norway, April 2018.

2017

  • SmartTables: Supporting Work with Tables
    Invited talk, Search Engines Amsterdam Meetup
    Amsterdam, The Netherlands, December 2017.
  • Artificial Intelligence
    Forskningsdagene 2017
    Stavanger, Norway, September 2017.
  • TREC OpenSearch
    SIGIR 2017 Workshop on Neural Information Retrieval (NeuIR ’17)
    Tokyo, Japan, August 2017.
  • Living Labs 
for IR Evaluation
    Invited talk, University of Fribourg
    Fribourg, Switzerland, May 2017.
  • Living Labs 
for IR Evaluation
    Invited talk, ELIAS iTREC workshop at CHIIR 2017
    Oslo, Norway, March 2017.

2016

  • Overview of the TREC 2016 Open Search track: Academic Search Edition
    25th Text REtrieval Conference (TREC ’16)
    Gaithersburg, Maryland, USA, November 2016.
    [Slides (10-up)|SlideShare]
  • Overview of the Living Labs for IR Evaluation (LL4IR) CLEF Lab
    7th International Conference of the CLEF Association (CLEF ’16)
    Évora, Portugal, September 2016.
    [Slides (8-up)|SlideShare]
  • Towards an Understanding of Transactional Tasks
    7th International Conference of the CLEF Association (CLEF ’16)
    Évora, Portugal, September 2016.
    [Poster]
  • Entity Linking
    Tutorial, 10th Russian Summer School in Information Retrieval (RuSSIR ’16)
    Saratov, Russia, August 2016.
    [Slides (10-up)|SlideShare]
  • Entity Search: The Last Decade and the Next
    Keynote talk, 10th Russian Summer School in Information Retrieval (RuSSIR ’16)
    Saratov, Russia, August 2016.
    [SlideShare]
  • Artificial Intelligence: From Search Engines to Digital Personal Assistants
    Invited talk, Art Science & Cocktails
    Stavanger, Norway, August 2016.
  • Entity Linking and Retrieval for Semantic Search
    As part of the PhD course “Advanced Information Retrieval and Web-indexing”, Oslo and Akershus University College of Applied Sciences (HiOA)
    Oslo, Norway, May 2016.
  • Living Labs for 
Online Evaluation
    Invited talk, University of Lugano
    Lugano, Switzerland, April 2016
  • Living Labs for Online Evaluation: From Theory to Practice
    Half-day tutorial with A. Schuth, 38th European Conference on Information Retrieval (ECIR ’16)
    Padua, Italy, March 2016.
    [Slides|Complete tutorial material]

2015

  • Task-Completion Engine
    Innovation seminar
    Stavanger, Norway, November 2015.
  • Probabilistic Field Mapping for Product Search
    Sixth International Conference of the CLEF Association (CLEF ’15)
    Toulouse, France, September 2015.
    [Slides (8-up)|Poster]
  • Evaluation Initiatives for Entity-oriented Search
    Keynote talk, KEYSTONE Spring WG Meeting 2015
    Kosice, Slovakia, May 2015.
    [Slides (8-up)|SlideShare]
  • Task-completion Engines: A Vision with a Plan
    ECIR ’15 workshop on Supporting Complex Search Tasks (SCST ’15)
    Vienna, Austria, March 2015.
    [Poster]
  • Living Labs for Information Retrieval Evaluation
    Evaluation-as-a-Service (EaaS) expert workshop
    Sierre, Switzerland, March 2015.
  • How Search Engines Work
    Open day, University of Stavanger
    Stavanger, Norway, March 2015.

2014

  • Head First: Living Labs for Ad-hoc Search Evaluation
    23rd ACM International Conference on Information and Knowledge Management (CIKM ’14)
    Shanghai, China, November 2014.
    [Poster]
  • How Search Engines Work
    Open day, University of Stavanger
    Stavanger, Norway, September 2014.
  • How Search Engines Work
    Randaberg videregående skole
    Stavanger, Norway, September 2014.
  • How Search Engines Work
    St. Olav videregående skole
    Stavanger, Norway, September 2014.
  • Semantic and Entity-oriented Search
    Stavanger Aftenblad
    Stavanger, Norway, September 2014.
  • Entity Retrieval
    As part of the full-day tutorial “Entity Linking and Retrieval for Semantic Search” with E. Meij and D. Odijk, Tutorial organized by Radialpoint Inc.
    Montreal, Canada, June 2014.
    [Slides (8-up)|SlideShare|Complete tutorial material]
  • Entity-oriented and Semantic Search
    As part of the PhD course “Advanced Information Retrieval and Web-indexing”, Oslo and Akershus University College of Applied Sciences (HiOA)
    Oslo, Norway, June 2014.
  • The Life of a Query
    Open day, University of Stavanger
    Stavanger, Norway, March 2014.
  • Entity Retrieval
    As part of the half-day tutorial “Entity Linking and Retrieval for Semantic Search” with E. Meij and D. Odijk, 7th ACM International Conference on Web Search and Data Mining (WSDM ’14)
    New York City, NY, USA, February 2014.
    [Slides (8-up)|SlideShare|Complete tutorial material]

2013

  • Knowledge Base Acceleration: A First Round of TEA
    Invited talk, ILPS, University of Amsterdam
    Amsterdam, The Netherlands, November 2013.
  • Time-aware Evaluation of Cumulative Citation Recommendation Systems
    SIGIR ’13 workshop on Time-aware Information Access (#TAIA2013)
    Dublin, Ireland, August 2013.
    [Slides (8-up)|SlideShare]
  • Cumulative Citation Recommendation: Classification vs. Ranking
    36th international ACM SIGIR conference on Research and development in Information Retrieval (SIGIR ’13)
    Dublin, Ireland, July 2013.
    [Poster]
  • A Test Collection for Entity Search in DBpedia
    36th international ACM SIGIR conference on Research and development in Information Retrieval (SIGIR ’13)
    Dublin, Ireland, July 2013.
    [Poster]
  • Entity Retrieval
    As part of the full-day tutorial “Entity Linking and Retrieval” with E. Meij and D. Odijk, 36th international ACM SIGIR conference on Research and development in Information Retrieval (SIGIR ’13)
    Dublin, Ireland, July 2013.
    [Slides (8-up)|SlideShare|Complete tutorial material]
  • Multi-step Classification Approaches to Cumulative Citation Recommendation
    10th Conference on Open Research Areas in Information Retrieval (OAIR ’13)
    Lisbon, Portugal, May 2013.
    [Slides (8-up)|SlideShare]
  • KBAAA: A Web-based Toolkit for the Assessment and Analysis of Knowledge Base Acceleration Systems
    10th Conference on Open Research Areas in Information Retrieval (OAIR ’13)
    Lisbon, Portugal, May 2013.
    [Demo]
  • Entity Retrieval
    As part of the half-day tutorial “Entity Linking and Retrieval” with E. Meij and D. Odijk, 22nd International World Wide Web Conference (WWW ’13)
    Rio de Janeiro, Brazil, May 2013.
    [Slides (8-up)|SlideShare|Complete tutorial material]
  • The Life of a Query
    Open day, University of Stavanger
    Stavanger, Norway, March 2013.
  • Semistructured Data Search
    Invited lecture, PROMISE Winter School 2013, Bridging between Information Retrieval and Databases
    Bressanone, Italy, February 2013.
    [Slides (8-up)|SlideShare]

2012

  • On the Use of Semantic Knowledge Bases for Temporally-aware Entity Retrieval
    CIKM ’12 workshop on Exploiting Semantic Annotations in Information Retrieval (ESAIR ’12)
    Maui, Hawaii, USA, November 2012.
    [Poster]
  • Hierarchical Target Type Identification for Entity-oriented Queries
    21st ACM Conference on Information and Knowledge Management (CIKM ’12)
    Maui, Hawaii, USA, November 2012.
    [Poster]
  • Collection Ranking and Selection for Federated Entity Search
    19th International Symposium on String Processing and Information Retrieval (SPIRE ’12)
    Cartagena de Indias, Colombia, October 2012.
    [Slides (8-up)|SlideShare]
  • Semantic Entity Search
    Invited talk, Department of Electrical and Computer Engineering, University of Stavanger
    Stavanger, Norway, June 2012.
  • Semantic Entity Search
    Invited talk, Department of Computer Science, University College London
    London, UK, May 2012.

2011

  • Overview of the TREC 2011 Entity track
    The Twentieth Text REtrieval Conference (TREC ’11)
    Gaithersburg, Maryland, USA, November 2011.
    [Slides (8-up)]
  • Finding Related Entities
    Keynote talk, CIKM ’11 workshop on Search and Mining Entity-Relationship Data (SMER)
    Glasgow, UK, October 2011.
    [Slides (8-up)]
  • Towards a Living Lab for Information Retrieval Research and Development. A proposal for a living lab for product search tasks
    CLEF 2011: Conference on Multilingual and Multimodal Information Access Evaluation
    Amsterdam, The Netherlands, September 2011.
    [Slides (8-up)]
  • The Sindice-2011 Dataset for Entity-Oriented Search in the Web of Data
    SIGIR ’11 workshop on Entity-Oriented Search (EOS)
    Beijing, China, July 2011.
    [Slides (8-up)]
  • On the Investigation of Similarity Measures for Product Resolution
    IJCAI ’11 workshop on Discovering Meaning On the Go in Large Heterogeneous Data (LHD-11)
    Barcelona, Spain, July 2011.
    [Slides (8-up)]

2010

  • Entity Search
    Invited talk, Department of Computer and Information Science, Norwegian University of Science and Technology
    Trondheim, Norway, November 2010.
  • Overview of the TREC 2010 Entity track
    The Nineteenth Text REtrieval Conference (TREC ’10)
    Gaithersburg, Maryland, USA, November 2010.
    [Slides (8-up)|Poster]
  • Expertise Retrieval: Tasks, Methods, Evaluation
    Keynote talk, CLEF ’10 workshop on Cross-lingual Expert Search (CriES)
    Padua, Italy, September 2010.
    [Slides (8-up)]
  • Entity Search: Building Bridges between Two Worlds
    WWW ’10 workshop on Semantic Search (SemSearch ’10)
    Raleigh, NC, USA, April 2010.
    [Slides (6-up)]
  • Retrieving Entities
    Invited talk, Department of Computing Science, University of Glasgow
    Glasgow, UK, April 2010.
  • Category-based Query Modeling for Entity Search
    32nd European Conference on Information Retrieval (ECIR ’10)
    Milton Keynes, UK, March 2010.
    [Poster]
  • Beyond document search: Finding entities
    Invited talk, Microsoft Research
    Cambridge, UK, March 2010.
  • Beyond document search: Finding entities
    Invited talk, TripleTalk Semantic Web Meetings, Vrije Universiteit
    Amsterdam, The Netherlands, March 2010.

2009

  • Overview of the TREC 2009 Entity track
    The Eighteenth Text REtrieval Conference (TREC ’09)
    Gaithersburg, Maryland, USA, November 2009.
    [Slides (6-up)]
  • SaHaRa: Discovering Entity-Topic Associations in Online News
    8th International Semantic Web Conference (ISWC ’09)
    Chantilly, Virginia, USA, October 2009.
    [Poster]
  • Retrieving Entities
    Advanced SIKS-Course: Probabilistic Methods for Entity Resolution and Entity Ranking
    Zeist, The Netherlands, April 2009.
    [Slides (6-up)]

2008

  • Now that you’ve bought into Model 2, we’ll tell you why to get Model 1
    The Seventeenth Text REtrieval Conference (TREC ’08)
    Gaithersburg, Maryland, USA, November 2008.
    [Slides (6-up)]
  • Non-Local Evidence for Expert Finding
    ACM 17th Conference on Information and Knowledge Managment (CIKM ’08)
    Napa Valley, California, USA, October 2008.
    [Slides (6-up)]
  • A Few Examples Go A Long Way: Constructing Query Models from Elaborate Query Formulations
    31th Annual International ACM SIGIR Conference on Research & Development on Information Retrieval (SIGIR ’08)
    Singapore, Singapore, July 2008.
    [Slides (6-up)]
  • Bloggers as Experts
    31th Annual International ACM SIGIR Conference on Research & Development on Information Retrieval (SIGIR ’08)
    Singapore, Singapore, July 2008.
    [Poster]
  • Personal Name Resolution of Web People Search
    WWW ’08 workshop on NLP Challenges in the Information Explosion Era (NLPIX ’08)
    Beijing, China, April 2008.
    [Slides (6-up)]
  • Associating People and Documents
    30th European Conference on Information Retrieval (ECIR ’08)
    Glasgow, Scotland, April 2008.
    [Slides (6-up)]

2007

  • Query and Document Models for Enterprise Search
    Sixteenth Text REtrieval Conference (TREC ’07)
    Gaithersburg, Maryland, USA, November 2007.
    [Slides (6-up)]
  • Broad Expertise Retrieval in Sparse Data Environments
    30th Annual International ACM SIGIR Conference on Research & Development on Information Retrieval (SIGIR ’07)
    Amsterdam, The Netherlands, July 2007.
    [Slides (6-up)]
  • Finding Similar Experts
    30th Annual International ACM SIGIR Conference on Research & Development on Information Retrieval (SIGIR ’07)
    Amsterdam, The Netherlands, July 2007.
    [Poster]
  • People Search in the Enterprise
    Doctoral Consortium, SIGIR ’07
    Amsterdam, The Netherlands, July 2007.
    [Slides (6-up)]
  • Tracking User Generated Content
    Invited talk, Kickoff meeting of new mastertrack HAIT (Human Aspects of Information Technology)
    University of Tilburg, The Netherlands, May 2007.
    [Slides (6-up)]
  • How to Overcome Tiredness: Estimating Topic-Mood Associations
    International Conference on Weblogs and Social Media (ICWSM ’07)
    Boulder, Colorado, USA, March 2007.
    [Slides (6-up)]
  • Determining Expert Profiles (With an Application to Expert Finding)
    20th International Joint Conference on Artifical Intelligence (IJCAI ’07)
    Hyderabad, India, January 2007.
    [Slides (6-up)]

2006

  • Why Are They Excited? Identifying and Explaining Spikes in Blog Mood Levels
    Scientific ICT Research Event Netherlands (SIREN ’06)
    Utrecht, The Netherlands, October 2006.
    [Poster]
  • Formal Models for Expert Finding in Enterprise Corpora
    29th Annual International ACM SIGIR Conference on Research & Development on Information Retrieval (SIGIR ’06)
    Seattle, USA, August 2006.
    [Slides (6-up)]
  • Decomposing Bloggers’ Moods
    WWW ’06 workshop on the Weblogging Ecosystem
    Edinburgh, Scotland, May 2006.
    [Slides (6-up)]
  • Finding Experts and their Details in E-mail Corpora
    15th International World Wide Web Conference (WWW ’06)
    Edinburgh, Scotland, May 2006.
    [Poster]
  • Why Are They Excited? Identifying and Explaining Spikes in Blog Mood Levels
    11th Meeting of the European Chapter of the Association for Computational Linguistics (EACL ’06)
    Trento, Italy, April 2006.
    [Poster]