Together with ChengXiang Zhai, we will be giving our user simulation tutorial at AAAI’24 and WWW’24, customized to the respective audiences. The AAAI’24 edition adopts a broader perspective of user simulation for evaluating an interactive AI system and focuses more on simulation algorithms and techniques that are well connected with various sub-fields of AI, such as machine learning and agent-based systems. In contrast, the WWW’24 edition emphasizes more on applications of user simulation for evaluating Web information access systems, including click modeling and the application of simulation techniques in e-commerce.
Year: 2023
Tutorial on User Simulation @CIKM’23
I’m excited to share that, together with the esteemed ChengXiang Zhai, we’ll be presenting a tutorial on “User Simulation for Evaluating Information Access Systems” at the upcoming 32nd ACM International Conference on Information and Knowledge Management (CIKM ’23) in Birmingham, UK, in October. This half-day tutorial is based on our upcoming FnTIR book. We look forward to sharing our insights and also hope for feedback that could shape the final version of the book. Visit our companion website usersim.ai for more info.
User Simulation book draft available
I’m excited to share the draft of our book, co-authored by ChengXiang Zhai, User Simulation for Evaluating Information Access Systems: http://arxiv.org/abs/2306.08550
This book focuses on providing a thorough understanding of user simulation techniques designed specifically for evaluation purposes. We systematically review both general frameworks and specific models and algorithms for simulating user interactions with search engines, recommender systems, and conversational assistants.
We invite feedback on this first version. If you have suggestions, comments, pointers, etc. reach out to me in email!