Tutorials

Mixed Method Development of Evaluation Metrics[slides]
Praveen Chandar, Brian St., Christine Hosey, Fernando Diaz
KDD 2021 (Website)

Beyond Accuracy: Grounding Evaluation Metrics for Human-Machine Learning Systems [slides]
Praveen Chandar, Brian St. Thomas, Fernando Diaz
NeurIPS 2020 (Video)

Recent Talks

Large Scale Experimentation Using NVTabular [slides]
Invited Talk: Nvidia, Dec'21

Metrics & Evaluation at Spotify [slides]
Invited Talk: Peloton, Nov'21

Mixed Methods Research at Spotify [slides]
Invited Talk: RMIT, Oct'21

Counterfactual Evaluation of Sequential Recommendations[slides]
Research Talk: KDD, Sept'21

Offline Comparative Evaluation with Incremental, Minimally-Invasive Online Feedback[slides]
Research Talk: SIGIR, Sept'19