Uploaded October 2023 | Updated September 2026, 3 weeks ago
Innovation happens when we apply concepts from research papers and put them into production. Taking complex ideas and applying them to a real world production environment requires one key step: online evaluation. Theory and offline evaluations can only take you so far, you have to evaluate ideas in an online controlled setting. The better your experimentation practices are, the better you will be at evaluating research in production settings.
In this talk, we will zoom in on experimentation strategies from popular research papers that in theory, should really unlock innovation and the speed of experimenting but in practice, are hard to apply, why that's the case and what you can do to put research paper concepts into production.
Leemay Nassery
Engineering leader at Spotify
@LeemayNassery
Leemay Nassery is an engineering leader at Spotify. She is also the author of Practical A/B Testing.
----
Recorded on Sept 22, 2023 in the PWLConf track at Strange Loop 2023 in St. Louis, MO.
thestrangeloop.com
https://pwlconf
Innovation happens when we apply concepts from research papers and put them into production. Taking complex ideas and applying them to a real world production environment requires one key step: online evaluation. Theory and offline evaluations can only take you so far, you have to evaluate ideas in an online controlled setting. The better your experimentation practices are, the better you will be at evaluating research in production settings.
In this talk, we will zoom in on experimentation strategies from popular research papers that in theory, should really unlock innovation and the speed of experimenting but in practice, are hard to apply, why that's the case and what you can do to put research paper concepts into production.
Leemay Nassery
Engineering leader at Spotify
@LeemayNassery
Leemay Nassery is an engineering leader at Spotify. She is also the author of Practical A/B Testing.
----
Recorded on Sept 22, 2023 in the PWLConf track at Strange Loop 2023 in St. Louis, MO.
thestrangeloop.com
https://pwlconf
