MIT CODE 2024 Plenary Session 1: Johan Ugander and Sida Peng @mitide
MIT CODE 2024 Plenary Session 1: Johan Ugander and Sida Peng  @mitide
Uploaded October 2024 | Updated November 2026, 1 day ago
Johan Ugander – Associate Professor, Stanford School of Engineering
Counterfactual Evaluation of Peer-Review Assignment Policies
Peer review assignment algorithms aim to match research papers to suitable expert reviewers, working to maximize the quality of the resulting reviews. A key challenge in designing effective assignment policies is evaluating how changes to the assignment algorithm map to changes in review quality. In this work, we leverage recently proposed policies that introduce randomness in peer-review assignment–in order to mitigate fraud–as a valuable opportunity to evaluate counterfactual assignment policies. To address challenges in applying standard off-policy evaluation methods, such as violations of positivity, we introduce novel methods for partial identification based on monotonicity and smoothness assumptions. We apply our methods to peer-review data from two computer science venues, including a major conference with over 8000 submissions and over 3000 reviewers.

Sida Peng – Sr. Principal Economist, MSFT
The Productivity Effects of Generative AI – Evidence from Three Field Experiments with Software Developers
This study evaluates the impact of generative AI on software developer produc- tivity by analyzing data from three randomized controlled trials conducted at Mi- crosoft, Accenture, and an anonymous Fortune 100 electronics manufacturing com- pany. These field experiments, which were run by the companies as part of their ordinary course of business, provided a randomly selected subset of developers with access to GitHub Copilot, an AI-based coding assistant that suggests intelligent code completions. Though each separate experiment is noisy, combined across all three experiments and 4,867 software developers, our analysis reveals a 26.08% increase (SE: 10.3%) in the number of completed tasks among developers using the AI tool. Notably, less experienced developers showed higher adoption rates and greater pro- ductivity gains.
MIT CODE 2024 Plenary Session 1: Johan Ugander and Sida PengOctober 11: Marshall Van Alstyne, Boston UniversityKeynote Fireside Chat with Scott Sandell - Chairman, CEO & Chief Investment Officer, NEACODE@MIT 2023  Plenary Session 3: Jorge GuzmanFireside Chat: The Power of Ecosystems  Thriving Together in Times of Unprecedented ChangeBIG.AI@MIT 2024: Innovation ShowcaseCODE@MIT 2023 Plenary Session 2: Martin Tingley and Jean Pouget-AbadieSocial Media Summit@MIT 2023: Responsible, Human-First AI Panel DiscussionNovember 15 - Sonny Tambe, Wharton SchoolMIT Platform Strategy Summit 2022: Fireside Chat with Joanna RosenbergBIG.AI@MIT 2024: The Impact of AI on Society Fireside ChatMay 12 - Geoffrey Parker, MIT IDE + Svenja Falk, Accenture
MIT Initiative on the Digital Economy |

MIT CODE 2024 Plenary Session 1: Johan Ugander and Sida Peng

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER