Dr Leo Tiokhin | Red Team challenge: Incentivizing scientific criticism @RIOTScienceClub
Dr Leo Tiokhin | Red Team challenge: Incentivizing scientific criticism  @RIOTScienceClub
Uploaded September 2020 | Updated September 2026, 1 week ago
About this talk

Scientific rigor is the essence of scientific works. The more that a scientific product has been exposed to flaw detection, the more that researchers can trust the product. However, there are barriers to adopting critical approaches in science. For instance, there is little incentive for scientists to critically examine other researchers’ materials, since they are not adequately rewarded for criticizing others’ work, whether via traditional forms of peer-review or other less-traditional efforts to detect flaws in the published literature. This hinders the ability of the scientific process to weed-out errors and self-correct. In this talk, Leonid will discuss an initiative, the Red Team Challenge, in which they provided scientists with up to $3000 in financial incentives to identify problems in a scientific paper. He will discuss feasible and effective ways to improve the self-correcting nature of science.


About the speaker

Dr. Tiokhin is a postdoctoral researcher at the Eindhoven University of Technology, within Dr. Lakens team. His research focuses on how incentive structures affect the efficiency and reliability of science and evolutionary approaches to improve theory in the social sciences.


About the RIOT science club

The RIOT Science Club gives talks/workshops on Reproducible, Interpretable, Open & Transparent Science. We are currently operating at different sites within the UK and the Netherlands.

You can subscribe to our mailing list, to receive regular information on upcoming talks and workshops, any local events and vacancies for positions in open and reproducible research.
See riotscienceNL.com for events in the NL, and riotscience.co.uk for events in the UK.

You can also find us on Twitter at @riotscienceNL for events in the NL, and @riotscienceclub for events in the UK.

If you would like to give a talk or workshop for The RIOTS Club, please email riots.rdam@gmail.com (NL) or riotscienceclub@kcl.ac.uk (UK).
Dr Leo Tiokhin | Red Team challenge: Incentivizing scientific criticismAsha Sahni | Reciprocal Mentoring  - Understanding, Empathy, ActionDr Mark Sabbagh | Claims & EvidenceOpen data: The experience of Journal of Open Humanities Data | Paola Marongiu & Barbara McGillivrayDr Priya Silverstein | Easing into open science : No time like the presentDr Daniel Quintana | Using Twitter for Science | R.I.O.T. Science ClubLike the layers of an onion: Transparency and reproducibility for quant research | Prof Ben MarwickVersion control for academics with GitHub | Dr Sam ForbesERЯOR: A bug bounty program for science by Dr Ian HusseyCannabis: the Good, the Bad, & the Psychotic by Prof Sir Robin MurrayDr Matt Wall | How reliable is fMRI, and does it actually matter?Dr. Charles Driver | Dynamic Systems Modelling and Simulation - Assisted Thought Experiments
RIOT Science Club |

Dr Leo Tiokhin | Red Team challenge: Incentivizing scientific criticism

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER