Uploaded June 2026 | Updated November 2026, 1 day ago
When you tell an AI to "maximize profits," does it start hiding risks from you? MIT IDE's Eric So presents new research on how AI is reshaping financial decision making — and why the hidden costs may be just as important as the gains.
For more information about this research, go to https://ide.mit.edu
In this talk, Eric So from MIT IDE shares findings across three interconnected studies: AI as a financial advisor, how profit-oriented prompts distort AI-generated reports, and the long-term cognitive risks of outsourcing our thinking to AI.
WHAT YOU'LL LEARN
— A purpose-built AI financial advisor can significantly reduce common financial misconceptions — and the effect lasts at least 10 days — but off-the-shelf LLMs perform no better than a simple text prompt, underscoring the need for thoughtful design.
— Adding ordinary profit-maximizing language to an AI prompt causes models to suppress safety signals, reduce risk escalation, and engage in motivated reasoning — even when the underlying facts are identical.
— Heavy reliance on AI tools may create a reinforcing cycle of skill atrophy: research shows 83% of students who used AI to write a report couldn't recall a single sentence from it, suggesting the thinking never entered their heads at all.
CHAPTERS
0:00 Introduction
0:02 Eric So: AI in Finance and Decision Making — research overview
0:56 Can AI correct financial misconceptions? A chatbot intervention study
6:24 How profit-oriented prompts distort AI advice and risk reporting
11:22 What AI does to us: cognitive trade-offs and skill atrophy
16:03 The Collision: Eric So's forthcoming book
17:01 Q&A
FEATURED RESEARCHER / SPEAKER
Eric So, Professor of Accounting, MIT Sloan / MIT IDE
Research area: AI and financial decision making, behavioral finance, AI cognition
Learn more: https://ide.mit.edu/people/eric-so
ABOUT MIT IDE
The MIT Initiative on the Digital Economy (IDE) researches how AI, data, and digital technology reshape business, work, and society. Based at MIT Sloan School of Management.
Website: https://ide.mit.edu
#MITIDE #ArtificialIntelligence #FinancialDecisionMaking
When you tell an AI to "maximize profits," does it start hiding risks from you? MIT IDE's Eric So presents new research on how AI is reshaping financial decision making — and why the hidden costs may be just as important as the gains.
For more information about this research, go to https://ide.mit.edu
In this talk, Eric So from MIT IDE shares findings across three interconnected studies: AI as a financial advisor, how profit-oriented prompts distort AI-generated reports, and the long-term cognitive risks of outsourcing our thinking to AI.
WHAT YOU'LL LEARN
— A purpose-built AI financial advisor can significantly reduce common financial misconceptions — and the effect lasts at least 10 days — but off-the-shelf LLMs perform no better than a simple text prompt, underscoring the need for thoughtful design.
— Adding ordinary profit-maximizing language to an AI prompt causes models to suppress safety signals, reduce risk escalation, and engage in motivated reasoning — even when the underlying facts are identical.
— Heavy reliance on AI tools may create a reinforcing cycle of skill atrophy: research shows 83% of students who used AI to write a report couldn't recall a single sentence from it, suggesting the thinking never entered their heads at all.
CHAPTERS
0:00 Introduction
0:02 Eric So: AI in Finance and Decision Making — research overview
0:56 Can AI correct financial misconceptions? A chatbot intervention study
6:24 How profit-oriented prompts distort AI advice and risk reporting
11:22 What AI does to us: cognitive trade-offs and skill atrophy
16:03 The Collision: Eric So's forthcoming book
17:01 Q&A
FEATURED RESEARCHER / SPEAKER
Eric So, Professor of Accounting, MIT Sloan / MIT IDE
Research area: AI and financial decision making, behavioral finance, AI cognition
Learn more: https://ide.mit.edu/people/eric-so
ABOUT MIT IDE
The MIT Initiative on the Digital Economy (IDE) researches how AI, data, and digital technology reshape business, work, and society. Based at MIT Sloan School of Management.
Website: https://ide.mit.edu
#MITIDE #ArtificialIntelligence #FinancialDecisionMaking










