Making LLMs hallucinate less, how to diagnose ML models - Vikram Chatterji-TheDataScientistShow #066 The Data Scientist Show 2023-08-01 | Vikram is the co-founder of Galileo – an AI diagnostics and explainability platform used by data science teams building NLP, LLMs and Computer Vision models across the Fortune 500 and high growth startups. Prior to Galileo, Vikram led Product Management at Google AI, where his team built models for the Fortune 2000 across retail, financial services, healthcare and contact centers. He has a master degree from Carnegie Mellon University from the school of computer science. If you enjoy the show, subscribe to the channel and leave a 5-star review. Subscribe to Daliana's newsletter on www.dalianaliu.com for more on data science and career.Resources:LLM Studio: rungalileo.io/blog/announcing-llm-studioGalileo: rungalileo.ioBlog on LLM Hallucination: thesequence.substack.com/p/guest-post-stop-hallucinations-fromVikram Chatterji’s LinkedIn: linkedin.com/in/vikram-chatterji"The Mom Test": amazon.com/The-Mom-Test-Rob-Fitzpatrick-audiobook/dp/B07RJZKZ7FDaliana's Twitter: twitter.com/DalianaLiu Daliana's LinkedIn: linkedin.com/in/dalianaliu00:00:00 Introduction00:04:24 How he got into machine learning00:06:53 Diagnosing large language models00:09:56 Addressing model hallucination00:12:46 Metrics for measuring hallucination00:17:30 From Google AI to starting Galileo00:24:08 Developing LLMs and putting them into production00:32:51 Galileo's diagnostics and explainability platform00:43:16 Advice for data scientists when joining a startup
The art of sales (as an engineer), from PhD to sales engineer in AI - Mike Lo The Data Scientist Show 2025-08-02 | Daliana’s newsletter: https://www.dalianaliu.blog/Daliana interviewed her friend of 10 years, Mike Lo, on how he went from a physics PhD to Sales Engineer at Databricks, and fun stories of their friendship in LA.Mike Lo’s Linkedin: linkedin.com/in/hellomikelo
Why she quit Amazon to vlog, Creator Economy, Evelyn - Daliana’s Game - 01 The Data Scientist Show 2025-07-27 | Daliana’s newsletter on how to create your edge in data &AI: dalianaliu.kit.com/e0dcfc214bEvelyn was an analytics manager at Amazon, we talked about how she became a vlogger, how she navigated her career after leaving Amazon, and what she learned about the creator economy.Evelyn’s YouTube: youtube.com/@tapiocapress
Why I’m ending this show. Death, afterlife, Chinese philosophy, and what’s next? ft. Tina Huang The Data Scientist Show 2025-04-21 | I had a fun “funeral” of this show with Tina Huang, we talked about death, afterlife, and the various transitions as content creators. Join the newsletter with 20k readers to read my career stories here: https://www.dalianaliu.blog/
How to Advance Your Career in Data Science - Daliana Liu and Jon Krohn - The Data Scientist Show #91 The Data Scientist Show 2025-04-07 | ➡️ Learn more about the DS Career Coaching Course: https://forms.gle/cQLQxJfNsf18b4Au7I went on Super Data Science with Jon Kron to discuss how to accelerate your career in data science, why I paused the podcast, and how to navigate the industry's change.Daliana's newsletter about career influence and personal branding: dalianaliu.kit.com/e0dcfc214b
To data consultants The Data Scientist Show 2025-02-20 | Ben Rogojan, aka, Seattle data guy is an ex-Meta data engineer turned data engineering consultant and YouTuber. He has 100k followers each on YouTube and LinkedIn. We talked about how he become an independent consultant and the current state of data engineering.- Ben’s LinkedIn: linkedin.com/in/benjaminrogojan/- Daliana’s newsletter on career growth and personal branding: dalianaliu.kit.com/profileHi! I'm Daliana Liu Join 20,000+ subscribers to read the career lessons from my 7-year experience at Amazon and my solo-founder journey.
Future of Data Engineering The Data Scientist Show 2025-02-19 | Ben Rogojan, aka, Seattle data guy is an ex-Meta data engineer turned data engineering consultant and YouTuber. He has 100k followers each on YouTube and LinkedIn. We talked about how he became an independent consultant and the current state of data engineering.- Ben’s LinkedIn: linkedin.com/in/benjaminrogojan- Daliana’s newsletter on career growth and personal branding: dalianaliu.kit.com/profileHi! I'm Daliana LiuJoin 20,000+ subscribers to read the career lessons from my 7-year experience at Amazon and my solo-founder journey.
Current status of data engineering The Data Scientist Show 2025-02-17 | Ben Rogojan, aka, Seattle data guy is an ex-Meta data engineer turned data engineering consultant and YouTuber. He has 100k followers each on YouTube and LinkedIn. We talked about how he became an independent consultant and the current state of data engineering.- Ben’s LinkedIn: linkedin.com/in/benjaminrogojan- Daliana’s newsletter on career growth and personal branding: dalianaliu.kit.com/profileHi! I'm Daliana LiuJoin 20,000+ subscribers to read the career lessons from my 7-year experience at Amazon and my solo-founder journey.
From Meta to independent data consultant, Ben Rogojan-the data scientist show#090 The Data Scientist Show 2025-02-17 | Ben Rogojan, aka, Seattle data guy is an ex-Meta data engineer turned data engineering consultant and YouTuber. He has 100k followers each on YouTube and Linkedin. We talked about how he become an independent consultant and the current state of data engineerings.- Ben’s Linkedin: linkedin.com/in/benjaminrogojan- Daliana’s newsletter on career growth and personal branding: dalianaliu.kit.com/profileHi! I'm Daliana LiuJoin 20,000+ subscribers to read the career lessons from my 7-year experience at Amazon and my solo-founder journey.
Why data scientistsare frustrated? Here are 6 reasons - The Data Scientist Show #089 The Data Scientist Show 2024-04-25 | Daliana interviewed 6 data scientists from her meetup in New York City. It's a unique episode where you get to hear the real frustrations of data scientists. We talked about struggles working in healthcare, finance, data quality and AI, how to advocate for yourself, and align with your managers. Subscribe to Daliana's newsletter on www.dalianaliu.com for more on data science and career.Daliana's Twitter: twitter.com/DalianaLiuDaliana’s LinkedIn: linkedin.com/in/dalianaliu00:00:00 Introduction00:01:50 Frustration with AI projects00:02:03 Frustration with managers00:02:26 Your manager needs to be a protector00:03:38 How to be a good manager00:05:33 How to protect yourself at work00:06:08 What to say when pushing back requests00:07:16 Frustration as a data scientist in healthcare00:11:14 Data science feels transactional00:14:10 Data science meetup feedbacks00:14:48 Does he feel lonely?00:17:59 How to hate job interviews less00:18:34 What's draining for a VP of data science?00:20:11 Frustration about follow-up request00:22:40 Being a "trusted partner"00:23:54 Why does she feel like a second-class citizen?00:25:55 Daliana's story00:28:59 Job stability in finance00:30:58 Imposter syndrome00:36:58 Frustration as an AI strategist and content creator00:38:16 How Daliana plans her content00:39:23 Context switching00:41:01 How to manage your time
Why 80% A/B tests fail - Kristi Angel - The Data Scientist Show #088 The Data Scientist Show 2024-04-25 | Most experimentations fail, Kristi Angel shares her expertise on scaling experimentation and avoiding common A/B testing pitfalls. Learn five things that can help boost test velocity, designing impactful experiments, and leveraging knowledge repos. Subscribe to Daliana's newsletter on www.dalianaliu.com for more on data science and career.Daliana's Twitter: twitter.com/DalianaLiuDaliana’s LinkedIn: linkedin.com/in/dalianaliuKristi Angel’s LinkedIn: linkedin.com/in/kristiangel00:00:00 Introduction00:01:21 Why do most experimentations fail?00:06:60 Mistakes in choosing metrics00:10:00 Is revenue a good metric?00:13:13 Split metrics in three ways00:15:05 Daliana's story with too many category breakdowns00:16:54 What makes the best data science team?00:19:19 Data scientist work in silo vs in a data science team00:21:10 Building a knowledge center00:23:35 Example of knowledge center; nuance of experimentations00:26:04 How many metrics and variants?00:30:51 How to reduce noise - CUPED00:32:56 Future of A/B testing00:38:28 Q&A: Low statistical power
From Physics PhD to MLOps builder - Julia Silge - The Data Scientist Show #087 The Data Scientist Show 2024-04-25 | Julia Silge is an engineering manager at Posit PBC, formerly know as R-studio, where she leads a team of developers building open source software MLOps. Before Posit, she finished a PhD in astrophysics, worked for several years in the nonprofit space, and was a data scientist at Stack Overflow where some of her most public work involved the annual developer survey. We talked about MLOps tools, challenges in survey data, text analysis, and balancing her interests in data science and engineering. Subscribe to Daliana's newsletter on www.dalianaliu.com for more on data science and career.Daliana's Twitter: twitter.com/DalianaLiuDaliana’s LinkedIn: linkedin.com/in/dalianaliu/Julia’s LinkedIn: linkedin.com/in/juliasilgeJulia’s Website: juliasilge.com00:00:00 Introduction00:00:51 Getting into data science00:04:45 Transition from data centers to engineering manager00:13:59 Common challenges in tool development00:17:33 Challenges with survey data00:26:42 Engineering skills for data scientists00:28:54 Balancing roles00:34:44 Developing skills in Exploratory Data Analysis (EDA)00:39:14 Python vs. R for data analysis00:44:35 Exciting aspects in career and personal life
Why he created pandas, the future of data systems - Wes McKinney - The Data Scientist Show #086 The Data Scientist Show 2024-04-25 | Wes McKinney is the co-creator of pandas library and he is the cofounder of Voltron data. Currently he is a principal Architect at Posit and an investor in data systems. Subscribe to Daliana's newsletter on www.dalianaliu.com for more on data science and career.Daliana's Twitter: twitter.com/DalianaLiuDaliana’s LinkedIn: linkedin.com/in/dalianaliu/Wes' LinkedIn: linkedin.com/in/wesmckinn00:00:00 Introduction00:00:39 How Pandas Started00:06:35 Voltron Data00:09:58 Benefits of Easy-to-Use Data Tools00:13:15 The Rise of New Data Tools00:18:02 Choosing Tools: Vertical or Flexible?00:22:56 Big Models and Data Tools00:29:24 Challenges in Building a Product00:31:23 Becoming a Top Architect00:34:50 Missed Aspects of Previous Roles00:38:59 A Busy Week: Advising, Designing, Investing00:43:37 Improving Open Source00:45:19 How to Decide What to Work On00:46:23 What he’s learning now00:47:51 Excitement in Career and Life00:48:24 Using ChatGPT for Learning00:50:22 Future Impact Goals
Adapters: the game changer for fine-tuning - Geoffrey Angus - The Data Scientist Show #084 The Data Scientist Show 2024-03-08 | I interviewed Geoffery Angus, ML team lead @Predibase to talk about why adapter-based training is a game changer. We started with an overview of finetuning and then discussed five reasons why adapters are the future of LLMs. Later we also shared a demo and answered questions from the live audience. Try finetuning for free: pbase.ai/GetStartedGeoffrey’s LinkedIn:linkedin.com/in/geoffreyangusDaliana's Twitter: twitter.com/DalianaLiuDaliana’s LinkedIn: linkedin.com/in/dalianaliu/00:00:00 Intro00:01:19 What is Fine-tuning?00:08:18 Utilizing Adapters for Finetuning Enhancement00:09:50 5 reasons why adapters are the future of LLMs00:26:34 Common Mistakes in Adapters Usage00:28:34 Training Your Own Adapter00:32:23 Behind the Scenes of the Adapter Training Process00:37:51 Config File Guidance for Fine-Tuning00:39:41 Debugging Strategies for Suboptimal Fine-Tuning Results00:42:23 User Queries: Creating a LoRa Adapter and Future Support00:51:06 Key Takeaways and Recap
From data scientist to lifestyle business owner - Jay Feng - The Data Scientist Show #083 The Data Scientist Show 2024-03-05 | Jay Feng created a viral project using Seattle crime data and later got into data science. He later founded "Interview Query" helping data scientists get jobs. We'll talk about how he landed his data science job through his blog, and his journey from data scientist to founder. Subscribe to Daliana's newsletter on www.dalianaliu.com for more on data science and career.Daliana's Twitter: twitter.com/DalianaLiuDaliana’s LinkedIn: linkedin.com/in/dalianaliu/Jay Feng's LinkedIn: linkedin.com/in/jay-feng-ab66b049/Jay Feng's YouTube: youtube.com/c/DataScienceJay00:00:00 Introduction00:01:11 From engineer to data scientist00:03:10 Got a job through a project00:05:35 Daliana's portfolio project with Zillow00:09:13 From data scientist to entreprenuer00:13:19 "Tinder" for job00:15:01 How he chose companies to work for00:15:56 Why he became an entreprenuer00:17:37 How many hours does he work00:18:54 Challenges when building "interview query"00:20:18 Speed vs scale00:22:11 Growth hacks he used00:24:22 YouTube vs newsletter00:27:21 Lessons he learned as a CEO00:29:16 How to grow from tech employee to founder00:31:59 How he defines success00:34:38 If you have a business idea for Jay
GenAI case studies - Erik Gafni - The Data Scientist Show #082 The Data Scientist Show 2024-03-05 | Erik Gafni builds AI systems and teams. He founded Eventum AI (bit.ly/eventum-ai), an ML consulting company working with high-growth startups. We talked about GenAI projects he worked on, how he built production ML systems, how to scale ML teams, and his journey from biologist to ML researcher. Subscribe to Daliana's newsletter on www.dalianaliu.com for more on data science and career.Daliana's Twitter: twitter.com/DalianaLiuDaliana’s LinkedIn: linkedin.com/in/dalianaliu/Erik’s LinkedIn: linkedin.com/in/erik-gafni-906b0125Interested in working with Erik: bit.ly/erik-consulting00:00:00 Introduction00:01:59 Is GenAI overhyped?00:04:28 Ascent translation with AI00:11:58 Social media app with AI00:14:00 Stable diffusion model evaluation00:15:57 "Consult-to-hire" model00:17:35 AI in biotech00:22:46 Self-supervised learning00:31:22 How he hires people00:33:19 Research vs production00:35:57 Is AGI coming?00:37:30 New trends in GenAI00:41:45 Data quality in GenAI00:42:58 Philosophy in LLMs00:49:48 OpenAI vs Open Source00:53:58 Mistakes he made00:57:41 How did he get into ML
How To Optimize SQL - Jess Ramos - The Data Scientist Show #076 The Data Scientist Show 2024-02-28 | Full interview: youtube.com/watch?v=soF5zBZ9eQs&t=104sJess Ramos is a Senior Data Analyst at Crunchbase, a LinkedIn Learning Instructor, and a content creator in the data space. She has a bachelor's degree in Math, Spanish, and Business from Berry University and a master's in Business Analytics from University of Georgia. Today we’ll talk about SQL in the real world, data analyst vs data scientist, is job hopping bad, how she negotiated her salary. Subscribe to Daliana's newsletter on www.dalianaliu.com for more on data science and career.Jess’ Linkedin: linkedin.com/in/jessramosmsbaPreparing to Get a Job in Data Analytics: shorturl.at/sCNPTSolve Real-World Data Problems with SQL: bit.ly/3Zq6wndBig Data Energy Newsletter: bit.ly/46x4rIRDaliana's Twitter: twitter.com/DalianaLiuDaliana’s LinkedIn: linkedin.com/in/dalianaliu
Data science job market in 2024 - Jay Feng - The Data Scientist Show #081 The Data Scientist Show 2024-02-18 | Jay Feng is the CEO of interview query, a service that help data scientists get jobs. Previously he worked as a data scientist at Nextdoor, Monster. We talked about data science job market, the rise of AI engineering, and the softskills people overlook during interviews. Subscribe to Daliana's newsletter on www.dalianaliu.com for more on data science and career.Daliana's Twitter: twitter.com/DalianaLiuDaliana’s LinkedIn: linkedin.com/in/dalianaliuJay Feng's LinkedIn: linkedin.com/in/jay-feng-ab66b049Jay Feng's YouTube: youtube.com/c/DataScienceJay00:00:00 Introduction00:01:09 Data science job market in 202400:09:14 Build projects with AI00:16:27 Softskills in interviews00:23:32 Daliana's story on "socializing ideas"00:28:55 Common mistakes in interviews00:35:56 Product DS vs ML interviews00:36:51 Product analytics interview questions00:39:45 Career transition in DS00:43:40 Jay's career journey00:46:15 Is there a principal data analyst?00:52:30 AI engineer00:55:06 New roles vs obsolete roles in DS01:05:21 Is data science dead?
How to handle getting laid off - Susan Shu Chang, Sundar Swaminathan - The Data Scientist Show #080 The Data Scientist Show 2024-02-09 | Today we’re joined by two data scientists who have firsthand experience with layoffs. We’ll talk about how to negotiate severance packages, how to handle stress, strategies for job hunting post-layoff, and how to reduce risks in full-time employment. Subscribe to Daliana's newsletter on www.dalianaliu.com for more on data science and career. Working with Daliana on personal branding: https://forms.gle/heNuZzaHjaAMQwLu6Daliana’s email: daliana@dalianaliu.comDaliana's Twitter: twitter.com/DalianaLiuDaliana’s LinkedIn: linkedin.com/in/dalianaliuSusan Shu ChangLinkedIn: linkedin.com/in/susan-shu-changNewsletter: http://susanshu.substack.comSundar SwaminathanLinkedIn: linkedin.com/in/sswamina3Website: sundarswaminathan.com00:00:00 Introduction00:06:13 Severance Negotiation00:20:29 Identity crisis00:26:22 Job search after layoff00:30:21 Networking00:35:23 Risk at pre-seed startups00:37:03 How should data scientists pick companies00:40:43 What to ask hiring managers00:45:01 Does GenAI change interview processes?00:47:17 Are data science teams getting leaner?00:48:56 Future of data science roles00:50:37 Full time employment and job security00:53:46 Benefits of full time jobs00:58:14 Reduce risk of being laid off01:00:43 How to sell yourself01:02:43 How to plan your finances01:05:09 How to become an independent consultant
From data analyst to sales engineer - Jenny Wu - The Data Scientist Show #079 The Data Scientist Show 2024-02-01 | Jenny Wu is a data analyst turned sales engineer for data products at Hex. We talked about sales engineer vs data analyst, how to design a career based on your personality, and how to transition into a customer-facing role. Subscribe to Daliana's newsletter on www.dalianaliu.com for more on data science and career.Jenny’s LinkedIn: linkedin.com/in/jenny-wu-05903794Daliana's Twitter: twitter.com/DalianaLiuDaliana’s LinkedIn: linkedin.com/in/dalianaliu00:00:00 Introduction00:01:34 What is a Sales Engineer?00:09:35 Sales Engineering Day-to-Day00:13:09 Challenge in sales00:21:37 Traits of Successful Salespeople00:30:32 Stakeholder Engagement 00:36:24 Getting into customer-facing roles00:43:55 Quitting her job to travel the world00:48:05 Advice on Career Breaks00:50:39 Embedding Career and Personal Goals00:51:57 How do you achieve happiness?
The future of data science teams - Barry McCardel - The Data Scientist Show #078 The Data Scientist Show 2024-01-29 | Barry McCardel is the cofounder and CEO of Hex(free trial: hex.tech/dsshow), a collaborative data workspace. Their customers include FiveTran, Notion, and Anthropic. We talked about what does the future of data team look like, how to tackle challenges of data team collaborations, and how to leverage AI in data science’s workflow.60-day free trial for listeners: hex.tech/dsshowBarry’s LinkedIn: linkedin.com/in/barrymccardel00:00:00 Introduction00:01:25 Is AI replacing data scientists?00:06:08 Are data science teams getting smaller?00:09:57 What is Hex?00:11:26 How to communicate with stakeholders00:24:33 Should data scientists be full stack?00:31:27 How data team measure ROI00:33:42 Quantitative vs qualitative analysis00:35:39 When you shouldn't use data? Data vs product intuition00:41:43 How to hire your first data team?00:49:05 Is the modern data stack dead?00:53:59 GenAI in data science workflows00:59:02 Future of data scientist01:02:33 New features in Hex
Product data science for Microsoft AI - Sid Sharan - The Data Scientist Show #077 The Data Scientist Show 2024-01-16 | Siddhartha Sharan is a Senior Data and Applied Scientist at Microsoft, helping product teams make data-driven decisions. Currently he is working on an AI product built with OpenAI APIs for sentiment analysis. We talked about how he evaluates AI products built with large language models at Microsoft, product data science, and how he went from a business background to data science. Subscribe to Daliana's newsletter on www.dalianaliu.com for more on data science and career.Sid’s LinkedIn: linkedin.com/in/siddharthasharan/Daliana's Twitter: twitter.com/DalianaLiuDaliana’s LinkedIn: linkedin.com/in/dalianaliu00:00:00 Introduction00:05:20 How does Microsoft evaluate AI product00:16:17 Using OpenAI API for sentiment analysis00:25:29 Microsoft data science team culture00:26:52 DS, PM collaboration00:28:29 Three steps to build trust in data science00:30:13 How did he got into Microsoft00:34:09 Level up in Genetech00:36:09 ML engineer vs Product DS00:37:43 Core skills in product DS00:40:20 Hiring00:42:47 How to deal with burnout00:45:03 Should you over work to earn trust?00:45:44 Daliana's story about first day at Amazon00:49:54 Will AI replace data scientists?00:51:32)Data scientist's role of GenAI00:54:32 How to keep up with GenAI
Double your salary as a data analyst - Jess Ramos - The Data Scientist Show #076 The Data Scientist Show 2024-01-05 | Jess Ramos is a Senior Data Analyst at Crunchbase, a LinkedIn Learning Instructor, and a content creator in the data space. She has a bachelor's degree in Math, Spanish, and Business from Berry University and a master's in Business Analytics from University of Georgia. Today we’ll talk about SQL in the real world, data analyst vs data scientist, is job hopping bad, how she negotiated her salary. Subscribe to Daliana's newsletter on www.dalianaliu.com for more on data science and career.Jess’ Linkedin: linkedin.com/in/jessramosmsbaPreparing to Get a Job in Data Analytics: shorturl.at/sCNPTSolve Real-World Data Problems with SQL: bit.ly/3Zq6wndBig Data Energy Newsletter: bit.ly/46x4rIRDaliana's Twitter: twitter.com/DalianaLiuDaliana’s LinkedIn: linkedin.com/in/dalianaliu00:00:00 Introduction00:01:24 Why Jess left her job at Freddie Mac00:03:25 Is job hopping bad00:04:42 How to explain short job stints when interviewing00:06:49 Jess's day-to-day work and tech stack00:09:15 SQL in the real world00:12:10 How to talk data to stakeholders00:18:33 How Jess prepares for SQL interviews00:28:11 Data analysts vs data scientists00:32:11 Choosing a career path00:47:19 How to ask recruiter questions00:50:15 Jess's LinkedIn content creation journey00:59:03 The future of Jess's career01:03:42 Jess's favorite books
Is a PhD worth it? - Jason Yosinski - The Data Scientist Show #070 The Data Scientist Show 2023-12-20 | Full interview: youtu.be/9k-nW8ce9yUJason Yosinski was a founding member of Uber AI Labs. He is also a co-founder of WinscapeAI a company dedicated to using custom sensor networks and machine learning to increase the efficiency and sustainability of wind farms. Jason holds a PhD in computer science from Cornell University. We talked about his experience at Uber AI, his research in deep learning, and ML for wind farms. Subscribe to Daliana's newsletter on www.dalianaliu.com for more on data science and career. Jason’s Website: yosinski.comJason’s LinkedIn: linkedin.com/in/jasonyosinskiDaliana's Twitter: twitter.com/DalianaLiuDaliana's LinkedIn: linkedin.com/in/dalianaliu
Report to CPO - Che Sharma - The Data Scientist Show #071 The Data Scientist Show 2023-12-18 | Full interview: youtu.be/_B_aV4RX234?si=OQmyDwAzQpZp5EMZChe Sharma came back to discuss toxic behaviors in experimentation culture and provide actionable advice on how to handle those situations, how to have rigor and integrity when designing and analyzing A/B tests.Che was the 4th data scientist at Airbnb, later he joined Webflow as an early employee. In 2021 he founded Eppo, a next-gen A/B experimentation platform designed for modern data and product teams to run more trustworthy and advanced experiments. We talked about A/B testing best practices, A/B testing for ML models, and Che’s career journey. Subscribe to Daliana's newsletter on www.dalianaliu.com for more on data science and career. Che's LinkedIn: linkedin.com/in/chetanvsharmaDaliana's Twitter: twitter.com/DalianaLiuDaliana's LinkedIn: linkedin.com/in/dalianaliu
How he got into machine learning and GenAI at Amazon - Mehdi Noori - The Data Scientist Show #075 The Data Scientist Show 2023-12-18 | Mehdi Noori is an applied science manager at the Generative AI Innovation Center at Amazon. I used to work with Mehdi while we were at the Machine Learning Solutions Lab at AWS. So before Amazon, Maddie was a data scientist working on marketing intelligence. Mehdi has a PhD from University of Central Florida in civil engineering and sustainability. Subscribe to Daliana's newsletter on www.dalianaliu.com for more on data science and career.Daliana's Twitter: twitter.com/DalianaLiuDaliana’s LinkedIn: linkedin.com/in/dalianaliuMehdi Noori: linkedin.com/in/mehdi-nooriPredicting Soccer Goals: aws.amazon.com/blogs/machine-learning/predicting-soccer-goals-in-near-real-time-using-computer-vision
Academia vs Industry for machine learning - Jason Yosinski - The Data Scientist Show #070 The Data Scientist Show 2023-12-15 | Full interview: youtu.be/9k-nW8ce9yUJason Yosinski was a founding member of Uber AI Labs. He is also a co-founder of WinscapeAI a company dedicated to using custom sensor networks and machine learning to increase the efficiency and sustainability of wind farms. Jason holds a PhD in computer science from Cornell University. We talked about his experience at Uber AI, his research in deep learning, and ML for wind farms. Subscribe to Daliana's newsletter on www.dalianaliu.com for more on data science and career. Jason’s Website: yosinski.comJason’s LinkedIn: linkedin.com/in/jasonyosinskiDaliana's Twitter: twitter.com/DalianaLiuDaliana's LinkedIn: linkedin.com/in/dalianaliu
ML in Cybersecurity - Betty Zhang - The Data Scientist Show #072 The Data Scientist Show 2023-12-13 | Full interview: youtu.be/a3c52u8nWEIBetty Zhang is a data scientist currently working at a cloud security company, previously she was a data scientist at Amazon Web Services. Today we’ll talk about her computer vision projects in Sports, data science use cases in cyber security, from business major to data scientist, what’s her experience working in startups vs big tech companies. Subscribe to Daliana's newsletter on www.dalianaliu.com for more on data science and career.Betty’s Linkedin: linkedin.com/in/betty-zhang-0bb63731Daliana's Twitter: twitter.com/DalianaLiuDaliana’s LinkedIn: linkedin.com/in/dalianaliu
How he got into Netflix - Jeff Li - The Data Scientist Show #069 The Data Scientist Show 2023-12-11 | Full interview: youtu.be/7g5wLdMGd1c?si=NHYpziHW02jDRlMuJeff Li is a senior data scientist at Netflix, focusing on Ads forecast. Previously he was a data science manager at Spotify, worked on supply forecasting, demand forecasting, and data infrastructure. He studied business at the University of Southern California. We talked about Ads forecasting, career path as a manager vs IC, culture in Spotify vs Netflix vs Doordash. Subscribe to Daliana's newsletter on www.dalianaliu.com for more on data science and career. Jeff Li’s LinkedIn: linkedin.com/in/lijeffrey Daliana's Twitter: twitter.com/DalianaLiuDaliana's LinkedIn: linkedin.com/in/dalianaliu
Science vs Engineering - Jason Yosinski - The Data Scientist Show #070 The Data Scientist Show 2023-12-08 | Full interview: youtu.be/9k-nW8ce9yUJason Yosinski was a founding member of Uber AI Labs. He is also a co-founder of WinscapeAI a company dedicated to using custom sensor networks and machine learning to increase the efficiency and sustainability of wind farms. Jason holds a PhD in computer science from Cornell University. We talked about his experience at Uber AI, his research in deep learning, and ML for wind farms. Subscribe to Daliana's newsletter on www.dalianaliu.com for more on data science and career. Jason’s Website: yosinski.comJason’s LinkedIn: linkedin.com/in/jasonyosinskiDaliana's Twitter: twitter.com/DalianaLiuDaliana's LinkedIn: linkedin.com/in/dalianaliu
Should You Use A/B Testing? - Che Sharma - The Data Scientist Show #071 The Data Scientist Show 2023-12-06 | Full interview: youtu.be/_B_aV4RX234?si=OQmyDwAzQpZp5EMZChe Sharma came back to discuss toxic behaviors in experimentation culture and provide actionable advice on how to handle those situations, how to have rigor and integrity when designing and analyzing A/B tests.Che was the 4th data scientist at Airbnb, later he joined Webflow as an early employee. In 2021 he founded Eppo, a next-gen A/B experimentation platform designed for modern data and product teams to run more trustworthy and advanced experiments. We talked about A/B testing best practices, A/B testing for ML models, and Che’s career journey. Subscribe to Daliana's newsletter on www.dalianaliu.com for more on data science and career. Che's LinkedIn: linkedin.com/in/chetanvsharmaDaliana's Twitter: twitter.com/DalianaLiuDaliana's LinkedIn: linkedin.com/in/dalianaliu
Startups vs Big Tech for Data Scientist - Betty Zhang - The Data Scientist Show #072 The Data Scientist Show 2023-12-04 | Full interview: youtu.be/a3c52u8nWEIBetty Zhang is a data scientist currently working at a cloud security company, previously she was a data scientist at Amazon Web Services. Today we’ll talk about her computer vision projects in Sports, data science use cases in cyber security, from business major to data scientist, what’s her experience working in startups vs big tech companies. Subscribe to Daliana's newsletter on www.dalianaliu.com for more on data science and career.Betty’s Linkedin: linkedin.com/in/betty-zhang-0bb63731Daliana's Twitter: twitter.com/DalianaLiuDaliana’s LinkedIn: linkedin.com/in/dalianaliu
I had all the money I wanted - Misty Arnold - The Data Scientist Show #074 The Data Scientist Show 2023-12-02 | Full interview: youtu.be/Sm0OvyHI_Z8My friend Misty moved to a farm in Portugal after her 20 years of career in finance. We talked about her experience moving from the busy corporate life to the farm life where she does a lot of manual work. Was it challenging, how does her finance work, and what is her advice to other people who also want to explore a different path outside of the modern city life. I hope this episode will give you a different perspective about your career. Subscribe to Daliana's newsletter on www.dalianaliu.com for more on data science and career.Daliana's Twitter: twitter.com/DalianaLiuDaliana’s LinkedIn: linkedin.com/in/dalianaliu
Is Product Data Science Boring? - Pan Wu - The Data Scientist Show #073 The Data Scientist Show 2023-12-01 | Full interview: youtu.be/_oxRgkDDlQsPan Wu is a senior manager of data science at Meta. After finishing his PhD from Duke University, he started his career in machine learning engineering and applied science, later he focused more on product data science. Before Meta, he worked in TrueCar, Uber, and LinkedIn. Pan has a decade-long expertise in machine learning and data science. Today we’ll talk about why he moved from machine learning to product data science, projects he worked on at Uber, Linkedin, and Meta, and how he compares the culture among those companies and how he transitioned from IC to manager. If you like the show, subscribe to the channel, give me a five-star review and leave a comment. Subscribe to Daliana's newsletter on www.dalianaliu.com for more on data science and career.Pan’s LinkedIn: linkedin.com/in/panwu/Daliana's Twitter: twitter.com/DalianaLiuDaliana’s LinkedIn: linkedin.com/in/dalianaliu
From finance director to farmer at Portugal - Misty Arnold - The Data Scientist Show #074 The Data Scientist Show 2023-12-01 | My friend Misty moved to a farm in Portugal after her 20 years of career in finance. We talked about her experience moving from the busy corporate life to the farm life where she does a lot of manual work. Was it challenging, how does her finance work, and what is her advice to other people who also want to explore a different path outside of the modern city life. I hope this episode will give you a different perspective about your career. Subscribe to Daliana's newsletter on www.dalianaliu.com for more on data science and career.Daliana's Twitter: twitter.com/DalianaLiuDaliana’s LinkedIn: linkedin.com/in/dalianaliu00:00:00 Introduction00:11:41 Life on the farm00:15:46 Her finance plans00:22:55 Her career journey00:27:14 What do accountants do00:32:29 I thought I would be happy00:41:25 Daliana's personal view about finance; when it's enough for you00:44:41 Does she feel lonely on a farm?00:48:39 What if she didn't leave the corporate world?00:54:07 Does she regret her decision
Product Data Science vs Machine Learning - Pan Wu - The Data Scientist Show #073 The Data Scientist Show 2023-11-29 | Pan Wu is a senior manager of data science at Meta. After finishing his PhD from Duke University, he started his career in machine learning engineering and applied science, later he focused more on product data science. Before Meta, he worked in TrueCar, Uber, and LinkedIn. Pan has a decade-long expertise in machine learning and data science. Today we’ll talk about why he moved from machine learning to product data science, projects he worked on at Uber, Linkedin, and Meta, and how he compares the culture among those companies and how he transitioned from IC to manager. If you like the show, subscribe to the channel, give me a five-star review and leave a comment. Subscribe to Daliana's newsletter on www.dalianaliu.com for more on data science and career.Pan’s LinkedIn: linkedin.com/in/panwu/Daliana's Twitter: twitter.com/DalianaLiuDaliana’s LinkedIn: linkedin.com/in/dalianaliu00:00:00 Introduction00:01:30 Why he transitioned from MLE to product DS00:07:38 Meta data scientists skill sets00:15:49 When did his interest shifted from MLE to product DS00:18:04 Is MLE more respected?00:25:46 A/B testing deep dives in 3 steps00:28:21 Built a tool at Linkedin00:35:52 How to sell your project00:41:07 Junior vs senior data scientist00:43:24 From staff data scientist to manager00:45:18 Explore being a manager00:46:24 Cultures in Uber, Linkedin, TrueCar00:52:09 Data science over the past 10 year00:55:06 MLE vs DS fun and frustration00:57:26 Product DS reality00:59:10 Learning new skills01:01:39 Mistakes he made01:06:34 Future of data science01:08:04 Will data scientists be replaced by AI01:09:42 Three skills he looks for when hiring
Machine Learning in school vs in reality - Jason Yosinski - The Data Scientist Show #070 The Data Scientist Show 2023-11-20 | Full interview: youtube.com/watch?v=9k-nW8ce9yUJason Yosinski was a founding member of Uber AI Labs. He is also a co-founder of WinscapeAI a company dedicated to using custom sensor networks and machine learning to increase the efficiency and sustainability of wind farms. Jason holds a PhD in computer science from Cornell University. We talked about his experience at Uber AI, his research in deep learning, and ML for wind farms. Subscribe to Daliana's newsletter on www.dalianaliu.com for more on data science and career. Jason’s Website: yosinski.comJason’s LinkedIn: linkedin.com/in/jasonyosinskiDaliana's Twitter: twitter.com/DalianaLiuDaliana's LinkedIn: linkedin.com/in/dalianaliu
Machine Learning in Cybersecurity - Betty Zhang - The Data Scientist Show #072 The Data Scientist Show 2023-11-12 | Betty Zhang is a data scientist currently working at a cloud security company, previously she was a data scientist at Amazon Web Services. Today we’ll talk about her computer vision projects in Sports, data science use cases in cyber security, from business major to data scientist, what’s her experience working in startups vs big tech companies. Subscribe to Daliana's newsletter on www.dalianaliu.com for more on data science and career.Betty’s Linkedin: linkedin.com/in/betty-zhang-0bb63731Daliana's Twitter: twitter.com/DalianaLiuDaliana’s LinkedIn: linkedin.com/in/dalianaliu00:00:00 Introduction00:01:21 Computer Vision Project in Sports at AWS00:12:28 Challenges in computer vision00:14:02 Time allocation for ML projects00:15:22 3 key skills for computer vision00:17:20 From business analyst to ML engineer00:18:14 How she got her data scientist job through Linkedin00:21:32 How she got into Amazon00:22:17 Three tech skills needed during Amazon interviews00:26:11 Why she joined a Cyber Security startup00:27:22 Three cybersecurity use cases00:29:47 Anomaly detection00:30:40 ML for cybersecurity00:34:43 Tech stacks Amazon vs Startups00:39:35 Startups vs big tech00:45:56 Balance learning and impact00:48:35 Advice for new data scientists
Stop abusing A/B testing, toxic experimentation culture - Che Sharma - The Data Scientist Show #071 The Data Scientist Show 2023-11-08 | Che Sharma came back to discuss toxic behaviors in experimentation culture and provide actionable advice on how to handle those situations, how to have rigor and integrity when designing and analyzing A/B tests.Che was the 4th data scientist at Airbnb, later he joined Webflow as an early employee. In 2021 he founded Eppo, a next-gen A/B experimentation platform designed for modern data and product teams to run more trustworthy and advanced experiments. We talked about A/B testing best practices, A/B testing for ML models, and Che’s career journey. Subscribe to Daliana's newsletter on www.dalianaliu.com for more on data science and career. Che's LinkedIn: linkedin.com/in/chetanvsharmaDaliana's Twitter: twitter.com/DalianaLiuDaliana's LinkedIn: linkedin.com/in/dalianaliu
Academia vs. Industry for Machine Learning - Jason Yosinski - The Data Scientist Show #070 The Data Scientist Show 2023-10-23 | Jason Yosinski was a founding member of Uber AI Labs. He is also a co-founder of WinscapeAI a company dedicated to using custom sensor networks and machine learning to increase the efficiency and sustainability of wind farms. Jason holds a PhD in computer science from Cornell University. We talked about his experience at Uber AI, his research in deep learning, and ML for wind farms. Subscribe to Daliana's newsletter on www.dalianaliu.com for more on data science and career. Jason’s Website: yosinski.comJason’s LinkedIn: linkedin.com/in/jasonyosinskiDaliana's Twitter: twitter.com/DalianaLiuDaliana's LinkedIn: linkedin.com/in/dalianaliu00:00:00 Introduction00:06:06 His advice for Uber ML teams00:16:03 From research to industry00:20:24 ML for wind farms00:25:40 Metrics for wind energy prediction00:29:23 Start with a small dataset00:32:00 ML in academia vs. the industry00:33:24 Do you need a PhD for ML?00:38:14 Daliana's story about grad school00:41:37 The value of a PhD00:43:13 ML Collective00:48:36 Technical communication00:57:21 ML Skillsets00:59:45 Future of machine learning01:05:23 Personal development: Hoffman process01:15:13 Do things that excites you
Ads forecasting at Netflix and Spotify - Jeff Li - The Data Scientist Show #069 The Data Scientist Show 2023-10-20 | Jeff Li is a senior data scientist at Netflix, focusing on Ads forecast. Previously he was a data science manager at Spotify, worked on supply forecasting, demand forecasting, and data infrastructure. He studied business at the University of Southern California. We talked about Ads forecasting, career path as a manager vs IC, culture in Spotify vs Netflix vs Doordash. Subscribe to Daliana's newsletter on www.dalianaliu.com for more on data science and career. Jeff Li’s LinkedIn: linkedin.com/in/lijeffrey Daliana's Twitter: twitter.com/DalianaLiuDaliana's LinkedIn: linkedin.com/in/dalianaliu00:00:00 Introduction00:00:45 Got into data science from poker and consulting00:07:54 Ads forecasting at Netflix and Spotify00:13:30 From IC to manager to IC00:14:53 how to measure forecasting models00:21:58 collaborating with stakeholders in sales00:29:44 how he became an expert in ads forecasting00:49:57 impact sizing at Doordash00:57:34 Company culture differences (DoorDash, Spotify, Netflix)01:12:47 how he wants to grow his career
How to handle outliers in A/B Testing - Che Sharma - The Data Scientist Show #068 The Data Scientist Show 2023-09-11 | Full interview: youtube.com/watch?v=erW_AvYRERoChe Sharma was the 4th data scientist at Airbnb, later he joined Webflow as an early employee. In 2021 he founded Eppo, a next-gen A/B experimentation platform designed for modern data and product teams to run more trustworthy and advanced experiments. We talked about A/B testing best practices, A/B testing for ML models, and Che’s career journey. Subscribe to Daliana's newsletter on www.dalianaliu.com for more on data science and career.Che’s LinkedIn: https://www.linkedin.com/in/chetanvsh...Try Eppo for A/B testing: geteppo.comDaliana's Twitter: twitter.com/DalianaLiu Daliana's LinkedIn: linkedin.com/in/dalianaliu
Ex-Meta Data Scientist to full time content creator -Tina Huang - The Data Scientist Show #067 The Data Scientist Show 2023-09-08 | Full interview: youtu.be/2nCo17jM94M?si=zlqDapN1-iZK_9kMWe talked about self-learning, productivity, how Tina navigates her career change and how she thinks AI could change the future of work.Tina's YouTube: youtube.com/@TinaHuang1 Lonely Octopus: www.lonelyoctopus.comSubscribe to Daliana's newsletter on www.dalianaliu.com for more on data science and career.Tina Huang is a data scientist turned YouTube creator with 500k subscribers. She is the founder of Lonely Octopus, an online program helping people gain data science, AI, and freelancing skills. She originally studied pharmacology before transitioning into tech, completing a master's degree in computer science at UPenn.
A/B testing at Airbnb - Che Sharma - The Data Scientist Show #068 The Data Scientist Show 2023-08-25 | Che Sharma was the 4th data scientist at Airbnb, later he joined Webflow as an early employee. In 2021 he founded Eppo, a next-gen A/B experimentation platform designed for modern data and product teams to run more trustworthy and advanced experiments. We talked about A/B testing best practices, A/B testing for ML models, and Che’s career journey. Subscribe to Daliana's newsletter on www.dalianaliu.com for more on data science and career.Che’s LinkedIn: linkedin.com/in/chetanvsharmaTry Eppo for A/B testing: geteppo.comDaliana's Twitter: twitter.com/DalianaLiu Daliana's LinkedIn: linkedin.com/in/dalianaliu00:00:00 Introduction00:01:26 Getting started in data science at Airbnb00:03:08 Keys to successful A/B testing00:06:53 Interpreting and communicating A/B test results00:15:00 A/B testing best practices testing machine learning models00:41:39 Centralizing experiment analysis00:53:46 Preparing data scientists for the future00:59:33 Developing communication skills as a data scientist01:08:43 Transitioning from individual contributor to manager01:12:28 The future of experimentation
3 challenges for LLMs in production - Vikram Chatterji -TheDataScientistShow #066 The Data Scientist Show 2023-08-21 | Full interview: youtu.be/elrpDJWOfm8Vikram is the co-founder of Galileo – an AI diagnostics and explainability platform used by data science teams building NLP, LLMs and Computer Vision models across the Fortune 500 and high growth startups. Prior to Galileo, Vikram led Product Management at Google AI, where his team built models for the Fortune 2000 across retail, financial services, healthcare and contact centers. He has a master degree from Carnegie Mellon University from the school of computer science. If you enjoy the show, subscribe to the channel and leave a 5-star review. Subscribe to Daliana's newsletter on www.dalianaliu.com for more on data science and career.Vikram Chatterji’s LinkedIn: https://www.linkedin.com/in/vikram-ch..."The Mom Test": https://www.amazon.com/The-Mom-Test-R...Daliana's Twitter: twitter.com/DalianaLiu Daliana's LinkedIn: linkedin.com/in/dalianaliu
Solving real problems with mixed martial arts - Max Pumperla - The Data Scientist Show #065 The Data Scientist Show 2023-08-18 | Full interview: youtu.be/3951WpStCQgMax Pumperla designed his own career path in data science. He is a freelance software engineer at AnyScale, and also a data science professor. We talked about reinforcement learning, open source contributions, Ray for data scientists, and his view on the data scientists role. If you enjoy the show, subscribe to the channel and leave a 5-star review. Subscribe to Daliana's newsletter on www.dalianaliu.com for more on data science and career.Max’s LinkedIn: https://www.linkedin.com/in/max-pumpe...Max's GitHub: github.com/maxpumperlaDaliana's Twitter: twitter.com/DalianaLiuDaliana's LinkedIn: linkedin.com/in/dalianaliu
From data scientist@Meta to full-time YouTuber (500k+ sub)-Tina Huang - The Data Scientist Show #067 The Data Scientist Show 2023-08-17 | We talked about self-learning, productivity, how Tina navigates her career change and how she thinks AI could change the future of work.Tina's YouTube: www.youtube.com/@TinaHuang1Lonely Octopus: www.lonelyoctopus.comSubscribe to Daliana's newsletter on www.dalianaliu.com for more on data science and career.Tina Huang is a data scientist turned YouTube creator with 500k subscribers. She is the founder of Lonely Octopus, an online program helping people gain data science, AI, and freelancing skills. She originally studied pharmacology before transitioning into tech, completing a master's degree in computer science at UPenn. 00:02:38 Transitioning from Data Science to Content Creation 00:06:29 Preparing for Data Science Interviews00:10:59 Starting a YouTube Channel 00:14:18 Building Multiple Income Streams 00:17:35 Getting Started with AI Skills 00:29:29 Advice for Starting YouTube 00:34:47 Improving Storytelling Skills 00:36:58 Overcoming Procrastination 00:42:33 The Future of Work 01:47:08 Looking to the Future 01:26:49 Income Breakdown
Large language models in enterprises - Vikram Chatterji - TheDataScientistShow #066 The Data Scientist Show 2023-08-16 | Full interview: youtu.be/elrpDJWOfm8Vikram is the co-founder of Galileo – an AI diagnostics and explainability platform used by data science teams building NLP, LLMs and Computer Vision models across the Fortune 500 and high growth startups. Prior to Galileo, Vikram led Product Management at Google AI, where his team built models for the Fortune 2000 across retail, financial services, healthcare and contact centers. He has a master degree from Carnegie Mellon University from the school of computer science. If you enjoy the show, subscribe to the channel and leave a 5-star review. Subscribe to Daliana's newsletter on www.dalianaliu.com for more on data science and career.Vikram Chatterji’s LinkedIn: https://www.linkedin.com/in/vikram-ch..."The Mom Test": https://www.amazon.com/The-Mom-Test-R...Daliana's Twitter: twitter.com/DalianaLiu Daliana's LinkedIn: linkedin.com/in/dalianaliu
The art of reinforcement learning - Max Pumperla - The Data Scientist Show #065 The Data Scientist Show 2023-08-07 | Full interview: youtu.be/3951WpStCQgMax Pumperla designed his own career path in data science. He is a freelance software engineer at AnyScale, and also a data science professor. We talked about reinforcement learning, open source contributions, Ray for data scientists, and his view on the data scientists role. If you enjoy the show, subscribe to the channel and leave a 5-star review. Subscribe to Daliana's newsletter on www.dalianaliu.com for more on data science and career.Max’s LinkedIn: https://www.linkedin.com/in/max-pumpe...Max's GitHub: github.com/maxpumperlaDaliana's Twitter: twitter.com/DalianaLiuDaliana's LinkedIn: linkedin.com/in/dalianaliu
Data Science Mix Martial Arts,applied re-inforcement learning-MaxPumperla-TheDataScientistShow#065 The Data Scientist Show 2023-07-28 | Max Pumperla designed his own career path in data science. He is a freelance software engineer at AnyScale, and also a data science professor. We talked about reinforcement learning, open source contributions, Ray for data scientists, and his view on the data scientists role. If you enjoy the show, subscribe to the channel and leave a 5-star review. Subscribe to Daliana's newsletter on www.dalianaliu.com for more on data science and career.Max’s LinkedIn: linkedin.com/in/max-pumperla-a8099354Max's GitHub: github.com/maxpumperlaDaliana's Twitter: twitter.com/DalianaLiuDaliana's LinkedIn: linkedin.com/in/dalianaliu00:00:00 Introduction00:09:19 How he got a remote job through Twitter00:14:06 Introduction to Ray00:18:52 Reinforcement learning00:23:56 Key lessons on integrating customer feedback00:35:12 Flaws in data science job titles00:45:51 How to be irreplaceable as a data scientist00:48:55 An unconventional career path as a data scientist01:12:24 Productivity and work-life balance01:28:10 Advice for building a personal brand
