Uploaded December 2023 | Updated September 2026, 3 weeks ago

---

Mathematica Essentials - the first PRO COURSE from Socratica
Buy here: socratica.com/courses/mathematica-essentials
Learn along with free Mathematica notebooks available on github:
github.com/socratica/wolfram

𝙒𝘼𝙉𝙏 𝙈𝙊𝙍𝙀? snu.socratica.com/mathematica
To be notified about updates to our first Pro Course "Mathematica Essentials,", join our mailing list at: snu.socratica.com/mathematica

Natural Language Processing (NLP) is a specialized field within machine learning, focused on interpreting and processing HUMAN language, or "natural" language. This is crucial, as only a fraction of the population knows a computer language.

In this video, we explore the basics of text preprocessing, using Mathematica to demonstrate some of the techniques including tokenization (creating a list of words without punctuation), normalization (putting data into standard form, for instance, no capital letters), removing stop words, stemming and/or lemmatization (replacing similar words with a common stem or a representative word).

BTW—Socratica offers a pro course, 'Mathematica Essentials,' providing key concepts for mastering Wolfram products:
socratica.com/courses/mathematica-essentials

You can jump to sections of the video here:
0:00 What is Natural Language Processing (NLP)
0:58 What is Preprocessing?
1:36 Intro to Text Preprocessing
2:22 Sample Text before Preprocessing
3:00 Tokenization (List of words)
3:55 Case normalization (standard form, no capitals)
4:33 Removing Stop words (little information)
5:42 Stemming & Lemmatization

Thank you to our VIP Patreon Members who helped make this video possible!
KW, M Andrews, Jim Woodworth, Massimiliano Pala, Marcos Silveira, Christopher Kemsley, Eric Eccleston, Jeremy Shimanek, Michael Shebanow, Alvin Khaled, Kevin B, John Krawiec, Umar Khan, and Tracy Karin Prell — we are so happy to have you on our team!
— Thank you kind friends! 💜🦉

✷✷✷
We recommend the following (affiliate links):
The Wolfram Language
amzn.to/3D4jqvz

The Mythical Man Month - Essays on Software Engineering & Project Management
amzn.to/2tYdNeP

Innumeracy: Mathematical Illiteracy and Its Consequences
amzn.to/2ri1nf7

Mindset by Carol Dweck
amzn.to/2q9y8Nj

How to Be a Great Student (our first book!)
ebook: amzn.to/2Lh3XSP
Paperback: amzn.to/3t5jeH3
Kindle Unlimited: amzn.to/3atr8TJ

✷✷✷
If you find our work at Socratica valuable, please consider becoming our Patron on Patreon!
patreon.com/socratica

If you would prefer to make a one-time donation, you can also use
Socratica Paypal
paypal.me/socratica

✷✷✷
Written & Produced by Michael Harrison & Kimberly Hatch Harrison
Edited by Megi Shuke

About our Instructors:

Michael earned his BS in Math from Caltech, and did his graduate work in Math at UC Berkeley and University of Washington, specializing in Number Theory. A self-taught programmer, Michael taught both Math and Computer Programming at the college level. He applied this knowledge as a financial analyst (quant) and as a programmer at Google.

Kimberly earned her BS in Biology and another BS in English at Caltech. She did her graduate work in Molecular Biology at Princeton, specializing in Immunology and Neurobiology. Kimberly spent 16+ years as a research scientist and a dozen years as a biology and chemistry instructor.

Michael and Kimberly Harrison co-founded Socratica.
Their mission? To create the education of the future.

✷✷✷
Welcome to Socratica! We make SMART videos focusing on STEM - science, math, programming. Subscribe here: bit.ly/SocraticaSubscribe

PLAYLISTS
Study Tips bit.ly/StudyTipsPlaylist
Python programming bit.ly/PythonSocratica
SQL programming bit.ly/SQL_Socratica
Chemistry bit.ly/Chemistry_Playlist
Abstract Algebra bit.ly/AbstractAlgebra
Astronomy bit.ly/AstronomySocratica
Biology bit.ly/BiologySocratica
Calculus bit.ly/CalculusSocratica
Geometry bit.ly/GeometrySocratica
Mathematica bit.ly/SocraticaMathematica

#MachineLearning #TextPreprocessing #Mathematica