Welch Labs
Neural Networks Demystified [Part 4: Backpropagation]
updated
amazon.com/shop/welchlabs
Opening scenes from Oppenheimer: oppenheimermovie.com
References
The Trinity High-Explosive Implosion System: The Foundation for Precision Explosive Applications: tandfonline.com/doi/full/10.1080/00295450.2021.1913954
Critical Assembly: A Technical History of Los Alamos during the Oppenheimer Years, 1943–1945.
Welch Labs
patreon.com/welchlabs
tiktok.com/@welchlabs
welchlabs.com
Errata
Thank to Ferenci Tamás for catching an error - the image shown at 5:00 is not of the lensed implosion bomb but a later 72-block Y-1222 design.
Los Alamos Report 602: sgp.fas.org/othergov/doe/lanl/docs1/00329010.pdf
The bomb - the end of the world? http://large.stanford.edu/courses/2015/ph241/chung1/docs/buck.pdf
Ultimate Catastrophe? tandfonline.com/doi/abs/10.1080/00963402.1976.11455623?journalCode=rbul20
Welch Labs
patreon.com/welchlabs
tiktok.com/@welchlabs
welchlabs.com
Plutonium has been discovered in trace amounts in nature under highly unusual geologic circumstances: epa.gov/radiation/radionuclide-basics-plutonium#plutoniumsources
LINKS
Oppenheimer reading list: amazon.com/shop/welchlabs
Patreon: patreon.com/welchlabs
TikTok: tiktok.com/@welchlabs
Other Stuff: welchlabs.com
LINKS
patreon.com/welchlabs
tiktok.com/@welchlabs
welchlabs.com
LINKS
patreon.com/welchlabs
tiktok.com/@welchlabs
welchlabs.com
TikTok: tiktok.com/@welchlabs
Patreon: patreon.com/welchlabs
TWITTER: @welchlabs
MORE: http://www.welchlabs.com
CODE: github.com/stephencwelch/self_driving_cars
NO HANDS ACROSS AMERICA
https://www.cs.cmu.edu/~tjochem/nhaa/nhaa_home_page.html
RALPH
ieeexplore.ieee.org/document/528333
https://www.ri.cmu.edu/pub_files/pub2/pomerleau_dean_1995_2/pomerleau_dean_1995_2.pdf
patents.google.com/patent/US5675489A/en?inventor=dean+pomerleau&oq=dean+pomerleau
DRIVING VIDEOS
KITTI Dataset: http://www.cvlibs.net/datasets/kitti/index.php
Berkeley Dataset: https://bair.berkeley.edu/blog/2018/05/30/bdd/
VIDEO REFERENCES
youtube.com/watch?v=WZorfXa5pBc
youtube.com/watch?v=bdQ5rsVgPuk
youtube.com/watch?v=QFpBtOG87ak
youtube.com/watch?v=5-acCtyKf7E
youtube.com/watch?v=ntIczNQKfjQ
youtube.com/watch?v=B8R148hFxPw
youtube.com/watch?v=wTDG5gjwPGo
youtube.com/watch?v=C9G6JRUmg_A
youtube.com/watch?v=rV0H7u6tmIk
youtube.com/watch?v=Dtj9J1A-PMk
MUSIC
premiumbeat.com/royalty-free-tracks/girl-power
premiumbeat.com/royalty-free-tracks/jazz-manouche-forever
premiumbeat.com/royalty-free-tracks/out-of-the-woods
premiumbeat.com/royalty-free-tracks/above-the-ocean
SPECIAL THANKS TO
Tony Fast
Krish Ravindranath
Karthik Naga
Dean Pomerleau
Chuck Thorpe
- AND -
Sid Sarasvati
Ross Hanson
Yana Chernobilsky
Vin Soma
Antoine Pintout
Jaewon Jung
Raphael J Vasquez
AJ Englehardt
Nate Fuller
Hitoshi Yamauchi
TWITTER: @welchlabs
MORE: http://www.welchlabs.com
CODE: github.com/stephencwelch/self_driving_cars
FURTHER READING + REFEERENCES
For a bayesian approach to the same reliability testing math: stats.stackexchange.com/questions/73645/how-do-you-derive-the-success-run-theorem-from-the-traditional-form-of-bayes-the
Rand Report: rand.org/pubs/research_reports/RR1478.html
Zeiler and Fungus 2013: arxiv.org/abs/1311.2901
WHO top 10 causes of death: https://www.who.int/news-room/fact-sheets/detail/the-top-10-causes-of-death
WHO injuries and violence facts: https://apps.who.int/iris/bitstream/handle/10665/44288/9789241599375_eng.pdf%3Bjsessionid=7558B4BDC59A52BB94AEC68A0AD79EE8?sequence=1
Bojarski et al: arxiv.org/abs/1704.07911
Dean Pomerleau: http://www.cs.cmu.edu/~bhamner/neuralNetworksProject/pomerleau_dean.pdf
Dean Pomerleau: https://www.ri.cmu.edu/pub_files/pub3/pomerleau_dean_1991_1/pomerleau_dean_1991_1.pdf
Dean Pomerleau: https://www.ri.cmu.edu/publications/life-in-the-fast-lane-the-evolution-of-an-adaptive-vehicle-control-system/
Nvidia End to End: arxiv.org/abs/1604.07316
Way ChauffeurNet: arxiv.org/abs/1812.03079
VIDEO REFERENCES
Amnon Shashua Talk: youtube.com/watch?v=GCMXXXmxG-I
NAVLAB: youtube.com/watch?v=rV0H7u6tmIk
MUSIC
premiumbeat.com/royalty-free-tracks/jazz-manouche-forever
premiumbeat.com/royalty-free-tracks/out-of-the-woods
premiumbeat.com/royalty-free-tracks/wanderer
SPECIAL THANKS TO
Tony Fast
Krish Ravindranath
Karthik Naga
Alex Mones
Michael Grabchak
- AND -
Sid Sarasvati
Ross Hanson
Vin Soma
Antoine Pintout
Jaewon Jung
Raphael J Vasquez
AJ Englehardt
Nate Fuller
Hitoshi Yamauchi
TWITTER: @welchlabs
MORE: http://www.welchlabs.com
CODE: github.com/stephencwelch/self_driving_cars
Welch Labs on backpropogation
youtube.com/watch?v=GlcnxUlrtek
Great 3B1B Video on backpropogation
youtube.com/watch?v=tIeHLnjs5U8
FURTHER READING
Backpropagation: nature.com/articles/323533a0
ALVINN: http://www.cs.cmu.edu/afs/cs/Web/People/bhamner/neuralNetworksProject/pomerleau_dean.pdf
ALVINN: pdfs.semanticscholar.org/df76/59b147d04186a4885cdbe10fcf60e2ffca4e.pdf
ALVINN: http://papers.nips.cc/paper/95-alvinn-an-autonomous-land-vehicle-in-a-neural-network.pdf
VIDEO REFERENCES
Nvidia End-to-End: youtube.com/watch?v=qhUvQiKec2U
Amnon Shashua: youtube.com/watch?v=GCMXXXmxG-I
Chris Urmso: youtube.com/watch?v=BtgBySRrN0Q
Navlab: youtube.com/watch?v=QFpBtOG87ak
More Navlab: youtube.com/watch?v=ntIczNQKfjQ
More more Navlab:youtube.com/watch?v=QFpBtOG87ak
More more more navlab: youtube.com/watch?v=rV0H7u6tmIk
You guess it, more navlab: youtube.com/watch?v=5-acCtyKf7E
Navlab on the news: youtube.com/watch?v=IaoIqVMd6tc
MUSIC
premiumbeat.com/royalty-free-tracks/vultures
premiumbeat.com/royalty-free-tracks/wanderer
premiumbeat.com/royalty-free-tracks/girl-power
premiumbeat.com/royalty-free-tracks/language-2
SPECIAL THANKS TO
Tony Fast
Krish Ravindranath
Karthik Naga
Dean Pomerleau
- And -
Sid Sarasvati
Ross Hanson
Yana Chernobilsky
Vin Soma
Antoine Pintout
Jaewon Jung
Raphael J Vasquez
AJ Englehardt
Nate Fuller
TWITTER: @welchlabs
MORE: http://www.welchlabs.com
CODE: github.com/stephencwelch/self_driving_cars
FURTHER READING
Original ALV Paper: http://www.cs.ucsb.edu/~mturk/Papers/ALV.pdf
Great Book on SCI: amazon.com/Strategic-Computing-Machine-Intelligence-1983-1993/dp/0262529262/ref=sr_1_1?ie=UTF8&qid=1547071120&sr=8-1&keywords=strategic+computing
Great book on the history of AI: amazon.com/Ai-Daniel-Crevier/dp/0465001041/ref=sr_1_1?ie=UTF8&qid=1547071150&sr=8-1&keywords=ai+the+tumultuous+history+of+the+search+for+artificial+intelligence
VIDEO REFERENCES
Elon Musk at TED: youtube.com/watch?v=NcqI76Z4t1A
Cadillac Super Cruise: youtube.com/watch?v=_rxW68ADldI
Tesla Perception: youtube.com/watch?v=VG68SKoG7vE
Waymo Perception: youtube.com/watch?v=B8R148hFxPw
Chris Urmson TED talk: youtube.com/watch?v=tiwVMrTLUWg
MUSIC
premiumbeat.com/royalty-free-tracks/girl-power
premiumbeat.com/royalty-free-tracks/out-of-the-woods
premiumbeat.com/royalty-free-tracks/language-2
SPECIAL THANKS TO
Tony Fast
Krish Ravindranath
Karthik Naga
Charles Young
Chang Lee
Mathew Turk
- And -
Vin Soma
Raphael J Vasquez
Nate Fuller
http://www.welchlabs.com/guides
support Welch Labs:
patreon.com/welchlabs
MIT Video:
http://news.mit.edu/2016/music-tastes-cultural-not-hardwired-brain-0713
support welch labs:
patreon.com/welchlabs
music:
premiumbeat.com/royalty-free-tracks/jazz-manouche-forever
premiumbeat.com/royalty-free-tracks/out-of-the-wood
spremiumbeat.com/royalty-free-tracks/among-the-hills
Support Welch Labs: www.patreon.com/welchlabs
Music:
premiumbeat.com/royalty-free-tracks/jazz-manouche-forever
premiumbeat.com/royalty-free-tracks/out-of-the-woods
premiumbeat.com/royalty-free-tracks/truth-to-tell
Support Welch Labs: patreon.com/welchlabs
Music:
premiumbeat.com/royalty_free_music/songs/jazz-manouche-forever
premiumbeat.com/royalty_free_music/songs/razer-trap
support welch labs: patreon.com/welchlabs
music:
premiumbeat.com/royalty_free_music/songs/storytelling-piano
premiumbeat.com/royalty_free_music/songs/dark-eyes-gypsy-jazz
premiumbeat.com/royalty_free_music/songs/truth-to-tell
http://www.welchlabs.com/guides
music: premiumbeat.com/royalty_free_music/songs/storytelling-piano
patreon:
patreon.com/welchlabs
correction:
length table should be in cm, to mm!
YouTube channels referenced: MinutePhysics, Veritaseum, VSauce, Physics Girl, CGP Grey, Mathologer, 3Blue1Brown, and Numberphile.
A special thanks to Charles Young for all his fantastic help with the motion rig. Thanks to Joan and Alison Young for cutting out an absolutely amazing ransom note.
Music: premiumbeat.com/royalty_free_music/songs/yours-faithfully
premiumbeat.com/royalty_free_music/songs/it-s-always-funny-in-philadelphia
Supporting Code: github.com/stephencwelch/LearningToSee
welchlabs.com
@welchlabs
Supporting Code: github.com/stephencwelch/LearningToSee
welchlabs.com
@welchlabs
Supporting Code: github.com/stephencwelch/LearningToSee
welchlabs.com
@welchlabs
Supporting Code: github.com/stephencwelch/LearningToSee
welchlabs.com
@welchlabs
Supporting Code: github.com/stephencwelch/LearningToSee
welchlabs.com
@welchlabs
Supporting Code: github.com/stephencwelch/LearningToSee
welchlabs.com
@welchlabs
Supporting Code: github.com/stephencwelch/LearningToSee
welchlabs.com
@welchlabs
Supporting Code: github.com/stephencwelch/LearningToSee
welchlabs.com
@welchlabs
Supporting Code: github.com/stephencwelch/LearningToSee
welchlabs.com
@welchlabs
Supporting Code: github.com/stephencwelch/LearningToSee
welchlabs.com
@welchlabs
Supporting Code: github.com/stephencwelch/LearningToSee
welchlabs.com
@welchlabs
Supporting Code: github.com/stephencwelch/LearningToSee
welchlabs.com
@welchlabs
Supporting Code: github.com/stephencwelch/LearningToSee
welchlabs.com
@welchlabs
Code available soon.
welchlabs.com
@welchlabs
Supporting Code: github.com/stephencwelch/Imaginary-Numbers-Are-Real
Imaginary numbers are not some wild invention, they are the deep and natural result of extending our number system. Imaginary numbers are all about the discovery of numbers existing not in one dimension along the number line, but in full two dimensional space. Accepting this not only gives us more rich and complete mathematics, but also unlocks a ridiculous amount of very real, very tangible problems in science and engineering.
Part 1: Introduction
Part 2: A Little History
Part 3: Cardan's Problem
Part 4: Bombelli's Solution
Part 5: Numbers are Two Dimensional
Part 6: The Complex Plane
Part 7: Complex Multiplication
Part 8: Math Wizardry
Part 9: Closure
Part 10: Complex Functions
Part 11: Wandering in Four Dimensions
Part 12: Riemann's Solution
Part 13: Riemann Surfaces
Special thanks to the fantastic Charles Jackson Young for helping me get the motion rig done in time for this video. You Rock!
Want to learn more or teach this series? Check out the Imaginary Numbers are Real Workbook: http://www.welchlabs.com/resources.
Supporting Code: github.com/stephencwelch/Imaginary-Numbers-Are-Real
Imaginary numbers are not some wild invention, they are the deep and natural result of extending our number system. Imaginary numbers are all about the discovery of numbers existing not in one dimension along the number line, but in full two dimensional space. Accepting this not only gives us more rich and complete mathematics, but also unlocks a ridiculous amount of very real, very tangible problems in science and engineering.
Part 1: Introduction
Part 2: A Little History
Part 3: Cardan's Problem
Part 4: Bombelli's Solution
Part 5: Numbers are Two Dimensional
Part 6: The Complex Plane
Part 7: Complex Multiplication
Part 8: Math Wizardry
Part 9: Closure
Part 10: Complex Functions
Part 11: Wandering in Four Dimensions
Part 12: Riemann's Solution
Part 13: Riemann Surfaces
Want to learn more or teach this series? Check out the Imaginary Numbers are Real Workbook: http://www.welchlabs.com/resources.
Supporting Code: github.com/stephencwelch/Imaginary-Numbers-Are-Real
Imaginary numbers are not some wild invention, they are the deep and natural result of extending our number system. Imaginary numbers are all about the discovery of numbers existing not in one dimension along the number line, but in full two dimensional space. Accepting this not only gives us more rich and complete mathematics, but also unlocks a ridiculous amount of very real, very tangible problems in science and engineering.
Part 1: Introduction
Part 2: A Little History
Part 3: Cardan's Problem
Part 4: Bombelli's Solution
Part 5: Numbers are Two Dimensional
Part 6: The Complex Plane
Part 7: Complex Multiplication
Part 8: Math Wizardry
Part 9: Closure
Part 10: Complex Functions
Part 11: Wandering in Four Dimensions
Part 12: Riemann's Solution
Part 13: Riemann Surfaces
Want to learn more or teach this series? Check out the Imaginary Numbers are Real Workbook: http://www.welchlabs.com/resources.
More information and resources: http://www.welchlabs.com
Imaginary numbers are not some wild invention, they are the deep and natural result of extending our number system. Imaginary numbers are all about the discovery of numbers existing not in one dimension along the number line, but in full two dimensional space. Accepting this not only gives us more rich and complete mathematics, but also unlocks a ridiculous amount of very real, very tangible problems in science and engineering.
Part 1: Introduction
Part 2: A Little History
Part 3: Cardan's Problem
Part 4: Bombelli's Solution
Part 5: Numbers are Two Dimensional
Part 6: The Complex Plane
Part 7: Complex Multiplication
Part 8: Math Wizardry
Part 9: Closure
Part 10: Complex Functions
Part 11: Wandering in Four Dimensions
Part 12: Riemann's Solution
Part 13: Riemann Surfaces
Want to learn more or teach this series? Check out the Imaginary Numbers are Real Workbook: http://www.welchlabs.com/resources.
Become a Patron for exclusive perks: patreon.com/welchlabs
Supporting Code: github.com/stephencwelch/LearningToSee
welchlabs.com
@welchlabs
Imaginary numbers are not some wild invention, they are the deep and natural result of extending our number system. Imaginary numbers are all about the discovery of numbers existing not in one dimension along the number line, but in full two dimensional space. Accepting this not only gives us more rich and complete mathematics, but also unlocks a ridiculous amount of very real, very tangible problems in science and engineering.
Part 1: Introduction
Part 2: A Little History
Part 3: Cardan's Problem
Part 4: Bombelli's Solution
Part 5: Numbers are Two Dimensional
Part 6: The Complex Plane
Part 7: Complex Multiplication
Part 8: Math Wizardry
Part 9: Closure
Part 10: Complex Functions
Part 11: Wandering in Four Dimensions
Part 12: Riemann's Solution
Part 13: Riemann Surfaces
Want to learn more or teach this series? Check out the Imaginary Numbers are Real Workbook: http://www.welchlabs.com/resources.
Imaginary numbers are not some wild invention, they are the deep and natural result of extending our number system. Imaginary numbers are all about the discovery of numbers existing not in one dimension along the number line, but in full two dimensional space. Accepting this not only gives us more rich and complete mathematics, but also unlocks a ridiculous amount of very real, very tangible problems in science and engineering.
Part 1: Introduction
Part 2: A Little History
Part 3: Cardan's Problem
Part 4: Bombelli's Solution
Part 5: Numbers are Two Dimensional
Part 6: The Complex Plane
Part 7: Complex Multiplication
Part 8: Math Wizardry
Part 9: Closure
Part 10: Complex Functions
Part 11: Wandering in Four Dimensions
Part 12: Riemann's Solution
Part 13: Riemann Surfaces
Want to learn more or teach this series? Check out the Imaginary Numbers are Real Workbook: http://www.welchlabs.com/resources.