TechTechPotato | AI Hardware Will Be Everywhere (for a fee) @TechTechPotato | Uploaded December 2022 | Updated October 2024, 28 seconds ago.
This is a recording of a talk I've done now at multiple events - in this case, it is the @eetimes747 AI Everywhere Forum, hosted Dec 13th 2022. The title of the talk is State of Play: AI Hardware Startups, and covers the different types of architectures being built by a lot of the companies in the AI semiconductor hardware space building chips for either machine learning training or inference. As of recording, around $10B has been invested into these startups (at least, $10B that we know of), and estimates are in the $100B if we include software and the big players investments too (NVIDIA, Intel).
It is free to sign up to the EE Times AI Everywhere Forum at
aieverywhere.eetimes.com
Timestamps
Intro
- [0:00] The role of AI Hardware
- [0:40] Talk Overview
- [1:50] Intro to me #selfpromotion
- [2:45] AI Hardware: A New Era
Types of AI Hardware
- [4:37] CPUs
- [5:43] GPUs
- [6:56] FPGAs
- [7:37] ASICs
Types of Architectures
- [8:00] Systolic Arrays and Google TPU
- [9:21] CGRAs
- [10:45] Parallel Pipeline / Dataflow
The AI Hardware Startup Market
- [12:04] Current investment levels
- [13:36] @SambaNovaSystems Cardinal SN10/SN30
- [14:13] @CerebrasSystems Wafer Scale Engine
- [15:36] @Graphcore IPU and Bow
- [17:11] Honorable Mentions: @GroqInc , Lightmatter , Rain, Tachyum
Conclusions
- [18:00] How to Scale
- [19:12] @tenstorrentinc CTO Jim Keller Quote
-----------------------
more-moore.com : Sign up to the More Than Moore Newsletter
patreon.com/TechTechPotato : Patreon gets you access to the TTP Discord server!
Follow Ian on Twitter at twitter.com/IanCutress
Follow TechTechPotato on Twitter at twitter.com/TechTechPotato
If you're in the market for something from Amazon, please use the following links. TTP may receive a commission if you purchase anything through these links.
Amazon USA : geni.us/AmazonUS-TTP
Amazon UK : geni.us/AmazonUK-TTP
Amazon CAN : geni.us/AmazonCAN-TTP
Amazon GER : geni.us/AmazonDE-TTP
Amazon Other : geni.us/TTPAmazonOther
Ending music: youtube.com/watch?v=2N0tmgau5E4
-----------------------
Welcome to the TechTechPotato (c) Dr. Ian Cutress
Ramblings about things related to Technology from an analyst for More Than Moore
#techtechpotato #machinelearning #venturecapital
------------
More Than Moore, as with other research and analyst firms, provides or has provided paid research, analysis, advising, or consulting to many high-tech companies in the industry, which may include advertising on TTP. The companies that fall under this banner include AMD, Armari, Facebook, IBM, Intel, Linode, MediaTek, NordPass, Qualcomm.
This is a recording of a talk I've done now at multiple events - in this case, it is the @eetimes747 AI Everywhere Forum, hosted Dec 13th 2022. The title of the talk is State of Play: AI Hardware Startups, and covers the different types of architectures being built by a lot of the companies in the AI semiconductor hardware space building chips for either machine learning training or inference. As of recording, around $10B has been invested into these startups (at least, $10B that we know of), and estimates are in the $100B if we include software and the big players investments too (NVIDIA, Intel).
It is free to sign up to the EE Times AI Everywhere Forum at
aieverywhere.eetimes.com
Timestamps
Intro
- [0:00] The role of AI Hardware
- [0:40] Talk Overview
- [1:50] Intro to me #selfpromotion
- [2:45] AI Hardware: A New Era
Types of AI Hardware
- [4:37] CPUs
- [5:43] GPUs
- [6:56] FPGAs
- [7:37] ASICs
Types of Architectures
- [8:00] Systolic Arrays and Google TPU
- [9:21] CGRAs
- [10:45] Parallel Pipeline / Dataflow
The AI Hardware Startup Market
- [12:04] Current investment levels
- [13:36] @SambaNovaSystems Cardinal SN10/SN30
- [14:13] @CerebrasSystems Wafer Scale Engine
- [15:36] @Graphcore IPU and Bow
- [17:11] Honorable Mentions: @GroqInc , Lightmatter , Rain, Tachyum
Conclusions
- [18:00] How to Scale
- [19:12] @tenstorrentinc CTO Jim Keller Quote
-----------------------
more-moore.com : Sign up to the More Than Moore Newsletter
patreon.com/TechTechPotato : Patreon gets you access to the TTP Discord server!
Follow Ian on Twitter at twitter.com/IanCutress
Follow TechTechPotato on Twitter at twitter.com/TechTechPotato
If you're in the market for something from Amazon, please use the following links. TTP may receive a commission if you purchase anything through these links.
Amazon USA : geni.us/AmazonUS-TTP
Amazon UK : geni.us/AmazonUK-TTP
Amazon CAN : geni.us/AmazonCAN-TTP
Amazon GER : geni.us/AmazonDE-TTP
Amazon Other : geni.us/TTPAmazonOther
Ending music: youtube.com/watch?v=2N0tmgau5E4
-----------------------
Welcome to the TechTechPotato (c) Dr. Ian Cutress
Ramblings about things related to Technology from an analyst for More Than Moore
#techtechpotato #machinelearning #venturecapital
------------
More Than Moore, as with other research and analyst firms, provides or has provided paid research, analysis, advising, or consulting to many high-tech companies in the industry, which may include advertising on TTP. The companies that fall under this banner include AMD, Armari, Facebook, IBM, Intel, Linode, MediaTek, NordPass, Qualcomm.