TechTechPotato | 4,000,000,000,000 Transistors, One Giant Chip (Cerebras WSE-3) @TechTechPotato | Uploaded March 2024 | Updated October 2024, 4 minutes ago.
The only company with a chip as big as your head, Cerebras has a unique value proposition when it comes to AI silicon. Today they are announcing their third generation Wafer Scale Engine, called WSE-3. Built on 5nm, this chip increases the cores to over 900,000, has four trillion transistors, and doubles training performance over WSE-2. Each system costs a few million, but the price hasn't gone up, and these systems are being used globally to overcome the bottlenecks that GPUs can't get rid of.
[00:00] Sneaky Snek
[00:19] Moore's Law isn't Dead
[02:00] Tasty Chip (specifications)
[03:00] 2x Perf, 2x TCO
[04:52] 250 ExaFLOPs in one Supercomputer
[06:00] Eliminate GPU Bottlenecks
[07:30] The Business Model
[09:10] Partnership with Inference
[11:12] Co-designed software
[14:44] Wafer bite tax
-----------------------
Need POTATO merch? There's a chip for that!
merch.techtechpotato.com
more-moore.com : Sign up to the More Than Moore Newsletter
patreon.com/TechTechPotato : Patreon gets you access to the TTP Discord server!
Follow Ian on Twitter at twitter.com/IanCutress
Follow TechTechPotato on Twitter at twitter.com/TechTechPotato
If you're in the market for something from Amazon, please use the following links. TTP may receive a commission if you purchase anything through these links.
Amazon USA : geni.us/AmazonUS-TTP
Amazon UK : geni.us/AmazonUK-TTP
Amazon CAN : geni.us/AmazonCAN-TTP
Amazon GER : geni.us/AmazonDE-TTP
Amazon Other : geni.us/TTPAmazonOther
Ending music: youtube.com/watch?v=2N0tmgau5E4
-----------------------
Welcome to the TechTechPotato (c) Dr. Ian Cutress
Ramblings about things related to Technology from an analyst for More Than Moore
#cerebras #waferscale3 #mooreslaw
------------
More Than Moore, as with other research and analyst firms, provides or has provided paid research, analysis, advising, or consulting to many high-tech companies in the industry, which may include advertising on TTP. The companies that fall under this banner include AMD, Armari, Baidu, Facebook, IBM, Infineon, Intel, Lattice Semi, Linode, MediaTek, NordPass, ProteanTecs, Qualcomm, SiFive, Supermicro, Tenstorrent, TSMC.
The only company with a chip as big as your head, Cerebras has a unique value proposition when it comes to AI silicon. Today they are announcing their third generation Wafer Scale Engine, called WSE-3. Built on 5nm, this chip increases the cores to over 900,000, has four trillion transistors, and doubles training performance over WSE-2. Each system costs a few million, but the price hasn't gone up, and these systems are being used globally to overcome the bottlenecks that GPUs can't get rid of.
[00:00] Sneaky Snek
[00:19] Moore's Law isn't Dead
[02:00] Tasty Chip (specifications)
[03:00] 2x Perf, 2x TCO
[04:52] 250 ExaFLOPs in one Supercomputer
[06:00] Eliminate GPU Bottlenecks
[07:30] The Business Model
[09:10] Partnership with Inference
[11:12] Co-designed software
[14:44] Wafer bite tax
-----------------------
Need POTATO merch? There's a chip for that!
merch.techtechpotato.com
more-moore.com : Sign up to the More Than Moore Newsletter
patreon.com/TechTechPotato : Patreon gets you access to the TTP Discord server!
Follow Ian on Twitter at twitter.com/IanCutress
Follow TechTechPotato on Twitter at twitter.com/TechTechPotato
If you're in the market for something from Amazon, please use the following links. TTP may receive a commission if you purchase anything through these links.
Amazon USA : geni.us/AmazonUS-TTP
Amazon UK : geni.us/AmazonUK-TTP
Amazon CAN : geni.us/AmazonCAN-TTP
Amazon GER : geni.us/AmazonDE-TTP
Amazon Other : geni.us/TTPAmazonOther
Ending music: youtube.com/watch?v=2N0tmgau5E4
-----------------------
Welcome to the TechTechPotato (c) Dr. Ian Cutress
Ramblings about things related to Technology from an analyst for More Than Moore
#cerebras #waferscale3 #mooreslaw
------------
More Than Moore, as with other research and analyst firms, provides or has provided paid research, analysis, advising, or consulting to many high-tech companies in the industry, which may include advertising on TTP. The companies that fall under this banner include AMD, Armari, Baidu, Facebook, IBM, Infineon, Intel, Lattice Semi, Linode, MediaTek, NordPass, ProteanTecs, Qualcomm, SiFive, Supermicro, Tenstorrent, TSMC.
![[24] Jim Keller Interview 2: AI Hardware on PCIe Cards](https://i.ytimg.com/vi/fOUB73dZXEo/hqdefault.jpg "[24] Jim Keller Interview 2: AI Hardware on PCIe Cards
Written version: https://morethanmoore.substack.com/p/interview-with-jim-keller-tenstorrent?utm_source=youtube&utm_campaign=auto_share
Updated Audio! https://www.youtube.com/watch?v=YOiXomG9FhE&feature=youtu.be
Well, its official. I finally got to meet the guy in person. Jim now leads an startup called Tenstorrent, designing ML hardware and software, with a lot of clever people in the team. In this interview, we discuss RISC-V, Chiplets, IP, Expertise, and if theyll sell PCIe cards.
[00:00] Spicy talk
[00:33] Q1: Moving from CTO to CEO
[01:48] Q2: Tenstorrent and Software
[05:30] Q3: Incoming Hiring Mentality
[07:29] Q4: Why have cores, why RISC-V?
[09:28] Q5: Chiplets?
[11:37] Q6: Is Tenstorrent an AI company or an IP company?
[14:56] Q7: Differentiation and Expertise
[16:48] Q8: Use Tenstorrent To Make Tenstorrent
[19:50] Q9: AI on EDA: Unintelligible Outputs
[21:25] Q10: Auditable Hardware
[22:47] Q11: New Clean Sheet Designs
[24:25] Q12: Comfortable!
[24:58] Q13: One Core = One Chip = One System
[27:00] LOLs
[29:00] Q14: Customer System Sizes
[30:30] Q15: Selling PCIe Cards? Yes!
[33:17] Q16: Customer Announcements?
Big Ball of Mud Paper: https://www.researchgate.net/publication/2938621_Big_Ball_of_Mud
Even though Tenstorrent is a client of my analyst business, this interview was not sponsored content.
Need POTATO merch? Theres a chip for that!
http://merch.techtechpotato.com
http://more-moore.com : Sign up to the More Than Moore Newsletter
https://www.patreon.com/TechTechPotato : Patreon gets you access to the TTP Discord server!
Follow Ian on Twitter at http://twitter.com/IanCutress
Follow TechTechPotato on Twitter at http://twitter.com/TechTechPotato
If youre in the market for something from Amazon, please use the following links. TTP may receive a commission if you purchase anything through these links.
Amazon USA : https://geni.us/AmazonUS-TTP
Amazon UK : https://geni.us/AmazonUK-TTP
Amazon CAN : https://geni.us/AmazonCAN-TTP
Amazon GER : https://geni.us/AmazonDE-TTP
Amazon Other : https://geni.us/TTPAmazonOther
Ending music: https://www.youtube.com/watch?v=2N0tmgau5E4
Welcome to the TechTechPotato (c) Dr. Ian Cutress
Ramblings about things related to Technology from an analyst for More Than Moore
#techtechpotato #jimkeller #tenstorrent
More Than Moore, as with other research and analyst firms, provides or has provided paid research, analysis, advising, or consulting to many high-tech companies in the industry, which may include advertising on TTP. The companies that fall under this banner include AMD, Armari, Facebook, IBM, Infineon, Intel, Lattice Semi, Linode, MediaTek, NordPass, ProteanTecs, Qualcomm, SiFive, Tenstorrent.")
![[21] Emma Haruka Iwao, Google Cloud breaks π](https://i.ytimg.com/vi/iUjfRBfSN-o/hqdefault.jpg "[21] Emma Haruka Iwao, Google Cloud breaks π
Ive spoken a lot about Pi, and world records on how to calculate it, but Emma has done it again with a new WR: 100 trillion digits! In this interview, we go through why this record is interesting (to us) from the hardware perspective.
You can follow Emma on Twitter: www.twitter.com/yuryu
Read Googles Blog Post here: https://cloud.google.com/blog/products/compute/calculating-100-trillion-digits-of-pi-on-google-cloud
Watch Matt Parkers video on Pi^Pi^Pi^Pi: https://www.youtube.com/watch?v=BdHFLfv-ThQ
If you like these videos and want to see more, Patreon helps support this channel: https://www.patreon.com/TechTechPotato
Follow Ian on Twitter at http://twitter.com/IanCutress
Follow TechTechPotato on Twitter at http://twitter.com/TechTechPotato
If youre in the market for something from Amazon, please use the following links. TTP may receive a commission if you purchase anything through these links.
Amazon USA : https://geni.us/AmazonUS-TTP
Amazon UK : https://geni.us/AmazonUK-TTP
Amazon CAN : https://geni.us/AmazonCAN-TTP
Amazon GER : https://geni.us/AmazonDE-TTP
Amazon Other : https://geni.us/TTPAmazonOther
Welcome to the TechTechPotato (c) Dr. Ian Cutress
Ramblings about things related to Technology from an analyst for More Than Moore
#techtechpotato #emmaharukaiwao #googlecloud #pi
More Than Moore, as with other research and analyst firms, provides or has provided paid research, analysis, advising, or consulting to many high-tech companies in the industry, which may include advertising on TTP. The companies that fall under this banner include Armari, Facebook, IBM, Linode, MediaTek, NordPass, Qualcomm.")
