TechTechPotato | Next-Gen CPU Acceleration: AVX For Generative AI @TechTechPotato | Uploaded September 2023 | Updated October 2024, 1 minute ago.
The future is AVX10, so says Intel. Recently a document was released showcasing a post-AVX512 world, and to explain why this matters, I've again invited the Chips And Cheese crew onto the channel. Chester and George answer my questions on AVX10 and why it matters!
Visit chipsandcheese.com to learn more!
Background Thumbnail from Fritzchens Fritz: flickr.com/photos/130561288@N04/50134657271/in
-----------------------
Need POTATO merch? There's a chip for that!
merch.techtechpotato.com
more-moore.com : Sign up to the More Than Moore Newsletter
patreon.com/TechTechPotato : Patreon gets you access to the TTP Discord server!
Follow Ian on Twitter at twitter.com/IanCutress
Follow TechTechPotato on Twitter at twitter.com/TechTechPotato
If you're in the market for something from Amazon, please use the following links. TTP may receive a commission if you purchase anything through these links.
Amazon USA : geni.us/AmazonUS-TTP
Amazon UK : geni.us/AmazonUK-TTP
Amazon CAN : geni.us/AmazonCAN-TTP
Amazon GER : geni.us/AmazonDE-TTP
Amazon Other : geni.us/TTPAmazonOther
Ending music: youtube.com/watch?v=2N0tmgau5E4
-----------------------
Welcome to the TechTechPotato (c) Dr. Ian Cutress
Ramblings about things related to Technology from an analyst for More Than Moore
#techtechpotato
------------
More Than Moore, as with other research and analyst firms, provides or has provided paid research, analysis, advising, or consulting to many high-tech companies in the industry, which may include advertising on TTP. The companies that fall under this banner include AMD, Armari, Facebook, IBM, Infineon, Intel, Lattice Semi, Linode, MediaTek, NordPass, ProteanTecs, Qualcomm, SiFive, Tenstorrent.
The future is AVX10, so says Intel. Recently a document was released showcasing a post-AVX512 world, and to explain why this matters, I've again invited the Chips And Cheese crew onto the channel. Chester and George answer my questions on AVX10 and why it matters!
Visit chipsandcheese.com to learn more!
Background Thumbnail from Fritzchens Fritz: flickr.com/photos/130561288@N04/50134657271/in
-----------------------
Need POTATO merch? There's a chip for that!
merch.techtechpotato.com
more-moore.com : Sign up to the More Than Moore Newsletter
patreon.com/TechTechPotato : Patreon gets you access to the TTP Discord server!
Follow Ian on Twitter at twitter.com/IanCutress
Follow TechTechPotato on Twitter at twitter.com/TechTechPotato
If you're in the market for something from Amazon, please use the following links. TTP may receive a commission if you purchase anything through these links.
Amazon USA : geni.us/AmazonUS-TTP
Amazon UK : geni.us/AmazonUK-TTP
Amazon CAN : geni.us/AmazonCAN-TTP
Amazon GER : geni.us/AmazonDE-TTP
Amazon Other : geni.us/TTPAmazonOther
Ending music: youtube.com/watch?v=2N0tmgau5E4
-----------------------
Welcome to the TechTechPotato (c) Dr. Ian Cutress
Ramblings about things related to Technology from an analyst for More Than Moore
#techtechpotato
------------
More Than Moore, as with other research and analyst firms, provides or has provided paid research, analysis, advising, or consulting to many high-tech companies in the industry, which may include advertising on TTP. The companies that fall under this banner include AMD, Armari, Facebook, IBM, Infineon, Intel, Lattice Semi, Linode, MediaTek, NordPass, ProteanTecs, Qualcomm, SiFive, Tenstorrent.
![[37] MediaTek Interview: Finbarr Moynihan and Amy Guesner](https://i.ytimg.com/vi/cGFuoTTP1os/hqdefault.jpg "[37] MediaTek Interview: Finbarr Moynihan and Amy Guesner
After the last few years in the industry, Ive noticed that weve been speaking about AI on the edge, and there has been a concerted effort to bring the best models onto our handheld devices. However, there are limitations. Memory capacity is the big one, but these models work best when they support built-in acceleration. These are AI accelerators in everything from edge to TV to automotive to smartphone to PC. Time to first token and how many tokens per second are becoming the de facto standard metrics in generative AI. However, the AI and machine learning space is more than just generative. Not only do we have large language models and stable diffusion, but we also have machine learning to do many things on many devices. Even something as simple as power management these days is optimized by machine learning. This is why you need stuff on the device to help with battery life, to help with performance.
In order to find out more, I spoke to MediaTeks Finbarr Moynihan and Amy Guesner about what it takes to enable NPUs from edge to cloud.
https://i.mediatek.com/ai to find out more.
[00:00] - Introduction to AI on the Edge
[01:00] - Limitations of Edge Devices
[02:40] - Importance of Running AI Models on the Edge
[05:00] - Applications of AI Beyond Generative Models
[07:00] - Power Management Optimized by AI
[09:30] - MediaTek’s End-to-End Strategy for AI
[11:00] - MediaTek’s Market Position and AI Portfolio
[13:20] - Generative AI and Its Future Impact
[16:00] - MediaTeks AI Strategy and Cross-Device Integration
[19:00] - The Role of AI in Automotive and Consumer Devices
[22:00] - MediaTeks Partnership with Nvidia
[25:00] - Developer Ecosystem and AI Tools
[28:00] - MediaTeks Future Direction in AI and Custom Silicon
Need POTATO merch? Theres a chip for that!
http://merch.techtechpotato.com
http://more-moore.com : Sign up to the More Than Moore Newsletter
https://www.patreon.com/TechTechPotato : Patreon gets you access to the TTP Discord server!
Follow Ian on Twitter at http://twitter.com/IanCutress
Follow TechTechPotato on Twitter at http://twitter.com/TechTechPotato
If youre in the market for something from Amazon, please use the following links. TTP may receive a commission if you purchase anything through these links.
Amazon USA : https://geni.us/AmazonUS-TTP
Amazon UK : https://geni.us/AmazonUK-TTP
Amazon CAN : https://geni.us/AmazonCAN-TTP
Amazon GER : https://geni.us/AmazonDE-TTP
Amazon Other : https://geni.us/TTPAmazonOther
Ending music: https://www.youtube.com/watch?v=2N0tmgau5E4
Welcome to the TechTechPotato (c) Dr. Ian Cutress
Ramblings about things related to Technology from an analyst for More Than Moore
#techtechpotato #mediatek #machinelearning
More Than Moore, as with other research and analyst firms, provides or has provided paid research, analysis, advising, or consulting to many high-tech companies in the industry, which may include advertising on the More Than Moore newsletter or TechTechPotato YouTube channel and related social media. The companies that fall under this banner include AMD, Applied Materials, Armari, ASM, Ayar Labs, BCG, Baidu, Dialectica, Facebook, GLG, Guidepoint, IBM, Impala, Infineon, Intel, Kuehne+Nagel, Lattice Semi, Linode, MediaTek, NordPass, NVIDIA, ProteanTecs, Qualcomm, SiFive, SIG, SiTime, Supermicro, Synopsys, Tenstorrent, Third Bridge, TSMC, Untether AI, Ventana Micro.")
![[29] Ian Interviews: David Bennett, COO Tenstorrent](https://i.ytimg.com/vi/eUqanjudcGQ/hqdefault.jpg "[29] Ian Interviews: David Bennett, COO Tenstorrent
One of the most important things for any tech startup creating silicon is developers. Getting as many developers on board as possible. Today I spoke with David Bennett, CCO of Tenstorrent, to talk about their go-to-market strategy and what it means for the casual developer on the street.
[00:00] Intro
[01:40] Galaxy: The DGX Competitor
[02:50] Whats the lead product? IP or ML or RISC-V?
[06:25] How are strategic investors involved?
[08:05] Is there a market for AI IP?
[09:40] Is there a product design feedback loop?
[12:25] What major verticals are interested?
[14:09] Does the name JIM KELLER open doors?
[15:30] Customer influence on the roadmap?
[17:25] Why are most announced customers today in Asia?
[18:55] What new business has been unexpected?
[20:10] Balancing IP vs selling own hardware?
[22:00] When can we buy Tenstorrent hardware on Amazon?
[23:40] Whats the open source strategy?
Need POTATO merch? Theres a chip for that!
http://merch.techtechpotato.com
http://more-moore.com : Sign up to the More Than Moore Newsletter
https://www.patreon.com/TechTechPotato : Patreon gets you access to the TTP Discord server!
Follow Ian on Twitter at http://twitter.com/IanCutress
Follow TechTechPotato on Twitter at http://twitter.com/TechTechPotato
If youre in the market for something from Amazon, please use the following links. TTP may receive a commission if you purchase anything through these links.
Amazon USA : https://geni.us/AmazonUS-TTP
Amazon UK : https://geni.us/AmazonUK-TTP
Amazon CAN : https://geni.us/AmazonCAN-TTP
Amazon GER : https://geni.us/AmazonDE-TTP
Amazon Other : https://geni.us/TTPAmazonOther
Ending music: https://www.youtube.com/watch?v=2N0tmgau5E4
Welcome to the TechTechPotato (c) Dr. Ian Cutress
Ramblings about things related to Technology from an analyst for More Than Moore
#techtechpotato #tenstorrent #aidevelopment
More Than Moore, as with other research and analyst firms, provides or has provided paid research, analysis, advising, or consulting to many high-tech companies in the industry, which may include advertising on TTP. The companies that fall under this banner include AMD, Armari, Facebook, IBM, Infineon, Intel, Lattice Semi, Linode, MediaTek, NordPass, ProteanTecs, Qualcomm, SiFive, Tenstorrent, TSMC.")
![[24] Jim Keller Interview 2: AI Hardware on PCIe Cards](https://i.ytimg.com/vi/fOUB73dZXEo/hqdefault.jpg "[24] Jim Keller Interview 2: AI Hardware on PCIe Cards
Written version: https://morethanmoore.substack.com/p/interview-with-jim-keller-tenstorrent?utm_source=youtube&utm_campaign=auto_share
Updated Audio! https://www.youtube.com/watch?v=YOiXomG9FhE&feature=youtu.be
Well, its official. I finally got to meet the guy in person. Jim now leads an startup called Tenstorrent, designing ML hardware and software, with a lot of clever people in the team. In this interview, we discuss RISC-V, Chiplets, IP, Expertise, and if theyll sell PCIe cards.
[00:00] Spicy talk
[00:33] Q1: Moving from CTO to CEO
[01:48] Q2: Tenstorrent and Software
[05:30] Q3: Incoming Hiring Mentality
[07:29] Q4: Why have cores, why RISC-V?
[09:28] Q5: Chiplets?
[11:37] Q6: Is Tenstorrent an AI company or an IP company?
[14:56] Q7: Differentiation and Expertise
[16:48] Q8: Use Tenstorrent To Make Tenstorrent
[19:50] Q9: AI on EDA: Unintelligible Outputs
[21:25] Q10: Auditable Hardware
[22:47] Q11: New Clean Sheet Designs
[24:25] Q12: Comfortable!
[24:58] Q13: One Core = One Chip = One System
[27:00] LOLs
[29:00] Q14: Customer System Sizes
[30:30] Q15: Selling PCIe Cards? Yes!
[33:17] Q16: Customer Announcements?
Big Ball of Mud Paper: https://www.researchgate.net/publication/2938621_Big_Ball_of_Mud
Even though Tenstorrent is a client of my analyst business, this interview was not sponsored content.
Need POTATO merch? Theres a chip for that!
http://merch.techtechpotato.com
http://more-moore.com : Sign up to the More Than Moore Newsletter
https://www.patreon.com/TechTechPotato : Patreon gets you access to the TTP Discord server!
Follow Ian on Twitter at http://twitter.com/IanCutress
Follow TechTechPotato on Twitter at http://twitter.com/TechTechPotato
If youre in the market for something from Amazon, please use the following links. TTP may receive a commission if you purchase anything through these links.
Amazon USA : https://geni.us/AmazonUS-TTP
Amazon UK : https://geni.us/AmazonUK-TTP
Amazon CAN : https://geni.us/AmazonCAN-TTP
Amazon GER : https://geni.us/AmazonDE-TTP
Amazon Other : https://geni.us/TTPAmazonOther
Ending music: https://www.youtube.com/watch?v=2N0tmgau5E4
Welcome to the TechTechPotato (c) Dr. Ian Cutress
Ramblings about things related to Technology from an analyst for More Than Moore
#techtechpotato #jimkeller #tenstorrent
More Than Moore, as with other research and analyst firms, provides or has provided paid research, analysis, advising, or consulting to many high-tech companies in the industry, which may include advertising on TTP. The companies that fall under this banner include AMD, Armari, Facebook, IBM, Infineon, Intel, Lattice Semi, Linode, MediaTek, NordPass, ProteanTecs, Qualcomm, SiFive, Tenstorrent.")
