HC2024-K1: Predictable Scaling and Infrastructure @hotchipsvideos
HC2024-K1: Predictable Scaling and Infrastructure  @hotchipsvideos
Uploaded September 2024 | Updated November 2026, 1 hour ago
Keynote 1, Hot Chips 2024, Monday, August 26, 2024

Trevor Cai, OpenAI

In this keynote talk, Trevor gives a brief history of large language models (LLMs) like ChatGPT and describes how compute hardware has been increasing exponentially in order to keep up with the size and complexity of these rapidly developing models ... and will need to continue increasing in size and complexity for the foreseeable future, because currently there is no end in sight as these models continue to improve.
HC2024-K1: Predictable Scaling and InfrastructureHC27-S5: GPUsHC2024-R2: Closing Remarks and TCMM AwardsHC18-S5: Parallel ProcessingHC32-K1: No Transistor Left BehindHC34-K1: Semiconductors Run the WorldHC33-S1: Server ProcessorsHC2024-T2.2: The Cooling of Hot Chips: How thermal technology is keeping up with the AI revolutionHC25-S1: SoC 1HC31-S9: Graphics & ARHC18-S1: Video ProcessingHC26-K1: Power Constraints: From Sensors to Servers
hotchipsvideos |

HC2024-K1: Predictable Scaling and Infrastructure

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER