Making Transformers 100x Smaller @WeightsBiases
Making Transformers 100x Smaller  @WeightsBiases
Uploaded August 2026 | Updated September 2026, 2 weeks ago
Heron Power has made the transformer 100x smaller.

The trick? Speed. Traditional transformers switch power 60 times a second, the same rate the grid has used for a century, which is why they're giant, oil-filled boxes.

Drew Baglino explains how Heron's devices switch hundreds of thousands of times a second instead. The faster the switching, the smaller the transformer needs to be to do the same job.
Making Transformers 100x SmallerAI Builders: Building an AI agent for interior designPower agents with full context of your experiments and traces with W&B MCP serverModel CI/CD Course: Webhooks in Weights & BiasesHow Salesforce Leverages AI for System Health MonitoringCoreWeave ARIA: The autoresearch loop for continuous improvementMistral AI ecosystem for Japanese builders and enterprisesHow a sales guy built a $15B database companyToward zero traffic accidents: How we built a video AI agent for automated drivingThe AI that solves the market: A new era in forecasting with natural language explainability
Weights & Biases |

Making Transformers 100x Smaller

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER