We Vetted 2000 AI Skills Before They Reached Developers — Lucas Palma, Nubank @aiDotEngineer
We Vetted 2000 AI Skills Before They Reached Developers — Lucas Palma, Nubank  @aiDotEngineer
Uploaded July 2026 | Updated September 2026, 3 weeks ago
An AI skill is a piece of code you hand a model to extend what it can do, and once engineers start sharing skills with each other, each one becomes a supply chain risk, more so inside a regulated bank. Lucas Palma's security team at Nubank built Skill Vector to sit between a skill and the internal marketplace, so nothing reaches developers unvetted. Every skill is scanned first with deterministic checks, for destructive shell commands and the like, then with an LLM for the context those checks miss, and only then does it get a decision and permissions scoped to who will use it.

Running that gate over more than 2,000 skills surfaced real problems, since a single skill can carry many, and fed them into the bank's vulnerability management program with approval gates and human confirmation. What worked was pairing deterministic scans with LLM review; what needed work was the guidance the system gave and the habit of running skills locally before vetting. The lesson he leaves is simple: treat skills like any other dependency, and only what clears the gate belongs in the marketplace.

Speaker info:
- linkedin.com/in/lucaspalma

Timestamps:
0:00 - Introduction: making code safe at a bank
1:32 - AI skills as a supply chain risk
2:50 - What counts as an AI skill
3:57 - The extra weight of a regulated environment
6:07 - From plugins to a vetted marketplace
6:58 - What Skill Vector does
7:37 - Deterministic checks, then the LLM
10:00 - Scanning over two thousand skills
11:22 - What worked and what needed improvement
13:30 - Approval gates and human confirmation
14:23 - Next steps and policies
We Vetted 2000 AI Skills Before They Reached Developers — Lucas Palma, NubankRealtime multiplayer, automation, and you! — Idan Gazit, GitHubShip Production Software in Minutes, Not Months — Eno Reyes, FactoryFull Workshop: Setting Yourself Up for Success —Jason Liu, OpenAI CodexBeyond Static Intelligence: Evaluating Continual Learning — Parth Asawa, UC BerkeleyDesigning Agents (The Floor Is the Frontier) — Ben Hylak, RaindropBuilding Turbopuffer: Gergely Orosz (@pragmaticengineer ) × Simon Eskildsen (CEO)A Taxonomy for Next-gen Reasoning — Nathan Lambert, Allen Institute (AI2) & Interconnects.aiEverything Is a Rollout — Alex Shaw + Ryan Marten, Terminal-Bench, Harbor, Laude InstituteBuilding AI Agents that actually automate Knowledge Work - Jerry Liu, LlamaIndexBenchmarks: The Good, the Bad, and the Ugly — Ali Khial, G2iAgentic Sites: Building Hyper Personalized Websites — Carlos Sanchez, Adobe
AI Engineer |

We Vetted 2000 AI Skills Before They Reached Developers — Lucas Palma, Nubank

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER