Uploaded June 2026 | Updated September 2026, 1 week ago
Unlock powerful image understanding with the latest Vision framework and Foundation Models framework updates. The new tap-to-segment request lets you segment images in new ways, and Vision now supports watchOS. Combine the new image support in Apple Foundation Model together with OCR, barcode scanning and your own tools to deliver LLM-powered visual understanding in your app.
Explore related documentation, sample code, and more:
Segmenting objects using taps, scribbles or rectangles: developer.apple.com/documentation/Vision/segmenting-objects-using-taps-scribbles-or-rectangles
Implementing saliency-based image cropping in iOS and watchOS: developer.apple.com/documentation/Vision/implementing-saliency-based-image-cropping-in-iOS-and-watchOS
Deep dive into the Foundation Models framework: developer.apple.com/videos/play/wwdc2025/301
Discover Swift enhancements in the Vision framework: developer.apple.com/videos/play/wwdc2024/10163
What’s new in the Foundation Models framework: developer.apple.com/videos/play/wwdc2026/241
00:00 - Introduction
01:36 - Segment images with tap-to-segment
05:50 - Image inputs for Foundation Models
07:57 - Image-based tool calling
13:09 - Vision on watchOS
14:39 - Next steps
More Apple Developer resources:
Video sessions: apple.co/VideoSessions
Documentation: apple.co/DeveloperDocs
Forums: apple.co/DeveloperForums
App: apple.co/DeveloperApp
Unlock powerful image understanding with the latest Vision framework and Foundation Models framework updates. The new tap-to-segment request lets you segment images in new ways, and Vision now supports watchOS. Combine the new image support in Apple Foundation Model together with OCR, barcode scanning and your own tools to deliver LLM-powered visual understanding in your app.
Explore related documentation, sample code, and more:
Segmenting objects using taps, scribbles or rectangles: developer.apple.com/documentation/Vision/segmenting-objects-using-taps-scribbles-or-rectangles
Implementing saliency-based image cropping in iOS and watchOS: developer.apple.com/documentation/Vision/implementing-saliency-based-image-cropping-in-iOS-and-watchOS
Deep dive into the Foundation Models framework: developer.apple.com/videos/play/wwdc2025/301
Discover Swift enhancements in the Vision framework: developer.apple.com/videos/play/wwdc2024/10163
What’s new in the Foundation Models framework: developer.apple.com/videos/play/wwdc2026/241
00:00 - Introduction
01:36 - Segment images with tap-to-segment
05:50 - Image inputs for Foundation Models
07:57 - Image-based tool calling
13:09 - Vision on watchOS
14:39 - Next steps
More Apple Developer resources:
Video sessions: apple.co/VideoSessions
Documentation: apple.co/DeveloperDocs
Forums: apple.co/DeveloperForums
App: apple.co/DeveloperApp
