How to Fine-Tune SmolVLM2 | Convert Documents into JSON @Roboflow
How to Fine-Tune SmolVLM2 | Convert Documents into JSON  @Roboflow
Uploaded July 2025 | Updated November 2026, 32 minutes ago
Do you have a collection of documents — like invoices or shipping manifests — and want to digitize the content using AI?

In this video, we show how to transform paper documents into JSON format using a fine-tuned SmolVLM vision model. You'll see how to prepare a dataset, train a model, and then build an application to read invoices and return the text as JSON format.

Chapters:
00:00 Intro - Turn Paper Documents Into JSON?
00:27 Understanding SmolVLM2 & Multimodal Models
03:01 Creating and Configuring a New Project
04:36 Dataset Upload, Preparation, and Labeling
07:12 Training the SmolVLM Model in the Cloud
10:19 Deploying, Building, and Testing the Document Processing App
16:06 Optimizing with Pre-Classification

Resources:
Try the dataset yourself: roboflow.com/smolvlm-dataset
See the related blog article: blog.roboflow.com/train-smolvlm2
Join a future webinar: roboflow.com/webinar
How to Fine-Tune SmolVLM2 | Convert Documents into JSONUsing Images and Annotations From Open Source Computer Vision DatasetsTrack objects in video with SORT and OC-SORTCVPR 2023 - Top Papers & Highlights (My first time!)Introducing the Roboflow Deployment TabHow to Setup a Jetson Nano 2GB for computer vision with RoboflowYOLO26 Fine-Tuning | Detection and Instance Segmentation | Live Coding + Q&A (Jan 15th)How to Automate Quality Inspections with ResNet Classification ModelsHow to Build a Smart Parking System - License Plate Detection & OCRHow to Run Vision Models on Multiple Video Streams and Manage Everything in One PlaceMulti-Object Tracking Made Easy | Trackers CLI + RF-DETR | Live Demo + Q&A (Feb 19th)Dwell Time Analysis | Real-Time Stream Processing | Community Q&A (April 11)
Roboflow |

How to Fine-Tune SmolVLM2 | Convert Documents into JSON

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER