How To Build a Web Scraping API for Large-Scale Data Collection Using FastAPI @AkamaiDevelopers
How To Build a Web Scraping API for Large-Scale Data Collection Using FastAPI  @AkamaiDevelopers
Uploaded October 2024 | Updated November 2026, 6 hours ago
New to Cloud Computing? Get started here with a $100 credit → linode.com/lp/youtube-viewers/?utm_source=youtube&utm_medium=dev_advocacy&utm_content=scrpe_twt_10_16_24

@TechWithTim shows viewers how to build a Scalable Web scraping API for large scale data collection using FastAPI and Python. He walks through all the deployment steps and how to make it take advantage of multiple CPU cores.

Chapters:
0:00 - Introduction
1:06 - Setup Server
2:20 - Create a new Linode
4:40 - Configure Linode for deployment
10:15 - Write API code
19:30 - Use FastAPI
24:44 - Create roots & end points
32:00 - Build Web scraping code
38:15 - Write Web scraping logic
39:40 - Test the API locally
41:42 - Test with Uvicorn
43:00 - Move the code to the Linode
46:24 - Create a virtual environment using Python
47:45 - Make API publicly available
54:51 - Configure FastAPI to run automatically
57:43 - View the general & error logs
58:19 - Test the API using Postman
1:00:05 - Conclusion

Check out Tim's code on GitHub → github.com/techwithtim/Akami-Scaleable-Web-Scraping-API
Learn more about Fast API → fastapi.tiangolo.com
Learn more about Python → python.org/about
Subscribe to get notified of new episodes as they come out → youtube.com/channel/UCf8uu3IE42b6hRUusufEH8g?sub_confirmation=1


#AkamaiDeveloper #Webscraping #datacollection #FastAPI #Python
Product: Akamai, FastAPI, Python; @TechWithTim
How To Build a Web Scraping API for Large-Scale Data Collection Using FastAPIHow SSL, TLS, & HTTPS Work | Keeping Your Connections SafeDeploy Your Containerized App With Docker Swarm | Scalable App DeploymentCI/CD SaaS App Deployment | SaaS App From Scratch ConclusionTerraform Tapas Conclusion | HashiCorp Certification & Where to Learn NextUnderstanding Terraform Resource Naming | Terraform Tapas S2 Ep 3Build a Blogging Machine That Generates Its own Content Using AI | Code With Harry TutorialTerraform Import Command | Terraform Tapas Ep 8How Scalable is Your Application? Simulate Real-World Load Testing with Apache JMeterStreamline AI Apps with Caching Strategies and The Edge | 3 Ways to Improve App ArchitectureDevelopers Guide to Edge Computing vs Cloud Computing | A Technical ComparisonKubernetes VS Nomad | Which Orchestration Tool is Best to Build With?
Akamai Developers |

How To Build a Web Scraping API for Large-Scale Data Collection Using FastAPI

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER