DevTips | Recursion ➰ for Paginated Web Scraping @OfficialDevTips | Uploaded October 2018 | Updated October 2024, 6 hours ago.
Sponsored by: Brilliant, thanks! Be one of the first 200 people to sign up with this link and get 20% off your annual subscription with Brilliant.org!
brilliant.org/DevTips

We figure out how to deal with the paginated search results in our web scrape. RECURSION is our tool - not as difficult as you might think!!

🗿 MILESTONES
⏯ 00:12 Fika 🍪
⏯ 13:10 Extracting the next page number with regex
⏯ 16:50 Encounter with prettier... 🌋
⏯ 18:39 ➰ Recap
⏯ 20:15 TIME FOR RECURSION 😎
⏯ 29:00 Quick Google rant 🌋
⏯ 29:23 ➰➰ Rerecap by Commenting the Code

See the previous episode where we explain Puppeteer and finding the data to scrape
▶️ youtube.com/watch?v=pixfH6yyqZk

The code used in this video is on GitHub
🗒 github.com/chhib/scraper/tree/5d00bb08c6ec4ea8cbaec7ea78fb90a10a864f8b

Puppeteer - Headless Chrome browser for scraping (instead of Phantom JS)
🔪 github.com/GoogleChrome/puppeteer

The editor is called Visual Studio Code and is free. Look for the Live Share extension to share your environment with friends.
💻 code.visualstudio.com

DevTips is a weekly show for YOU who want to be inspired 👍 and learn 🖖 about programming. Hosted by David and MPJ - two notorious bug generators 💖 and teachers 🤗. Exploring code together and learning programming along the way - yay!

DevTips has a sister channel called Fun Fun Function, check it out!
❤️ youtube.com/funfunfunction

#recursion #webscraping #nodejs