Uploaded August 2026 | Updated September 2026, 2 weeks ago

---

Up to a quarter of the internet is going to block the Googlebot

One of the biggest web providers of around 25% of all internet sites, Cloudflare, is going to implement new default filter rules soon that will block major search engine crawler bots that also are used for AI training. Specifically those from Google, Microsoft (Bing), and Apple. They've been using the same bots they use to index sites (which sites want) to train on AI (which they don't want). But with these defaults, it will hopefully force the companies to separate the bots by purpose, making it easier to control what they do on your websites.

Time Stamps:
0:00 - Intro
1:02 - The Deadline
1:58 - What I Mean By Blocked
2:55 - What is Robots.txt
3:51 - Problematic Bots
5:00 - Which Companies Cooperate
6:20 - How Much Bot Traffic Anyway
7:22 - Does AI Traffic Even Benefit Sites
7:58 - Types of AI Traffic
8:35 - What Will They Do

▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
• My Desktop Wallpapers ⇨ https://thiojoe.art/
⇨ Instagram.com/ThioJoe
⇨ Twitter.com/ThioJoe
⇨ Facebook.com/ThioJoeTV
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬