Advertisement
Podcast

Podcast: Google, Reddit, and the Robots.txt Rebellion

We go long on robots.txt, AI scraping, and what it means for search and the web today. Also, a leaked document shows a multibillion dollar AI company scraped YouTube videos from specific creators, and we discuss Skibidi.
Clockwise: Emanuel Maiberg, Joseph Cox, Sam Cole, Jason Koebler.
Image: 404 Media.

We've got a bumper episode today. First off, a whole series of stories about robots.txt and its increased use against AI, as well as Reddit only being available in Google results now (and not other search engines like DuckDuckGo). Then after the break, Sam discusses her amazing scoop which showed that multibillion dollar company Runway scraped videos from individual YouTube creators. In the subscribers-section, everyone educates Joseph on what Skibidi is.

Listen to the weekly podcast on Apple Podcasts, Spotify, or YouTube. Become a paid subscriber for access to this episode's bonus content and to power our journalism. If you become a paid subscriber, check your inbox for an email from our podcast host Transistor for a link to the subscribers-only version! You can also add that subscribers feed to your podcast app of choice and never miss an episode that way. We will soon be emailing the subscribers-only unlisted YouTube link for the extended video version too.

Advertisement