Andy ReidtoTechnology@lemmy.worldEnglish·8 months agocross-posted to: technology@beehaw.orgAI companies are violating a basic social contract of the web and and ignoring robots.txt(www.theverge.com)external-linkarrow-up11.09Karrow-down115message-square200fedilink
arrow-up11.08Karrow-down1external-linkAI companies are violating a basic social contract of the web and and ignoring robots.txt(www.theverge.com)Andy ReidtoTechnology@lemmy.worldEnglish·8 months agocross-posted to: technology@beehaw.orgmessage-square200fedilink
minus-squareLvxferreEnglisharrow-up12arrow-down0·8 months agolinkfedilinkYeah, that throws a monkey wrench into the idea. That’s a shame, because “either respect robots.txt or you’re denied access to a lot of websites!” is appealing.
minus-squareNighedEnglisharrow-up1arrow-down5·8 months agolinkfedilinkThat’s when Google’s browser DRM thing starts sounding like a good idea 😭
Yeah, that throws a monkey wrench into the idea. That’s a shame, because “either respect robots.txt or you’re denied access to a lot of websites!” is appealing.
That’s when Google’s browser DRM thing starts sounding like a good idea 😭