minus-squarekcweller@feddit.nltoSelfhosted@lemmy.world•How to combat large amounts of Ai scraperslinkfedilinkEnglisharrow-up0·2 days agoNephentes that shit. Poison every scraper until they start respecting robot.txt. Purposefully use llm.txt to trap the fuckers. linkfedilink
Nephentes that shit. Poison every scraper until they start respecting robot.txt. Purposefully use llm.txt to trap the fuckers.