Cynicus RextoPrivacy@lemmy.mlEnglish·2 months agoHow to block AI Crawler Bots using robots.txt file(www.cyberciti.biz)external-linkarrow-up1110arrow-down132message-square64fedilink
arrow-up178arrow-down1external-linkHow to block AI Crawler Bots using robots.txt file(www.cyberciti.biz)Cynicus RextoPrivacy@lemmy.mlEnglish·2 months agomessage-square64fedilink
minus-squareOnno (VK6FLAB)arrow-up8arrow-down0·2 months agolinkfedilinkExcellent. I think I might be able to create a fail2ban rule for that.
Excellent.
I think I might be able to create a fail2ban rule for that.