gerald_eliasweb@reddthat.com to Memes@lemmy.mlEnglish · 13 days agoHuman on the internet vs bot on the internetlemmy.mlimagemessage-square15fedilinkarrow-up1355arrow-down15
arrow-up1350arrow-down1imageHuman on the internet vs bot on the internetlemmy.mlgerald_eliasweb@reddthat.com to Memes@lemmy.mlEnglish · 13 days agomessage-square15fedilink
minus-squarekautau@lemmy.worldlinkfedilinkarrow-up28·13 days agohttps://en.wikipedia.org/wiki/Anubis_(software)
minus-squarebrbposting@sh.itjust.workslinkfedilinkEnglisharrow-up15·13 days ago It was created by Xe Iaso in response to Amazon’s web crawler overloading their Git server, as it did not respect the robots.txt exclusion protocol and would work around restrictions. Jeff wouldn’t do that!
minus-squareAbnormalHumanBeing@lemmy.abnormalbeings.spacelinkfedilinkarrow-up19·13 days agohttps://anubis.techaro.lol/
What software is this?
https://en.wikipedia.org/wiki/Anubis_(software)
Jeff wouldn’t do that!
Even a wikipedia page lmfao
https://anubis.techaro.lol/