Davriellelouna@lemmy.world to Technology@lemmy.worldEnglish · 1 year agoThe AI company Perplexity is complaining their bots can't bypass Cloudflare's firewallwww.searchenginejournal.comexternal-linkmessage-square209linkfedilinkarrow-up1226arrow-down10
arrow-up1226arrow-down1external-linkThe AI company Perplexity is complaining their bots can't bypass Cloudflare's firewallwww.searchenginejournal.comDavriellelouna@lemmy.world to Technology@lemmy.worldEnglish · 1 year agomessage-square209linkfedilink
minus-squarepressanykeynow@lemmy.worldlinkfedilinkEnglisharrow-up1·1 year ago Cloudflare doesn’t distinguish these things It does. You just make useragent like “AI bot request initiated by user” and the website owners will decide for themselves to allow your traffic or not. If your bot pretends to not be a bot, it should be blocked. Edit. Btw Openai does this.
It does.
You just make useragent like “AI bot request initiated by user” and the website owners will decide for themselves to allow your traffic or not.
If your bot pretends to not be a bot, it should be blocked.
Edit. Btw Openai does this.