molave@reddthat.com to Selfhosted@lemmy.worldEnglish · 4 days agoRunning web sites makes me not want to - Lowkey Partylowkey.partyexternal-linkmessage-square51linkfedilinkarrow-up1168arrow-down14
arrow-up1164arrow-down1external-linkRunning web sites makes me not want to - Lowkey Partylowkey.partymolave@reddthat.com to Selfhosted@lemmy.worldEnglish · 4 days agomessage-square51linkfedilink
minus-squarediaphragmwp@discuss.tchncs.delinkfedilinkEnglisharrow-up3·2 days agoI have a simple static site. It’s been up for less than a month. On the cheapest possible VPS, someone gave me. Robots.txt: User-Agent: * Allow: / How long do yall think it will take for it to blow up?
minus-squarePossibly linux@lemmy.ziplinkfedilinkEnglisharrow-up1·1 day agoRobots.txt is completely ignored these days
minus-squarediaphragmwp@discuss.tchncs.delinkfedilinkEnglisharrow-up2·1 day agoCool. Doesn’t really answer my question, though.
I have a simple static site. It’s been up for less than a month. On the cheapest possible VPS, someone gave me. Robots.txt:
How long do yall think it will take for it to blow up?
Robots.txt is completely ignored these days
Cool. Doesn’t really answer my question, though.