tekeous@usenet.lol to Lemmy Shitpost@lemmy.world · 12 days agorobots.txt is a suggestionusenet.lolimagemessage-square24fedilinkarrow-up1603arrow-down13
arrow-up1600arrow-down1imagerobots.txt is a suggestionusenet.loltekeous@usenet.lol to Lemmy Shitpost@lemmy.world · 12 days agomessage-square24fedilink
minus-squareunalivejoy@lemm.eelinkfedilinkEnglisharrow-up4·12 days agoPeople really should be providing a sitemap.xml file
People really should be providing a sitemap.xml file