Allow all crawlers and point to the sitemap; the site had never served one and /robots.txt returned 404. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
5 lines
78 B
Plaintext
5 lines
78 B
Plaintext
User-agent: *
|
|
Allow: /
|
|
|
|
Sitemap: https://blog.kestrelsnest.social/sitemap.xml
|