eric/kestrelsnest-blog
1
0 Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Add robots.txt

Browse Source 
Allow all crawlers and point to the sitemap; the site had never served
one and /robots.txt returned 404.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
This commit is contained in:
Eric WagonerandClaude Fable 5 committed 2026-11-10 20:02:21 -05:00
1 parent 925c88f075
commit db156f3227
1 file changed
+4
Download Patch File Download Diff File Expand all files Collapse all files
static/robots.txt
+4
View File
@@ -0,0 +1,4 @@
User-agent: *
Allow: /
Sitemap: https://blog.kestrelsnest.social/sitemap.xml