mirror of
https://github.com/searxng/searxng.git
synced 2025-12-23 12:10:00 +00:00
[mod] robots.txt update
This commit is contained in:
@@ -226,6 +226,7 @@ def robots():
|
||||
Allow: /
|
||||
Allow: /about
|
||||
Disallow: /stats
|
||||
Disallow: /engines
|
||||
""", mimetype='text/plain')
|
||||
|
||||
|
||||
|
||||
Reference in New Issue
Block a user