Fix robots.txt
This commit is contained in:
+17
@@ -0,0 +1,17 @@
|
||||
# Robots.txt per giampy-dogservice
|
||||
|
||||
User-agent: *
|
||||
Disallow: /admin/
|
||||
Disallow: /logout/
|
||||
|
||||
User-agent: AhrefsBot
|
||||
Disallow: /
|
||||
|
||||
User-agent: SemrushBot
|
||||
Disallow: /
|
||||
|
||||
User-agent: DotBot
|
||||
Disallow: /
|
||||
|
||||
User-agent: MJ12bot
|
||||
Disallow: /
|
||||
Reference in New Issue
Block a user