popov.link/_pages/robots.txt

---
permalink: "robots.txt"
layout: null
---

User-agent: *
Allow: {{ site.baseurl | relative_url | uri_escape }}
Disallow: {{ "/404.html" | relative_url | uri_escape }}
Sitemap: {{ "sitemap.xml" | absolute_url | uri_escape }}
robots.txt 2018-04-12 03:15:20 +03:00			`---`
			`permalink: "robots.txt"`
			`layout: null`
			`---`

			`User-agent: *`
			`Allow: {{ site.baseurl \| relative_url \| uri_escape }}`
Simplification of forming a file 'robots.txt' Signed-off-by: Valentin Popov <info@valentineus.link> 2018-09-15 17:00:53 +03:00			`Disallow: {{ "/404.html" \| relative_url \| uri_escape }}`
Flexible exception list Signed-off-by: Valentin Popov <info@valentineus.link> 2018-05-15 14:53:48 +03:00			`Sitemap: {{ "sitemap.xml" \| absolute_url \| uri_escape }}`