popov.link/_pages/robots.txt
Valentin Popov 7aff2fd186
Flexible exception list
Signed-off-by: Valentin Popov <info@valentineus.link>
2018-05-15 15:53:48 +04:00

14 lines
286 B
Plaintext

---
permalink: "robots.txt"
layout: null
---
User-agent: *
Allow: {{ site.baseurl | relative_url | uri_escape }}
{% for link in site.data.robots_disallow %}
Disallow: {{ link.path | relative_url | uri_escape }}
{% endfor %}
Sitemap: {{ "sitemap.xml" | absolute_url | uri_escape }}