valentineus/popov.link
valentineus/popov.link
0
Fork 0
Code Issues Pull Requests Actions Releases Activity

Simplification of forming a file 'robots.txt'

Browse Source 
Signed-off-by: Valentin Popov <info@valentineus.link>
This commit is contained in:
Valentin Popov 2018-09-15 18:00:53 +04:00
parent 862a62bc20
commit 085dc3feea
Signed by: Valentin Popov
GPG Key ID: 269A00ACA90A8EA3
2 changed files with 1 additions and 6 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
_data/robots_disallow.yml
View File

@ -1 +0,0 @@
- path: "/404.html"

6
_pages/robots.txt
View File

@ -5,9 +5,5 @@ layout: null
User-agent: * User-agent: *
Allow: {{ site.baseurl | relative_url | uri_escape }} Allow: {{ site.baseurl | relative_url | uri_escape }}
Disallow: {{ "/404.html" | relative_url | uri_escape }}
{% for link in site.data.robots_disallow %}
Disallow: {{ link.path | relative_url | uri_escape }}
{% endfor %}
Sitemap: {{ "sitemap.xml" | absolute_url | uri_escape }} Sitemap: {{ "sitemap.xml" | absolute_url | uri_escape }}