3 Commits

Author	SHA1	Message	Date
Valentin Popov	085dc3feea	Simplification of forming a file 'robots.txt' ... Signed-off-by: Valentin Popov <info@valentineus.link>	2018-09-15 18:00:53 +04:00
Valentin Popov	7aff2fd186	Flexible exception list ... Signed-off-by: Valentin Popov <info@valentineus.link>	2018-05-15 15:53:48 +04:00
Valentin Popov	8050ce1f55	robots.txt	2018-04-12 00:15:20 +00:00