mirrors/bootstrap
2
0
Fork 0
mirror of https://github.com/tenrok/bootstrap.git synced 2026-06-17 19:21:23 +03:00
Code Activity

Disallow crawling on Netlify. (#29194)

Browse Source
This commit is contained in:
XhmikosR
2019-08-03 17:09:25 +03:00
committed by GitHub
parent 8c3a1298f7
commit c93fdec2f0
5 changed files with 9 additions and 6 deletions
Download Patch File Download Diff File Expand all files Collapse all files
site/robots.txt
+3 -1
View File
@@ -3,7 +3,9 @@
# www.robotstxt.org/
{% if jekyll.environment != "netlify" -%}
# Allow crawling of all content
{%- endif %}
User-agent: *
Disallow:{% if jekyll.environment != "production" %} /{% endif %}
Disallow:{% if jekyll.environment == "netlify" %} /{% endif %}
Sitemap: {{ site.url }}/sitemap.xml