Close

Правильный ли я составил robots.txt для своего сайта?

Правильный ли я составил robots.txt для своего сайта?

Код:

User-Agent: *
Allow: /wp-content/uploads/
Allow: /wp-content/themes/
Disallow: /wp-login.php
Disallow: /wp-register.php
Disallow: /xmlrpc.php
Disallow: /wp-admin
Disallow: /wp-includes
Disallow: /wp-content
Disallow: /tag
Disallow: /category
Disallow: /archive
Disallow: */page/*
Disallow: */trackback/
Disallow: */feed/
Disallow: */comments/
Disallow: /?feed=
Disallow: /search/*
Disallow: */itemlist/*
Disallow: */tag/*
Disallow: */item/*
Disallow: *.feed/

Sitemap: https://israel-escorts.com/sitemap.xml

User-Agent: Yandex
Allow: /wp-content/uploads/
Allow: /wp-content/themes/
Disallow: /wp-login.php
Disallow: /wp-register.php
Disallow: /xmlrpc.php
Disallow: /wp-admin
Disallow: /wp-includes
Disallow: /wp-content
Disallow: /tag
Disallow: /category
Disallow: /archive
Disallow: */page/*
Disallow: */trackback/
Disallow: */feed/
Disallow: */comments/
Disallow: /?feed=
Disallow: /search/*
Disallow: */itemlist/*
Disallow: */tag/*
Disallow: */item/*
Disallow: *.feed/

Host: https://israel-escorts.com
Sitemap: https://israel-escorts.com/sitemap.xml


Источник

Добавить комментарий