User-agent: Yandex Disallow: /cgi-bin Disallow: /wp-admin Disallow: /wp-includes Disallow: /wp-content/plugins Disallow: /wp-content/cache Disallow: /wp-content/themes Disallow: /wp-trackback Disallow: /wp-comments Disallow: */trackback Disallow: */comments Host: https://rosservis-spb.ru User-agent: * Crawl-delay: 40 # задает таймаут в 40 секунд для всех поисковых роботов Disallow: /cgi-bin Disallow: /wp-admin Disallow: /wp-includes Disallow: /wp-content/plugins Disallow: /wp-content/cache Disallow: /wp-content/themes Disallow: /wp-trackback Disallow: /wp-comments Disallow: */trackback Disallow: */comments Sitemap: https://rosservis-spb.ru/sitemap.xml