User-agent: * Crawl-delay: 10 Sitemap: https://scr.ru/sitemap.xml Allow: /404.html Allow: /404.md Allow: /ab/* Disallow: /assets/* Allow: /cc/* Allow: /consent/* Allow: /disclaimer/* Allow: /favicon.ico Allow: /gdpr-policy/* Allow: /github/* Disallow: /go*.html Disallow: /_img/* Allow: /index.html Allow: /index.md Disallow: /LICENSE Allow: /method/* Allow: /offer/* Allow: /README.md Allow: /result/* Allow: /robots.txt Allow: /security/* Allow: /value/* Disallow: /ya*.html