User-agent: * Allow: / # Private areas. Nothing here is public, and a crawler spending its budget on # login screens is budget not spent on the service pages. Disallow: /administrator/ Disallow: /admin/ Disallow: /radnik/ Disallow: /klijent/ Disallow: /login Disallow: /prijava Disallow: /moj-nalog Disallow: /zaboravljena-lozinka Disallow: /api/ Sitemap: https://eclectic.rs/sitemap.xml # Note for whoever edits this next: # # The long "Allow:" list that used to sit here did nothing — "Allow: /" already # permits everything, and the extra lines only made the file look considered. # # "Crawl-delay: 1" was also removed. Google ignores it outright, and Bing obeys # it: on a site this size it capped crawling for no benefit. Crawl rate belongs # in Search Console / Bing Webmaster Tools if it is ever genuinely a problem.