User-Agent: * Disallow: /admin/ Disallow: /calc/ Disallow: /calculator/ Disallow: /Edu/ Disallow: /for_money/ Disallow: /for_semen/ Disallow: /not_used/ Disallow: /prex/ Disallow: /visitors/ # Запретить работу для offline-качалок. # User-Agent: DISCo Pump, Teleport Pro, WebSnake, Teleport # Disallow: / # User-Agent: Offline Explorer, MSIECrawler, NetVampire # Disallow: / # User-Agent: WebZIP, Web-By-Mail, Wget, Reget, GetRight # Disallow: /