User-agent: * Disallow: /web/ Allow: /web/assets/ Disallow: /web/login Disallow: /web/signup Disallow: /web/reset_password Disallow: /my/ Disallow: /*?* Allow: / User-agent: Googlebot Allow: / User-agent: Bingbot Allow: / User-agent: SemrushBot Allow: / User-agent: SemrushBot-SA Allow: / Sitemap: https://www.dartaw.com/sitemap.xml