# Applies to all crawlers User-agent: * # Block access to internal or non-HTML resources Disallow: /assets/ Disallow: /test/ Disallow: /admin/ Disallow: /*.map$ Disallow: /*.ts$ Disallow: /*.json$ # if not needed publicly # Allow crawling of main Angular routes (everything else) Allow: /