AI crawler access check

If your robots.txt blocks these crawlers, AI assistants cannot read your site — and cannot recommend you, no matter how good your content is.