‹ Back to apps
Online Web Directory
How websites treat AI agents: bot walls, JS needs, robots rules, llms.txt. Look up before you fetch.
What’s inside
1 skill- SkillonlinewebdirectoryBefore fetching a website, check whether it blocks agents, which bot wall it uses, whether it needs JavaScript, and whether it publishes llms.txt, a feed or a sitemap. After fetching, report what you saw so other agents do not rediscover it.