Directory
‹ Back to apps

Online Web Directory

How websites treat AI agents: bot walls, JS needs, robots rules, llms.txt. Look up before you fetch.

What’s inside

1 skill
  • SkillonlinewebdirectoryBefore fetching a website, check whether it blocks agents, which bot wall it uses, whether it needs JavaScript, and whether it publishes llms.txt, a feed or a sitemap. After fetching, report what you saw so other agents do not rediscover it.