sus.bot

robots.txt audits: what your file tells search engines, AI crawlers and attackers.

Plans

• Free

  Everything you need to get started.

  • robots.txt starter guide

• Pro

  For teams that depend on their robots.txt.

  • robots.txt starter guide
  • Scheduled monitoring