Lookful

LookfulBot

Seen LookfulBot in your logs?

LookfulBot is the scanner behind Lookful. It visits pages because someone who manages the site added it to Lookful to check it for accessibility and privacy issues.

How to recognize it.

Page scans use a current Chrome user agent with this token at the end:

LookfulBot/0.1 (+https://lookful.us/bot)

When Lookful reads a site’s sitemap to suggest pages, it uses:

Mozilla/5.0 (compatible; LookfulBot/1.0; +https://lookful.us/bot)

What it does

  • Loads the pages the site’s manager picked: up to ten per site, at their chosen schedule
  • Reads robots.txt and sitemaps to suggest pages
  • Tabs through pages, opens menus and dialogs, and presses controls to test them
  • Loads pages a few times: as a new visitor, after accepting cookies and after rejecting them
  • Paces visits to the same site, so it never loads its pages in parallel

What it never does

  • Send form data: requests that would send data are blocked before they leave the page
  • Follow links off the site’s domain
  • Log in, or try to get past a bot wall or CAPTCHA; blocked pages are reported as blocked
  • Store cookie values

Don’t want it on your site?

If your firewall or bot protection blocks LookfulBot, Lookful stops at that page and tells the person who added your site that it was blocked. If someone added your site without your permission,send us a message and we’ll look into it.