Stable identity
Direct crawler requests use the same User-Agent and Web Bot Auth identity. The public verification key is published on this domain.
NBT BOT
NBT Bot runs website and ecommerce QA for our customers. We sign direct crawler traffic, follow site rules, pace requests, back off when a site tells us to, and do not change identity to get around a block.
NBTBot/1.0 (+https://nbt.bot/)"https://nbt.bot"Direct crawler requests use the same User-Agent and Web Bot Auth identity. The public verification key is published on this domain.
robots.txt, Crawl-delay, allowed scope and Content Signals are checked before normal crawling starts.
If several tests target the same site, they share the same site-level limits. Separate runs do not get to pile on independently.
If a site rate-limits, blocks or challenges us, we slow down or stop. We do not swap identity, proxy or transport just to force the request through.
Depending on the customer’s test, NBT can inspect public pages and assets, robots and sitemap files, products and variants, links, forms, rendered behaviour and customer journeys. Normal discovery is read-only. Any test that changes state has to be explicitly authorised for that customer and run.
For direct crawler traffic, we intend to register NBT in BotBase as an Intermediary with Monitoring & Operations and SEO behaviour. Our content-use level is reference. NBT is not a search-index or model-training crawler.
A User-Agent can be copied. If you need stronger proof, use our verification guide and the public Web Bot Auth key directory.
https://nbt.bot/.well-known/http-message-signatures-directory