COMPLIANCE
Clear identity, clear rules.
NBT is built around a simple idea: say who we are, respect the site’s rules and do not pretend a block means “try another way”.
Cloudflare
NBT uses Ed25519 Web Bot Auth for direct crawler identity. We intend to register in Cloudflare BotBase as an Intermediary service with Monitoring & Operations and SEO behaviour.
- Verification
- Request Signature / Web Bot Auth
- User-Agent match
NBTBot- Content use
- Reference
- Model training
- No
Current status
Shopify
NBT signs direct Shopify storefront crawling and can use a merchant-provided domain-bound crawler approval for the exact store it covers. Shopify or Cloudflare protection still slows or stops work; signing is not a bypass.
Site-owner rules
robots.txt, Crawl-delay, Content Signals, customer scope and site/provider pressure can all restrict or stop a test.
Customer identity in headers
Cloudflare is testing extra identity fields for intermediary bots. NBT does not put customer-identifying details into public request headers today. We would only add that after a privacy and security review.