Whitelisting Guide
Is your site showing a "blocked" error? Here's how to allow our crawler through your bot protection.
Quick Summary
If your site uses bot protection (Cloudflare, Sucuri, etc.), you'll need to whitelist our crawler. Add our User-Agent or IP addresses to your allowlist:
User-Agent
PixelHarborBot/1.0Full User-Agent String
PixelHarborBot/1.0 (+https://pixelharbor.io/bot; report@pixelharbor.io)Choose Your Platform
Other Platforms
For other WAF, firewall, or bot protection services, the general approach is:
- Access your security or WAF dashboard
- Find the bot management, allowlist, or whitelist settings
- Add our User-Agent:
PixelHarborBot/1.0 - Or add our IP addresses to your allowlist
- Save and apply the changes
If you're unsure how to whitelist crawlers on your platform, contact your hosting provider or security service's support team.
About Our Crawler
User-Agent
PixelHarborBot/1.0 (+https://pixelharbor.io/bot; report@pixelharbor.io)Behavior
- Respects robots.txt directives
- Honors Crawl-delay settings
- Default rate: 1 request per second
- Only downloads HTML and images (no form submissions)
- Does not execute logins or authentication
Purpose
Our crawler scans websites to discover and collect images for optimization. It's a benign bot that only reads publicly accessible content.
Need Help?
If you're still having trouble after whitelisting, or need our current IP addresses, contact us.
Contact Support