Description
Get realtime analytics on the AI agents, crawlers, scrapers, and other bots visiting your website. Generate a robots.txt to opt out of AI training.
Track AI Agents and Bots on Your Website
Half of your traffic is invisible to you. Get realtime insight into the hidden ecosystem of artificial agents browsing, scraping, crawling, and gathering intelligence on your website. Protect your content from unwanted AI training with a robots.txt that stays up to date with the latest bots automatically.
Features
- Expose Your Hidden Traffic With Agent Analytics: Watch the activity of AI assistants, scrapers, and other bots browsing your website in real time.
- Keep Your Robots.txt Updated Automatically: Generate a robots.txt that continuously adds rules for the latest AI agents.
- Protect Your Content From Scraping: Block agents who try to ignore your robots.txt rules.
- Spot Spoofed Visits With Agent Verification: Detect bad actors pretending to be legitimate agents.
- Get Spike Alert Notifications: Find out when an agent’s traffic starts surging or overloading your server.
- Identify Top Agents and Pages: See which agents visit your website the most, and which pages they’re most interested in.
Demos
Links to demos can be found on the home page.
Further Detail
This plugin connects your website to Dark Visitors. It uses the Dark Visitors API to connect to your account and provide functionality.
By signing up, you agree to the Terms of Service and Privacy Policy.
Screenshots
An overview of all agent activity on the website 
A timeline of all agent visits to the website 
Insights into an agent’s activity on the website 
Insights into agents who are not following the website’s robots.txt rules 
Agent details including insight into how many websites are blocking it 
A generated robots.txt
Installation
- Install and activate the Dark Visitors plugin from the WordPress Plugin Directory
- Sign up for Dark Visitors and create a new project for your website.
- Copy your access token from the project’s settings page, then paste it into the access token field on the plugin’s configuration page.
Your website is now connected to Dark Visitors.
FAQ
-
Do I need a Dark Visitors account to use this plugin?
-
Yes. Setting up an account only takes a few seconds. This is where you’ll be able to see insights into agent activity on your website.
-
Is Dark Visitors free?
-
Dark Visitors is a freemium service. Most features are free, but you can choose to pay for premium features. More detail can be found on the pricing page.
-
What are some examples of agents?
-
Examples include GPTBot, CCBot, Claudebot, PerplexityBot, Googlebot, etc. See the full agent list for more.
-
Why should I care about agents?
-
There are many reasons. Their activity affects:
- Whether your content is used in AI model training
- If your users can use AI assistants to access your website
- How your pages appear in search engine results
- Server resource usage
- Etc.
Reviews
Contributors & Developers
“Dark Visitors” is open source software. The following people have contributed to this plugin.
Contributors
Translate “Dark Visitors” into your language.
Interested in development?
Browse the code, check out the SVN repository, or subscribe to the development log by RSS.
Changelog
1.18.0
- Code updates
1.17.0
- Code updates
1.16.0
- Code updates
1.15.0
- Code updates
1.14.0
- Code updates
1.13.0
- Code updates
1.12.0
- Code updates
1.11.0
- Code updates
1.10.0
- Code updates
1.9.0
- Code updates
1.8.0
- Copy changes
1.7.0
- Design updates
1.6.0
- Code cleanup
1.5.0
- Simplified the analytics code
1.4.0
- Added the option to block agents
1.3.0
- Added a small edge case fix
1.2.0
- Updated copy
1.1.0
- Added the ability to disable analytics
1.0.0
- Initial release