Anthropic
Claude-User
Fetches content in real time on behalf of a user's query when Claude needs to look up information on a specific webpage.
Purpose: Real-time content fetching for user queries
📊 Popularity & Traffic
User-initiated fetches for real-time information retrieval.
🤖 User Agent Strings
Use these patterns to identify Claude-User in your server logs or configure your robots.txt file.
Claude-User
Respects robots.txtFetches pages on-demand during Claude conversations
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; Claude-User/1.0🌐 IP Ranges
Source: Not published
No specific IP ranges published. Identify this bot using the User Agent strings above.
📝 Robots.txt Configuration
Add the following to your robots.txt file to block Claude-User:
User-agent: Claude-User
Disallow: /💡 Important Notes
- Blocking reduces your visibility in Claude's responses
- Separate from ClaudeBot - allows granular control
Beyond blocking crawlers
See what AI is saying about your brand
Understanding crawlers is step one. With Aiso, you can see the actual conversations happening about your brand inside ChatGPT, Claude, and Perplexity.