Huawei

PetalBot

Huawei's official search engine crawler and its AI-specific training agent, PanguBot.

Purpose: Search indexing and Pangu LLM training

Quick Facts

Company
Huawei
Respects robots.txt
Yes
Last Updated
2025-05
Official Documentation

📊 Popularity & Traffic

PetalBot is particularly active on sites catering to global Huawei device users.

🤖 User Agent Strings

Use these patterns to identify PetalBot in your server logs or configure your robots.txt file.

PetalBot

Respects robots.txt

Official Huawei/PetalSearch crawler

PetalBot

PanguBot

Respects robots.txt

Huawei's AI-training specialized crawler

PanguBot

🌐 IP Ranges

Source: Huawei Cloud datacenters (AS136907)
Official source file

Identified IP Ranges1 Range

114.119.128.0/18
Subnet with 16384 addresses

How to read CIDR notation:

The /28 suffix indicates a block of 16 IP addresses. For example,.112/28 covers all addresses from .112 up to .127. Adding these to your firewall will block the entire range used by PetalBot.

📝 Robots.txt Configuration

Add the following to your robots.txt file to block PetalBot:

User-agent: PetalBot
Disallow: /

User-agent: PanguBot
Disallow: /

💡 Important Notes

  • Provides a unique 'PetalSpider-Referer' tag to help webmasters identify referral sources
  • PanguBot name comes from Huawei's 'PanGu' 100B+ parameter model
  • Verify PetalBot IPs via reverse DNS lookup - legitimate IPs resolve to *.aspiegel.com
  • Offers an API to verify the authenticity of crawler IPs

Other AI Crawlers

OpenAI

GPTBot

Model training data collection

OpenAI

OAI-SearchBot

ChatGPT search indexing and citations

OpenAI

ChatGPT-User

Real-time webpage fetching for user queries

Google

Googlebot

Search indexing and AI model training

Beyond blocking crawlers

See what AI is saying about your brand

Understanding crawlers is step one. With Aiso, you can see the actual conversations happening about your brand inside ChatGPT, Claude, and Perplexity.

Start Free TrialBook a Demo