1. Wrong ban
On the update of Baidu’s robots. txt, if you click “Detect and Update” multiple times, there will be a problem of being able to update frequently, but often unable to update. In this way, it is normal for things that should not be included to be banned on robots. txt and then deleted. So what is its problem? It’s not that the server is overloaded, but because the firewall mistakenly blacklisted some Baiduspiders.
2. Server Exception
Not to mention regular servers, as we all know, Beijing, Shanghai, and Guangzhou are generally good. But there are some special servers that most webmasters probably don’t know about? For example, the “Hong Kong and Taiwan server” of Western Digital is very interesting. Is it really from Hong Kong and Taiwan? What kind of Hong Kong and Taiwan do you consider if your computer room is located in China? Using a Hong Kong and Taiwan IP to avoid filing, all data is in China.
What’s wrong with this? We will find that the server on the site is CDN enabled, and even if you upload an image, it will display as a “302 status code”. The access speed has increased, but is this beneficial for SEO?
3. Unable to obtain the real IP address
Larger scale websites generally use CDN acceleration, but some sites not only use CDN acceleration for “devices”, but also for spiders. What is the result after that? If the CDN node is unstable, then this problem will be fatal for website spiders.
The reason why many large websites open their CDNs is that they are easily attacked, and at this time, if you don’t do “spider backtracking”, you can imagine it. Has your site done a CDN yet? Please log in to the Baidu webmaster platform to check if the spider can capture the real IP address!