Baidu web search results robots prompt online

I accidentally downloaded Taobao on Baidu at noon today. It was found that due to restriction instructions in the robots.txt file of this website, the system could not provide a content description of this page. Du Niang made an announcement below...
Have you ever encountered the phenomenon of no summary displayed on individual pages in Baidu search results before, or have you encountered a problem where some content on the website is not included? The webmaster platform reminds you that these two situations may be caused by the robots.txt file set up on the website. In order to make it easier for webmasters to understand whether the robot file is set when the above problems occur on the website page, a prompt for the robots.txt file has been launched in the Baidu web search results. When a website uses the robots.txt file to prohibit Baidu from including part or all of the website's content, Baidu will give a prompt for robots.txt in the search results to let the webmaster understand in time the reason why the website has no summary display in the search results. At the same time, you can click "Learn More" in the search results to view the detailed robots information of the website to confirm whether the ban was caused by the erroneous setting of robots.txt.
Introduction to robots.txt: robots.txt is the first file viewed by a search engine when visiting a website. This file is used to specify the crawl range of the spider on the website. Some websites use the robots.txt file to block part or all of the content of the website because there are content that they do not want to be included by search engines. If the website sets the robots.txt file for Baidu spider, Baidu will follow the robots protocol and not grab the blocked results. However, considering that users have the need to search for the website address in the search engine, the search results will display the website's title and URL based on the search needs, but will not display the website's summary.
Tips: You only need to use the robots.txt file if your website contains content that you don't want to be included by search engines. If you want search engines to include everything on your website, do not create robots.txt files. At the same time, in order to facilitate webmasters to quickly detect and generate robot files, Baidu webmaster platform has launched robots tools