Those of us who are in the position of website optimization, the main daily work is not only to keep thinking about the problems of users and produce a large number of high-quality internal significance, on the other hand, we should also take into account the search engine website, remove some of the stumbling blocks that do harm to the search engine website to understand our website. For example, a lot of websites are not optimized, which has caused the existence of a lot of spiders in the site, to the end of a good site by the search engine site repeatedly misjudged, if not for the ranking, and even caused a number of pages are abandoned by search engine sites. Because this is on the one hand we add in seo optimization office, the following is the specific Shaojie of Fang Kuai net.
Website optimization spider crawl rules
First, Flash plate
Indeed, Flash plate does give people the visual feeling effect is very good, from this point of view is actually very helpful to the user experience understanding, but it is a pity that the spider can only grab ordinary HTML code, the most favorite is the book deed information, and Flash in the eyes of the search engine site is just a link. It is very difficult to judge what is at the end of the inside item, which naturally also has disadvantages to the optimization of the site.
Two, Javascript script code
This basically and Flash is a principle, although can increase the pleasure of the site group, but very sorry to search engine site capture, and if the site has a lot of so JS will seriously affect the loading speed of the site, the site ranking is not smooth, which also belongs to a more serious spider pit.
Iii. Session ID
If a website considers it appropriate to use Session ID to track users, this is also a very nasty trap, because the moment the spider visits this site, no matter what sub-page, even if it is visited by the same page, will also show different ids. It is difficult to judge which url is the main page at all, and it may even be misjudged as the internal substance meaning of multiple pages of the website, which should be prevented.
Four, dynamic URL with various parameters
Website dynamic URL more, the site will mislead the search engine site, if the setting is not appropriate will also lead to search engine site judgment to the end of which is a regular page (similar to the principle of Session ID), and dynamic URL is also harmful to spiders grab, we should prevent, propose webmaster hand site to do a sudden static, And mask the url of the exception parameter.
Five, the page is frame frame structure
In the past, many people’s website is the use of the framework structure, this structure is code simplification, and very convenient we webmaster to update the protection of our website, however, this kind of structure spider is difficult to capture, basically can not grasp the internal significance of this, especially there are some close internal significance of the moment, it is greatly not smooth for optimization.
Six, we must visit the landing ability
This is completely can not be taken, after all, the search engine website spider is not a person, not so smart, he will not semi-automatic fill in the user name, password, verification code, this kind of thing page Settings to pay particular attention to.
7. Force Cookies
The principle is basically the same as above, search engine website spiders will not be intelligent according to the requirements to force the use of Cookies, then it will cause the page has no way to show normally so forced use of Cookies can only lead to search engine website spiders no way to visit normally.
Generally speaking, now also revealed the above said these spider pits are often caused by the master’s own fumbling. If you really have no way to absolutely take into account to avoid these pits, the proposed webmaster without prevention to see more of their own site included page snapshot, see if the snapshot revealed internal significance and page at all internal significance is different, especially in the case of some close internal significance revealed things, Then it is necessary to add meaning, it is likely to be due to their own website fell into the above mentioned some kind of spider pit. Therefore, in the site optimization to always understand the search engine spider crawl rules.
