What Googlebot does on your site?
by murda the funky space monkey on Sep.24, 2008, under MISC STUFF
New to this blog? I have tons of great articles that can benefit you. Don't miss the upcoming interesting articles, subscribe to my RSS. . Thanks for visiting!
Once Googlebot is on your site, it crawls each page in turn. When it finds an internal link, it will remember it and crawl it, either later that visit or on a subsequent trip to your site. Eventually, Google will crawl your whole site.
. However, for now the best analogy I can give you is to imagine that your site is a tree, with the base of the trunk being your home page, your directories the branches, and your pages the leaves on the end of the branches. Google will crawl up the tree like nutrients from the roots, gifting each part of the tree with its allimportant PageRank. If your tree is well structured and has good symmetry, the crawl will be even and each branch and leaf will enjoy a proportionate benefit. There is (much) more on this later.


