Showing posts with label crawlers. Show all posts
Showing posts with label crawlers. Show all posts

Friday, 9 November 2012

Why is the Google algorithm so important?

Finding useful information on the ­World Wide Web is something many of us take for granted. According to the Internet research firm Netcraft, there are nearly 150,000,000 active Web sites on the Internet today [source: Netcraft]. The task of sifting through all those sites to find helpful information is monumental. That's why search engines use complex algorithms -- mathematical instructions that tell computers how to complete assigned tasks.
Googleplex Image Gallery
Google's algorithm does the work for you by searching out Web pages that contain the keywords you used to search, then assigning a rank to each page based several factors, including how many times the keywords appear on the page. Higher ranked pages appear further up in Google's search engine results page (SERP), meaning that the best links relating to your search query are theoretically the first ones Google lists.

For Web page administrators, being listed prominently on Google can result in a big boost in site traffic and visibility. In 2007, Google surpassed Microsoft as the most visited site on the Web [source: The San Francisco Chronicle]. With that much traffic, getting a good spot on a Google SERP could mean a huge boost in the number of site visitors.

Google's keyword search function is similar to other search engines. Automated programs called spiders or crawlers travel the Web, moving from link to link and building up an index page that includes certain keywords. Google references this index when a user enters a search query. The search engine lists the pages that contain the same keywords that were in the user's search terms. Google's spiders may also have some more advanced functions, such as being able to determine the difference between Web pages with actual content and redirect sites -- pages that exist only to redirect traffic to a different Web page.

­Keyword placement plays a part in how Google finds sites. Google looks for keywords throughout each Web page, but some sections are more important than others. Including the keyword in the Web page's title is a good idea, for example. Google also searches for keywords in headings. Headings come in a range of sizes, and keywords in larger headings are more valuable than if they are in smaller headings. Keyword dispersal is also important. Webmasters should avoid overusing keywords, but many people recommend using them regularly throughout a page.

In the next section, we'll learn about Google's patented Page Rank system.