ABOUT META AND SPIDER IN SEARCH ENGINE

The term "search engine" (SE) is often misused to describe between directories and pure search engines. In fact, they are not the same, the difference lies in the way the results list generated.

There are four types of major search engines you need. They are:

    crawler-based (traditional, general) search engines;
    directories (mostly human user);
    hybrid engines (META engines and those who use the results of other engines);
    pay-per-performance engines and paid inclusion.

Crawler-based SES, also referred to as Spider or Web crawlers, which used special software to automatically and regularly visit the website to create and equip a giant repository of their Web pages.

This software is called a "bot", "robot", "spider" or "crawler". All of these terms indicate the same concept. These programs run on search engines. They browse the existing pages in the repository, and found your site by following links from that page. Or, after pages you have submitted to a search engine, this page is queued for scanning by a spider, and find your page by looking through the list of pages in the queue awaiting review.

Once the spider has found a page to scan, it took this page over HTTP (as usual Web surfers who type a URL into the browser address field and hit "enter"). As same as visitors, software will leave a note on your server about the visit. Therefore, it is possible to find out from your server log when search engines had stopped at the plantation online.

Your web server returns the HTML source code of your page spider. Spider then read while visitors can appreciate the quality of graphics and Flash animation impresses you have loaded into your page. A visitor usually does not read META tags, but the Spider can. Only experienced users might be curious enough to read the code of a page when looking for additional information on Web pages. A visitor will first see the biggest and most exciting on the page of text. on the other hand, spiders, will give more value to the text closest to the beginning and end of the page, and the text is wrapped in a link.

Perhaps you've spent a lot of money to create a killer web site that is designed to quickly captivate your visitors and get them admiration. You even embedded a lot of quality Flash animations and JavaScript tricks. However, the search engine spider is a robot which just saw that there are some photos on the page and some code that is embedded into the "<script>" tag are ordered to go through. The design element is an additional obstacle on the way to your content. What were the results? Page Rank of your pages is low, there is nothing to find on search engines, and no one is able to appreciate the design.

SEO (search engine optimization) is the solution to make your page more search-engine friendly. Optimization is mostly oriented crawler-based engines, the most popular on the Internet.

Let's go back to how the spider. After reading your page, it will hit them in a way that is easy to store in a giant repository of  Web pages called search engine index. Data is stored in a search engine's index possible way to quickly determine whether the page is relevant to a particular query and to pull it out to put in the page results shown in response to the request. The process of putting the pages in the index is referred to as "indexing". Once your page has been indexed, it will appear on the search engine result pages for words and phrases are most common on the web pages indexed. Position in the list, however, may vary.

Then, when someone is looking for a machine for a particular term, your page will be pulled out of the index and included in search results. Search engines are now applying advanced techniques to determine how relevant your page is these terms. Considered by many in the pages and pages and external factors are given a certain position, or rank, in other results found for surfing requests. This process is called "Rank".

Another approach to find broad internet is a multi-use search engine, or a meta-search engine that combines results from multiple search engines at the same time and put them in a results page that has been formatted. The common or natural language query translated to multiple search engines, each geared to find the requested information seekers. Search engines thus obtained responses are aggregated into a single list of results. This type of search allows the user to cover a lot of material in a very efficient manner, maintain some tolerance for improper search query or keyword.

Examples of multi-engine Meta Crawler (http://www.metacrawler.com) and Dogpile (http://www.dogpile.com). Referring Meta Crawler your search to seven of the most popular search engines (including Alta Vista and Lycos), then compiles and ranks the results to you.