View all newsletters
Receive our newsletter - data, insights and analysis delivered to you
  1. What Is
June 21, 2016updated 22 Sep 2016 12:18pm

What is a search engine?

From spiders to indexing - CBR looks at how search results are gathered and ranked.

By Ellie Burns

A search engine, or web search engine, is software which is designed to search and retrieve information on the World Wide Web.

A search engine uses web crawling, indexing and search processes in near real-time in order to search information on the World Wide Web.

The first process used by a search engine is web crawling, whereby the search engine typically sends out a spider to go from website to website to fetch as many documents as possible. Then, via indexing, the information sent back by the spider is indexed.

Indexing depends on many factors, such as titles, page content, headings, or metadata in HTML meta tags, among other fators.

Indexing means associating words and other definable tokens found on web pages to their domain names and HTML-based fields. Usually when a user inputs a query into the search engine, the index already has the names of sites containing the keywords or phrases used in the query.

Search results are retrieved from the index and the engine usually employs an algorithm in which to rank the relevance and quality of each result. These algorithms are usually trade secrets and differ from engine to engine.

what is a search engine

Content from our partners
Green for go: Transforming trade in the UK
Manufacturers are switching to personalised customer experience amid fierce competition
How many ends in end-to-end service orchestration?

Websites in our network
Select and enter your corporate email address Tech Monitor's research, insight and analysis examines the frontiers of digital transformation to help tech leaders navigate the future. Our Changelog newsletter delivers our best work to your inbox every week.
  • CIO
  • CTO
  • CISO
  • CSO
  • CFO
  • CDO
  • CEO
  • Architect Founder
  • MD
  • Director
  • Manager
  • Other
Visit our privacy policy for more information about our services, how New Statesman Media Group may use, process and share your personal data, including information on your rights in respect of your personal data and how you can unsubscribe from future marketing communications. Our services are intended for corporate subscribers and you warrant that the email address submitted is your corporate email address.
THANK YOU