What is a web search engine?
How do resources end up in a web search engine's database?
Most web search engines use automated tools and programs to gather resources. These
tools, often referred to as worms, spiders, crawlers, and robots, search thousands of
websites worldwide, collect information, and store the information in the database.