Architecture Of search Engines
Spider – A browser-like program that downloads web pages.
Crawler ? A program that automatically follows all of the links on each web page.
Indexer – a program that analyzes web pages downloaded by the spider and the crawler.
Database? storage for downloaded and processed pages.
Results engine ? extracts search results from the database.
Web server ? a server that is responsible for interaction between the user and other search engine components.