![what are specialized search engines called what are specialized search engines called](https://miro.medium.com/max/948/0*AynTXrKeB45zSd5W.jpg)
![what are specialized search engines called what are specialized search engines called](https://developers.google.com/earth-engine/images/Code_editor_diagram.png)
But also, the crawler search engine could decide to stop supplying them with results at any time, maybe after seeing them as a threat or otherwise deciding not to collaborate anymore. Without being in the driver's seat, your experience is ultimately directed by the whim of underlying competitors. They don't have the capacity to identify and discriminate between ranking factors. But more specifically, metasearch engines can only use the limited data accessed from the crawler engine to re-arrange the results. Meta (from the Greek preposition μετά = "after", "beyond", "adjacent", "self") So if the end-user experience is ostensibly the same, why should you care about what type of search engine you're using? First, let's start with Wikipedia's definition of the word 'meta' to learn about what metasearch engines can't do: Incidentally, most search engines come under this category, with DuckDuckGo being perhaps the best example, Ixquick and Unbubble are two others also worth checking out. Further, they usually concentrate on front-end technologies such as user experience and novel ways of displaying the information. In many cases they bring in results from multiple search engines with the intention of delivering better results. These search engines don't have the arduous task of developing the required technology (the engine) and depend upon the crawlers to build their service on. If crawler-based search engines are the car, then you could think of metasearch engines as the caravans being towed behind. Notable/Web Scale Crawlers (English-language):Īnd yes, Mojeek is a crawler-based search engine! Metasearch Engines These are notoriously difficult and expensive to build from scratch, and you have to be just a little bit crazy to start one! :)
![what are specialized search engines called what are specialized search engines called](https://www.infidigit.com/wp-content/uploads/2020/09/Search-Engines.png)
You can think of these like the car - what you see and what you use - and the engine which moves you to your destination.
#WHAT ARE SPECIALIZED SEARCH ENGINES CALLED SOFTWARE#
They are called Crawler because the software produced crawls the web like a spider, automatically updating and adding new pages to its search index as it goes. These companies develop their own software that enables them to build and maintain searchable databases of web pages (the engine), and to organise those pages into the most valuable and pertinent way to the user. Generally speaking, you'll find two types of search engine:Ĭrawler-based search engines are what most of us are familiar with - mainly because that's what Google and Bing are. What is a Crawler-based Search Engine? (And Why it Matters)