The foremost search engines, including Google, Bing and Yahoo!, use crawlers to find web pages for their algorithmic search effects. Webpages that are connected from other search engine indexed webpages never must be submitted because they are uncovered routinely. The Yahoo! Directory and DMOZ, two big directories which closed in 2014 and 2017 resp