Originally, website owners submitted the address of a web site, or URL to the various search engines like google and yahoo, which would send out an online crawler to crawl that web page, extract back links to other internet pages from it, and return details observed over the web page https://www.youtube.com/watch?v=hgyQy18ZcIs