Initially, site owners submitted the tackle of a website page, or URL to the different search engines, which would send a web crawler to crawl that site, extract hyperlinks to other pages from it, and return info observed within the site for being indexed.[five] By utilizing responsive design, robotic directives, https://www.youtube.com/watch?v=Oe36fe1qPtQ