Each search engine, whether it is Google, Yahoo, Bing or some other, use crawlers or robots to visit your website and collect data about it. These robots follow the links found in your web site to move from one page to next collecting all the text, meta tags, links and images they can find. Crawlers generally revisit your site regularly once they know it exists.