Crawler - SEO Glossary
Another name for a search engine spider. A robotic program that visits and downloads web pages and stores them to be inspected by the search engines later.
Another name for a search engine spider. A robotic program that visits and downloads web pages and stores them to be inspected by the search engines later.