Home Page : Glossary : "W" : Web Scraper

Web Scraper

Web Scraper

1. To capture the information displayed on a single web page. This may be to either capture the entire content of a webpage or more typically to capture certain information from a web page. A web scraper is a simple development over the screen scraper technique.

2. To capture (and download) an entire website. A technique to capture and download a complete image of a website so it can be browsed off-line. This involves downloading each file used to render a web page on the site and to follow all the links on the site until every page and file has been downloaded. Web Scrapers - the tools that perform this capture and download - can typically be set to download an entire site or just portions of it.

Relevant links:

www.webstripper.net - A free-for-personal use web stripper.
www.httrack.com - Free open source website copier (i.e. web scraper)

Can you add to this definition? If so please Report an Observation. Do you know of a relevant link to add under this definition? If so please Add a Link.