The heavy task of a Web crawler lies in the large volume of Web pages, their high rate of change and the difficulty to avoid retrieving duplicate content.
举一反三
- 下列哪个选项不是因特网信息采集工具的英文名称（ ）？? Web spider|Web scraper|Web clipper|Web crawler
- The job of a Web crawler is to browse the World Wide Web.
- He thought that web pages which had the most links to them from other web pages must be the most popular.
- Cg is defined as the rate of change in volume per unit volume of gas under isothermal conditions.
- Web search engines store information about many web pages which are retrieved if by a spider.