AppShopper

iWebCrawler

       Mac OS

iWebCrawler is a web spider(crawler) application, iWebCrawler crawls Internet and retrieves plenty of Internet information with amazing speed. iWebCrawler offers downloading and saving network resources like web pages, audio/video/image binaries as well as documentations and applications to your local physical disk.
iWebCrawler has following characteristics
•High-speed performance of downloading Internet resources
•Wide scope of target network resources
•Configurable target resource types and properties.
•Configurable crawler behaviors (you can either let the crawler crawls a specific domain, or all domains belong to same company, or the whole Internet from being specified entry pages).
•Configurable domain filter.
•Configurable performance settings.
•Multi-threads-enabled resource downloading
•Asynchronous DNS querying
•Depth-prioritized crawling mechanism
•Use proxy for resource retrieving.

What's new

Changed the algorithm of the downloading controller, version 1.1.1 will crawl wider and deeper scope of resources than 1.0.1
Change the location of storing meta information.
Reduce the memory used.
Added downloading bandwidth control feature.
Added showing downloaded resource in Finder feature.
Added 2 more performance options in setting panel.
Fixed 2 UI bugs.
Fixed 1 backend-process bug.

Screenshots

	Screenshot 1 of 4

Share with Others

Last changed:

Nov 19, 2012

Category:

Productivity

Developer:

Lily Yu

Version:

1.1.1

Average Rating:

No data

Size:

2.5 MB

Other Apps By This Developer