Intelligent Web Crawler
Intelligent Web Crawler (iWC) offers specialized and directed web crawling service. iWC crawls pages in specific categories or languages to find desired and targeted web pages. It is able to crawl up to 300 pages simultaneously. It crawls web based on keywords or URLs with comprehensive accuracy and speed. It has a trainable searching procedure that is configurable through a user-friendly GUI and WUI. Usage of search engines like Google, Yahoo or Bing and usage of robots.txt standards are optional. iWC supports Ipv6 and 150 different languages.