</> Java Source

Java Web Crawler

Inactive

Simple Java web crawling utility; supports the robots exclusion standard. Former Sun developer article; reference implementation.

Metadata

Category: Crawlers

License:Other

Homepage: https://web.archive.org/web/20080101000000/http://java.sun.com/developer/technicalArticles/ThirdParty/WebCrawler/