The SimpleCrawler module is a library for crawling web sites. The crawler provides comprehensive data from the page crawled which can be used for page analysis, indexing, accessibility checks etc. Restrictions can be specified to limit crawling of binary files.
Required Ruby Version
>= 1.8.2
Authors
Peter Krantz
Versions
- 0.1.8 November 02, 2011 (6.5 KB)
- 0.1.7 May 03, 2009* (9.5 KB)
- 0.1.6 November 27, 2008* (6.5 KB)
- 0.1.4 September 16, 2008* (6.5 KB)
- 0.1.3 January 25, 2008* (6.5 KB)