The SimpleCrawler module is a library for crawling web sites. The crawler provides comprehensive data from the page crawled which can be used for page analysis, indexing, accessibility checks etc. Restrictions can be specified to limit crawling of binary files.

Required Ruby Version

>= 1.8.2

Authors

Peter Krantz

Versions

  1. 0.1.8
    1. source

      1. 0.1.8 source November 02, 2011 (6.5 KB)
  2. 0.1.7
    1. source

      1. 0.1.7 source May 03, 2009 (9.5 KB)
  3. 0.1.6
    1. source

      1. 0.1.6 source November 27, 2008 (6.5 KB)
  4. 0.1.4
    1. source

      1. 0.1.4 source September 16, 2008 (6.5 KB)
  5. 0.1.3
    1. source

      1. 0.1.3 source January 25, 2008 (6.5 KB)
Show all versions (7 total)

SHA 256 checksum