A Web spidering library: handles robots.txt, scraping, finding more links, and doing it all over again.

Required Ruby Version

>= 2.5

Authors

John Nagro

Versions

  1. 0.8.0

    1. source

      1. 0.8.0 source July 06, 2026 (10 KB)
  2. 0.7.0

    1. source

      1. 0.7.0 source September 08, 2025 (10 KB)
  3. 0.6.0

    1. source

      1. 0.6.0 source September 08, 2025 (10 KB)
  4. 0.5.4

    1. source

      1. 0.5.4 source June 04, 2020 (15.5 KB)
  5. 0.5.3

    1. source

      1. 0.5.3 source April 23, 2018 (15 KB)
Show all versions (17 total)

Pushed by

johnnagro

SHA 256 checksum

← Previous version