RubyGems Navigation menu

spidercrawl 0.3.9

With the help of Nokogiri, SpiderCrawl will parse each page and return you its title, links, css, words, and many many more! You can also customize what you want to do before & after each fetch request.

Gemfile:
= Copy to clipboard Copied!

install:
=

Versions:

  1. 0.3.9 - March 10, 2016 (10.5 KB)

Runtime Dependencies (4):

colorize >= 0
curb >= 0
nokogiri ~> 1.6
typhoeus >= 0

Development Dependencies (2):

bundler ~> 1.7
rake ~> 10.0

Owners:

Authors:

  • Belson Heng

SHA 256 checksum:

= Copy to clipboard Copied!

Total downloads 2,732

For this version 2,732

License:

MIT

Required Ruby Version: >= 0

Links: