RubyGems Navigation menu

cobweb 0.0.59

Cobweb is a web crawler that can use resque to cluster crawls to quickly crawl extremely large sites which is much more perofmant than multi-threaded crawlers. It is also a standalone crawler that has a sophisticated statistics monitoring interface to monitor the progress of the crawls.

Gemfile:
=

安裝:
=

版本列表:

  1. 1.2.1 January 09, 2021 (9.3 MB)
  2. 1.2.0 February 25, 2019 (9.3 MB)
  3. 1.1.0 November 06, 2015 (9.3 MB)
  4. 1.0.29 November 05, 2015 (9.3 MB)
  5. 1.0.28 March 20, 2015 (9.3 MB)
  6. 0.0.59 July 10, 2012 (9.3 MB)
顯示所有版本(共 94)

Runtime 相依性套件 (10):

haml >= 0
namespaced_redis >= 1.0.2
nokogiri >= 0
redis >= 0
resque >= 0
rspec >= 0
sinatra >= 0
thin >= 0

擁有者:

作者:

  • Stewart McKee

SHA 256 總和檢查碼:

=

總下載次數 331,753

這個版本 3,625

版本发布:

授權:

Ruby 版本需求:

相關連結: