cobweb 0.0.59

Cobweb is a web crawler that can use resque to cluster crawls to quickly crawl extremely large sites which is much more perofmant than multi-threaded crawlers. It is also a standalone crawler that has a sophisticated statistics monitoring interface to monitor the progress of the crawls.

Gemfile:
=

Installeer:
=

Versies:

1.2.1 January 09, 2021 (9,28 MB)
1.2.0 February 25, 2019 (9,28 MB)
1.1.0 November 06, 2015 (9,28 MB)
1.0.29 November 05, 2015 (9,28 MB)
1.0.28 March 20, 2015 (9,28 MB)
0.0.59 July 10, 2012 (9,27 MB)

Toon alle versies (94 totaal)

Runtime afhankelijkheden (10):

addressable >= 0

awesome_print >= 0

haml >= 0

namespaced_redis >= 1.0.2

nokogiri >= 0

redis >= 0

resque >= 0

rspec >= 0

sinatra >= 0

thin >= 0

Show all transitive dependencies

Eigenaren:

Authors:

Stewart McKee

cobweb 0.0.59

Gemfile:
=

Installeer:
=

Versies:

Runtime afhankelijkheden (10):

Eigenaren:

Authors:

SHA 256 checksum:

Total downloads 331.753

Voor deze versie 3.625

Versie vrijgegeven:
July 10, 2012 9:08am

Licenties:
N/A

Required Ruby Version: Geen

Links:

cobweb 0.0.59

Gemfile: =

Installeer: =

Versies:

Runtime afhankelijkheden (10):

Eigenaren:

Authors:

SHA 256 checksum:

Total downloads 331.753

Voor deze versie 3.625

Versie vrijgegeven: July 10, 2012 9:08am

Licenties: N/A

Required Ruby Version: Geen

Links:

Gemfile:
=

Installeer:
=

Versie vrijgegeven:
July 10, 2012 9:08am

Licenties:
N/A