Reverse dependencies for robotstxt Latest version of the following gems require robotstxt

hostelify 0.8.4

scrapper for publicly accessible data from hostelworld hostelbookers etc.

120,244 Downloads

site_analyzer 0.3.17

Create site report for SEO many options.

45,669 Downloads

rwspider 0.4.3

RW Spider is an multithreading spider client written in Ruby designed to make easy th...

8,499 Downloads

Total downloads 31,833

For this version 17,331

Version Released:
February 13, 2010 8:43pm

Licenses:
N/A

Required Ruby Version: None

Required Rubygems Version: >= 1.2

Links:

Homepage Source Code Download Review changes Badge RSS Report abuse Reverse dependencies