stupid_crawler 0.2.0
Stupid crawler that looks for URLs on a given site. Result is saved as two CSV files one with found URLs and another with failed URLs.
Gemfile:
=
instalar:
=
dependencias de Runtime (1):
spidr
~> 0.6