stupid_crawler 0.2.1
Stupid crawler that looks for URLs on a given site. Result is saved as two CSV files one with found URLs and another with failed URLs.
Gemfile:
=
In die Zwischenablage kopieren
Kopiert!
installieren:
=
Runtime Abhängigkeiten (1):
spidr
~> 0.6
Besitzer:
Autoren:
-
Jacob Burenstam
SHA 256-Prüfsumme:
ae72100eb481ed5f6b51fd00233954cf60c847b3535ea57350fcbf26f5ca7659