Give AlbumentationsX a star on GitHub — it powers this leaderboard

scrapy/dirbot

Scrapy project to scrape public web directories (educational) [DEPRECATED]

Stars: 1,630Language: Python

View on GitHub Owner: scrapy

scrapy/dirbot - GitHub Repository | PyPI Leaderboard