Scrapetron
projectsPython scraping with simple config
- Type
- App · 2022 · built before AI tools
- Built with
- Python · BeautifulSoup · Scrapy
- Reach
- 20 users
- Links
- PyPISource
- Install
pip install scrapetron
A Python web scraping framework built on BeautifulSoup and Scrapy with a simplified configuration interface. I kept rewriting the same scraper boilerplate for different projects, so I packaged the pattern into something reusable.
Commands
scrapetron init <name>Initialize a new scraping projectscrapetron runRun the configured scraperscrapetron export --format jsonExport results as JSON