Scraping and Crawling Tools Grid

Features currently being evaluated

FeatureDescription
Scrapy
Celery
Django versions
Package django-dynamic-scraper django-scraper
Package django-dynamic-scraper django-scraper
Description Creating Scrapy scrapers via
the Django admin interface
Django application which
crawls and downloads online
content following instructions
CategoryAppApp
# Using This00
Python 3?
Development Status Beta Unknown
Last updated June 18, 2015, 11:04 a.m. May 26, 2015, 2:18 a.m.
Version0.5.20.3.8
RepoGithubGithub
Commits
Stars3007
Repo Forks1062
Participantsholgerd77
zzpwelkin
joetric
rakanalh
zniper
Documentation
Scrapy , 0.16 (Scrapy 0.18+ not yet supported)
Celery , 3.0+ (Celery 3.1+ not yet tested)
Django versions , 1.4+ (also tested against Django 1.5, Django 1.6+ not yet supported)
Search WeightPackageDescriptionLast PyPI release:Repo ForksStars
{{ item.weight / max_weight * 100 | number:0 }}%{{ item.title }}Grid: {{ item.description }} {{ item.last_released | date: 'mediumDate' }} N/A {{ item.repo_forks }} N/A {{ item.repo_watchers }} N/A