Scraping and Crawling Tools Grid

Features currently being evaluated

FeatureDescription
Scrapy
Celery
Django versions
Package django-dynamic-scraper django-scraper
Description Creating Scrapy scrapers via
the Django admin interface
Django application which
crawls and downloads online
content following instructions
CategoryAppApp
# Using This00
Python 3?
Development Status Alpha Unknown
Last updated March 17, 2015, 10:08 a.m. March 12, 2015, 5:03 a.m.
Version0.3.100.2.3
RepoGithubGithub
Commits
Repo Watchers2816
Repo Forks962
Participantsholgerd77
zzpwelkin
joetric
rakanalh
zniper
Documentation
Package django-dynamic-scraper django-scraper
Scrapy , 0.16 (Scrapy 0.18+ not yet supported)
Celery , 3.0+ (Celery 3.1+ not yet tested)
Django versions , 1.4+ (also tested against Django 1.5, Django 1.6+ not yet supported)
Package django-dynamic-scraper django-scraper
Search WeightPackageDescriptionLast PyPI release:Repo ForksWatchers
{{ item.weight / max_weight * 100 | number:0 }}%{{ item.title }}Grid: {{ item.description }} {{ item.last_released | date: 'mediumDate' }} N/A {{ item.repo_forks }} N/A {{ item.repo_watchers }} N/A