home / grids / Workers, Queues, and Tasks edit

Apps and services for running your Django apps in various parallel environments to the web server, freeing your project architecture from the HTTP-based service lifecycle:

* Construct daemons to batch-process large datasets
* Call functions on a recurring schedule
* Respond to system events
* Sync with external data sources without beach-balling

Use existing components (models, templates, &c) and your favorite Django design patterns in these new contexts as you need -- while including Pythonic batteries from disciplines beyond web development.

 

Standard View

Features currently being evaluated

FeatureDescription
Synopsis Packages' organizational style and method of Django integration
PackageDescriptionCategoryDownloadsLast UpdatedVersionRepoCommitsRepo watchersForksParticipantsLicenseSynopsis
Django-celeryOld Celery integration project for DjangoApp0March 31, 2014, 10:40 a.m.3.1.10Github718203ask
diegueus9
jezdez
jasonbaker
iamjstates
zpencerq
midiotthimble
davidfischer-ch
gtaylor
nvie
more...
BSDProvides a decorator syntax for defining tasks, which run in worker instances of your app, and a backend-agnostic protocol for serializing data between these workers and the web process.
django-signalqueueTruly asynchronous Django signals!App0Jan. 20, 2014, 9:44 p.m.0.5.1Github454fish2000
bitdeli-chef
BSDDefine and dispatch asynchronous Django signals, using the same semantics as their inbuilt synchronous counterparts. Originally developed for ImageKit -- https://github.com/jdriscoll/django-imagekit -- to decouple image pipeline processing from view functions. Offers a easily implemented engine API, an extensible JSON-based interprocess protocol; off-the-shelf backends leverage the characteristics of several Redis and relational datastructures.
django-ztaskA simple framework for backgrounding tasks with Django, built on top of ZeroMQ.App0June 5, 2012, 7:10 p.m.Github20729themartorana
jallum
chemt
bmorganpa
UNKNOWNA django-friendly interface to ZeroMQ -- http://www.zeromq.org/

Django-ztask offers a syntactically celery-esque decorator API for defining tasks. Function objects decorated for ztask have self-evidently named curried sub-functions as attributes, such that e.g. `yodogg(**opts)` can be simply changed to`yodogg.async(**opts)` to dispatch and run it asynchronously.

ZeroMQ is an amazing socket framework/protocol/convention, but django-ztask is written against it in such a manner such that function arguments must be able to survive pickling. The django-signalqueue API (which does some pickling itself, under-the-hood) exposes serialization methods _qua_ type, allowing such types as model instances to be transparently passed; tasks in ztask don't provide anything like this -- you have to hack your own object reference/serialization scheme or stick to the dict/list/tuple collection primitives; this is the library's biggest pain-point.
django-kitsuneHost server monitoring app for Django Admin. Allows to schedule checks on hosts and notify results to administrators by mail.App0July 23, 2013, 4:11 p.m.0.2.2Github465raulgarreta
amartinezuy
BSDA Django Admin app to perform host server monitoring. A control panel will be added to the Admin in order to configure hosts, checks and monitor check results. Notification rules can be defined to notify administrator users by mail.
hueya little multi-threaded task queue for pythonApp0April 3, 2014, 9:06 p.m.0.4.2Github33736coleifer
jbaiter
psyonara
hgdeoro
jaap3
asmedrano
lfriedrich
Psycojoker
swilcox
averagehuman
MIT License
django-rqA simple app that provides django integration for RQ (Redis Queue)App0Feb. 19, 2014, 6:22 p.m.0.6.1Github18034selwin
jeanphix
acjay
michaelbrooks
b7w
jmagnusson
bruth
svetlyak40wt
jarcoal
kennknowles
MITA simple app that provides django integration for RQ (http://python-rq.org)
jobtasticMake your user-responsive long-running Celery jobs totally awesomer.Other0March 21, 2014, 5:20 p.m.0.2.2Github16520winhamwr
kylegibson
abbasovalex
georgemarshall
coagulant
silviot
jacobwegner
BSD
django-rq-dashboardA dashboard for managing RQ in the Django adminApp0April 2, 2014, 5:17 p.m.0.2.1Github393brutasseCustom
django-chronographApp0March 5, 2013, 11:39 p.m.svn-r21-git.2Bitbucket6121wnielsonBSDProvides a master hook for the Cron daemon. Periodic tasks can then be defined within the Django admin panel -- no need to mess around with fragile crontab syntax with superuser privileges. Run any Django ./manage.py commands as needed: every minute, every day, or whatever in between.
PackageDescriptionCategoryDownloadsLast UpdatedVersionRepoCommitsRepo watchersForksParticipantsLicenseSynopsis
Search WeightPackageDescriptionLast PyPI release:Repo ForksWatchers
{{item.weight / max_weight * 100 | number:0}}%{{item.title}}Grid: {{item.description}} {{item.last_released | date: 'mediumDate'}} N/A {{item.repo_forks}} N/A {{item.repo_watchers}} N/A