Workers, Queues, and Tasks

Apps and services for running your Django apps in various parallel environments to the web server, freeing your project architecture from the HTTP-based service lifecycle:

* Construct daemons to batch-process large datasets
* Call functions on a recurring schedule
* Respond to system events
* Sync with external data sources without beach-balling

Use existing components (models, templates, &c) and your favorite Django design patterns in these new contexts as you need -- while including Pythonic batteries from disciplines beyond web development.

Features currently being evaluated

FeatureDescription
Synopsis Packages' organizational style and method of Django integration
Package huey Django-celery django-rq jobtastic Django Q django-ztask django-rq-dashboard django-pq django-chronograph django-kitsune django-signalqueue django-rq-jobs autotask django-admin-rq
Package huey Django-celery django-rq jobtastic Django Q django-ztask django-rq-dashboard django-pq django-chronograph django-kitsune django-signalqueue django-rq-jobs autotask django-admin-rq
Description a little task queue for python Old Celery integration project
for Django
A simple app that provides
django integration for RQ
(Redis Queue)
Make your user-responsive
long-running Celery jobs
totally awesomer.
A multiprocessing distributed
task queue for Django
A simple framework for
backgrounding tasks with
Django, built on top of
ZeroMQ.
A dashboard for managing RQ in
the Django admin
[UNMAINTAINED] A task queue
based on the elegant python RQ
but with a django postgresql
backend.
Host server monitoring app for
Django Admin. Allows to
schedule checks on hosts and
notify results to
administrators by mail.
Truly asynchronous Django
signals!
Provides scheduled jobs
management from the Django
Admin using Django-RQ
Django admin rq is a django
package that creates a 4 step
(form, preview, main,
complete) asynchronous
workflow from a ...
CategoryAppAppAppOtherAppAppAppAppAppAppAppAppAppApp
# Using This2621114320111101
Python 3?
Development Status Beta Production/Stable Beta Beta Beta n/a Alpha Alpha Unknown Unknown Beta Beta Beta Beta
Last updated May 5, 2016, 10:19 a.m. May 26, 2016, 5:19 p.m. May 16, 2016, 8:22 p.m. Feb. 4, 2016, 3:26 p.m. May 15, 2016, 5:30 a.m. June 5, 2012, 7:10 p.m. March 11, 2016, 9:13 a.m. Oct. 12, 2014, 10:39 p.m. March 5, 2013, 11:39 p.m. Nov. 6, 2014, 9:54 a.m. Jan. 20, 2014, 9:44 p.m. July 29, 2015, 8:34 a.m. April 29, 2016, 5:20 p.m. April 26, 2016, 4:54 a.m.
Version1.1.23.1.170.9.10.3.10.7.17n/a0.3.00.3.2svn-r21-git.20.2.30.5.10.1.5.10.5.30.1.1
RepoGithubGithubGithubGithubGithubGithubGithubGithubBitbucketGithubGithubGithubBitbucketGithub
Commits
Stars90088247835134722069696660531431
Repo Forks903101033824291873595111
Participantscoleifer
jbaiter
deathowl
hgdeoro
psyonara
72squared
mtyaka
miohtama
oz123
angvp
more...
ask
ionelmc
auvipy
diegueus9
jezdez
jasonbaker
iamjstates
nuklea
zpencerq
piotrbulinski
more...
selwin
lechup
jeanphix
acjay
wastrachan
b7w
michaelbrooks
philippbosch
viaregio
bruth
more...
winhamwr
jlward
midnightlynx
kylegibson
abbasovalex
georgemarshall
singingwolfboy
luzfcb
coagulant
silviot
more...
Koed00
Eagllus
thatmattbone
nickpolet
themartorana
jallum
chemt
bmorganpa
brutasse
olarin
mmsepyx
ihuro
spapas
nsbk
sbussetti
bretth
saulshanabrook
wnielsonraulgarreta
amartinezuy
fish2000
bitdeli-chef
Koed00
likeon
kbrProper-Job
Documentation N/A N/A N/A N/A N/A N/A N/A N/A N/A
SynopsisProvides a decorator syntax for defining tasks, which run in worker instances of your app, and a backend-agnostic protocol for serializing data between these workers and the web process.A simple app that provides django integration for RQ (http://python-rq.org)Multiprocessing worker pool

Django native

Encrypted and compressed task packages

Scheduled tasks

Result hooks

Result and Failure database

Redis, DIsque, IronMQ , SQS, MongoDB or ORM broker

Django Admin

Multi Cluster Monitor

Worker cpu affinity
A django-friendly interface to ZeroMQ -- http://www.zeromq.org/

Django-ztask offers a syntactically celery-esque decorator API for defining tasks. Function objects decorated for ztask have self-evidently named curried sub-functions as attributes, such that e.g. `yodogg(**opts)` can be simply changed to`yodogg.async(**opts)` to dispatch and run it asynchronously.

ZeroMQ is an amazing socket framework/protocol/convention, but django-ztask is written against it in such a manner such that function arguments must be able to survive pickling. The django-signalqueue API (which does some pickling itself, under-the-hood) exposes serialization methods _qua_ type, allowing such types as model instances to be transparently passed; tasks in ztask don't provide anything like this -- you have to hack your own object reference/serialization scheme or stick to the dict/list/tuple collection primitives; this is the library's biggest pain-point.
Provides a master hook for the Cron daemon. Periodic tasks can then be defined within the Django admin panel -- no need to mess around with fragile crontab syntax with superuser privileges. Run any Django ./manage.py commands as needed: every minute, every day, or whatever in between.A Django Admin app to perform host server monitoring. A control panel will be added to the Admin in order to configure hosts, checks and monitor check results. Notification rules can be defined to notify administrator users by mail.Define and dispatch asynchronous Django signals, using the same semantics as their inbuilt synchronous counterparts. Originally developed for ImageKit -- https://github.com/jdriscoll/django-imagekit -- to decouple image pipeline processing from view functions. Offers a easily implemented engine API, an extensible JSON-based interprocess protocol; off-the-shelf backends leverage the characteristics of several Redis and relational datastructures.Scheduled jobs management Django Admin plugin using Django-RQ

Supports once, daily, weekly, monthly, quarterly and yearly scheduled tasks.
Jobs can be limited to a set number of repeats.
Both regular tasks and management commands can be scheduled.
All tasks are queued to RQ , enabling a large payload schedule without delays.
Search WeightPackageDescriptionLast PyPI release:Repo ForksStars
{{ item.weight / max_weight * 100 | number:0 }}%{{ item.title }}Grid: {{ item.description }} {{ item.last_released | date: 'mediumDate' }} N/A {{ item.repo_forks }} N/A {{ item.repo_watchers }} N/A