This foss.in I managed to have long chats with Jace, Tarique and Mahendra over the design of retask project, a job/task queue for Python.
We discussed about various alternatives available and how they use those in their work. This lead to a more clear picture on requirements beyond my primary use cases.
Now we have asynchronous result communication between job producer and workers. We can also do blocking wait call on a job object (with an optional timeout value) till the worker returns a result.
You can find the code on github, please feel free to play with the examples (tutorials page) and provide suggestions on how to improve.