title: Globally accessible object across all Celery workers / memory cache in Django
body: <p>I have pretty standard Django+Rabbitmq+Celery setup with 1 Celery task and 5 workers.</p>
  <p>Task uploads <b>the same</b> (I simplify a bit) big file (~100MB) asynchronously to a number of remote PCs.</p>
  <p>All is working fine at the expense of using lots of memory, since every task/worker load that big file into memory separatelly.</p>
  <p>What I would like to do is to have some kind of cache, accessible to all tasks, i.e. load the file only once. Django caching based on locmem would be perfect, but like documentation says: &quot;each process will have its own private cache instance&quot; and I need this cache accessible to all workers.</p>
  <p>Tried to play with Celery signals like described in <a href="https://stackoverflow.com/questions/2129820/how-can-i-set-up-celery-to-call-a-custom-initialization-function-before-running-m/2145587#2145587">#2129820</a>, but that's not what I need.</p>
  <p>So the question is: is there a way I can define something global in Celery (like a class based on dict, where I could load the file or smth). Or is there a Django trick I could use in this situation ?</p>
  <p>Thanks.</p>