[Answered ]-Store datapoints persistently before writing to database

by

1👍

✅

That sounds like a queue, background tasks, etc. You are right, it just displaces the issue, but queues are highly reliable as well.

The standard libs for doing this with Django and/or Rest Framework are:

  • Celery – Full featured, mature, pluggable queue backends
  • Django RQ – Simpler, uses only redis

Celery is probably the right starting point here, since it lets you use a "real" queue backend, but Django RQ+redis will also work if there isn’t a ton of load.

Without knowing anything more about your app or architecture, its hard to say more. There are a lot of queuing systems (Rabbit, ZeroMQ, AWS SQS, Google’s, etc). You can also look into building the queue+processor using, for example, AWS SQS and AWS Lambda Functions (or google versions).

👤Andrew

Leave a comment