From 52cedf09285f8a23ac37b8846113222e1bcfd9be Mon Sep 17 00:00:00 2001 From: prachizala Date: Sun, 8 Nov 2026 20:46:55 +0530 Subject: [PATCH] docs: document enqueue idempotency and worker crash resilience Detailed documentation for Redis SETNX idempotency key mechanism and Celery worker crash resilience settings. Co-authored-by: Claude --- README.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/README.md b/README.md index 669d3ca..528b635 100644 --- a/README.md +++ b/README.md @@ -51,6 +51,8 @@ flowchart TD | Capability | Technical Implementation | Value | |---|---|---| | **Non-Blocking Ingestion** | FastAPI async endpoints + Uvicorn ASGI | Sub-millisecond job admission and horizontal throughput | +| **Enqueue Idempotency** | Redis `SETNX` via `Idempotency-Key` header with TTL cache | Prevents duplicate task dispatches & double-billing on network retries | +| **Crash-Resilient Workers** | Celery `acks_late=True` & `task_reject_on_worker_lost=True` | Automatic message requeue if a worker container OOMs or crashes | | **Distributed Task Queue** | Celery 5.4 + Redis 7 Broker | Handles heavy computation and external I/O without blocking user threads | | **Persistent Audit Logging** | PostgreSQL 16 + Async SQLAlchemy 2.0 | Complete execution history, error traces, and duration profiling | | **Intelligent Rate Limiting** | Redis Sliding Window / Token-Bucket (`ZADD`/`ZREMRANGEBYSCORE`) | Prevents API degradation from traffic spikes or DDoS |