🛡️ SentinelCore

SentinelCore is an enterprise-grade, high-performance distributed event streaming and audit log processing engine designed for modern microservices architectures and high-throughput environments.

The platform asynchronously ingests log/event streams, persists them in a relational database, and routes critical events (such as CRITICAL severity errors) to a Celery & Redis task queue for real-time background execution, anomaly detection, and alert webhook triggers.

---

📋 Table of Contents

• Key Features
• System Architecture
• Tech Stack
• Directory Structure
• Quick Start
• Environment Variables (.env)
• API Documentation & Usage
• Running Tests
• Contributing
• License

---

✨ Key Features

• ⚡ High Throughput: Built on FastAPI and ASGI for non-blocking asynchronous request handling.
• 🔄 Distributed Background Tasks: Heavy background processes are offloaded from the primary API server to Celery workers using Redis Pub/Sub.
• 🗄️ Asynchronous ORM Layer: Fully asynchronous database transactions powered by SQLAlchemy 2.0 and asyncpg over PostgreSQL.
• 🛡️ Data Validation: Strict type safety and runtime schema validation enforced by Pydantic v2.
• 🐳 Fully Dockerized Environment: Single-command setup to orchestrate API nodes, Workers, PostgreSQL, and Redis instances via docker-compose.
• 🧪 Comprehensive Testing: Pre-configured integration test suite using pytest and httpx.

---

🏗️ System Architecture

               +-----------------------+
               |  Microservices / API  |
               +-----------+-----------+
                           |
                           | (HTTP POST /api/v1/events)
                           v
               +-----------------------+
               |   SentinelCore API    |
               |       (FastAPI)       |
               +----+-------------+----+
                    |             |
     (Async Save)   |             | (Enqueue Task)
                    v             v
          +-----------+         +-----------+
          | PostgreSQL|         |   Redis   |
          +-----------+         +-----+-----+
                                      |
                                      v
                                +-----------+
                                |  Celery   |
                                |  Workers  |
                                +-----------+