Skip to content
ModernOps888Public

About

Multi-Agent Code Evolution Platform: 4 LLMs compete, evolve, and breed code through a JIT compiler judge

Topics

Resources

Stars

14 stars

Watchers

1 watching

Forks

Repository files navigation

🔥 The Forge

Multi-Agent Code Evolution Platform

Version Python Vitalis License Multi-Vendor Cross-Platform

Multiple LLMs compete to solve coding challenges.
The Vitalis compiler is the impartial judge.
Evolution breeds the winners into code no single model could write.


Claude's elegance × GPT's brute force × Gemini's lateral thinking → native compiled code


The Forge Dashboard


💡 The Idea

Every AI coding agent generates code. None of them evolve it.

The Forge takes solutions from multiple LLMs, compiles them through a real JIT compiler (Vitalis), benchmarks them with statistical rigor, and then breeds the winners together — crossover, mutation, selection — for hundreds of generations.

The result: code that's measurably better than any single model wrote.

4 LLMs × 1 challenge × 100 generations = code no single model could write

🏗 Architecture

┌─────────────────────────────────────────────────────────────┐
│                  8. NATIVE DESKTOP BRIDGE                    │
│  File Explorer · VS Code · PowerShell · Clipboard Sync      │
├─────────────────────────────────────────────────────────────┤
│                  7. GOVERNANCE LAYER                         │
│  SHA-256 provenance · Policy engine · Circuit breaker        │
├─────────────────────────────────────────────────────────────┤
│                  6. MEMORY & SKILLS                          │
│  Working → Episodic → Semantic · Cosine retrieval · Decay    │
├─────────────────────────────────────────────────────────────┤
│                  5. SELF-IMPROVEMENT ENGINE                  │
│  LLM patching · AST validation · Fitness gating · Backup    │
├─────────────────────────────────────────────────────────────┤
│                  4. AGENT FACTORY                            │
│  18 artifact types · 9 languages · Auto-deploy + Marketplace │
├─────────────────────────────────────────────────────────────┤
│                  3. EVOLUTION LAYER                          │
│  KLS Stochastic Localization · Boltzmann · UCB · Lévy flight │
├─────────────────────────────────────────────────────────────┤
│                  2. COMPILER LAYER (Vitalis)                 │
│  Lex → Parse → Type-check → Lint → Capability → JIT → Exec  │
├─────────────────────────────────────────────────────────────┤
│                  1. ORCHESTRATION LAYER                      │
│  Multi-LLM dispatch · Budget tracking · Cost observability   │
└─────────────────────────────────────────────────────────────┘

🚀 Quick Start

Prerequisites

Tool Version Purpose
Python 3.12+ Orchestration engine
API Key Any vendor At least one: OpenRouter, Anthropic, OpenAI, Google, or DeepSeek
Ollama (optional) Latest Local GPU/CPU inference (qwen, llama, etc.)
Vitalis (optional) v60 JIT compilation backend (falls back to Python)

Install & Run

# Clone The Forge
git clone https://github.com/ModernOps888/the-forge.git
cd the-forge

# Install dependencies (minimal — mostly stdlib)
pip install -r requirements.txt

# Set at least one API key (see .env.example for all options)
# Windows PowerShell:
$env:OPENROUTER_API_KEY = "sk-or-v1-your-key-here"
# Or use direct vendor keys for lower latency:
$env:ANTHROPIC_API_KEY = "sk-ant-..."
$env:OPENAI_API_KEY = "sk-..."

# Linux/macOS:
export OPENROUTER_API_KEY="sk-or-v1-your-key-here"

# Launch the server + dashboard
python forge_server.py

# Open dashboard
# → http://localhost:8777

On first run the server generates a random API key and stores it in .forge_key (git-ignored). The dashboard fetches it automatically over loopback — you only need it yourself for direct curl/CLI access. See 🔐 Security below.

CLI Usage

# Run a demo tournament (mock providers, no API keys needed)
python forge_cli.py demo --generations 5 --population 10

# Compile a .sl snippet through Vitalis
python forge_cli.py compile "fn main() -> i64 { 42 }"

# Type-check without executing
python forge_cli.py check "fn main() -> i64 { 42 }"

# Run a full tournament from a challenge file
python forge_cli.py arena --challenge challenges/sort_integers.json --generations 20

# Interactive chat with any model
python forge_cli.py chat --model claude

# Multi-agent research (all models answer, then synthesize)
python forge_cli.py consensus "Best practices for Rust error handling"

# Build an artifact (4 models compete)
python forge_cli.py build "Build a GitHub webhook receiver with HMAC verification"

# Orchestrate a complex task
python forge_cli.py orchestrate "Design a microservice architecture for a payment gateway"

🏭 Agent Factory

The Factory is the crown jewel. Tell it what to build, and 4 models compete to write the best implementation.

from forge import factory_build

result = factory_build(
    description="Build a GitHub MCP server with PR review and issue triage tools",
    artifact_type="mcp_server",  # or "auto" to detect
)

print(result.leaderboard())
# Winner is auto-saved with all deployment config

Supported Artifact Types

Type Language What It Generates
agent Python Autonomous agent with tools, memory, multi-step reasoning
mcp_server Python MCP server with JSON-RPC, tool schemas, stdio transport
api Python FastAPI REST API with Pydantic models, CORS, OpenAPI docs
cli Python CLI tool with argparse, rich output, config management
pipeline Python Data pipeline with transform stages, validation, sinks
integration Python Third-party connector (Slack, GitHub, Notion)
sdk Python Client library with retries, auth, pagination
webhook Python Webhook receiver with HMAC verification, retry queue
rust_lib Rust Library crate with error types, tests, Cargo.toml
go_service Go Microservice with handlers, middleware, graceful shutdown
react_app TypeScript React/Next.js component with hooks, CSS, accessibility
terraform HCL IaC module with variables, outputs, remote state
workflow YAML GitHub Actions CI/CD workflow
extension TypeScript VS Code extension with package.json, tsconfig
docker Dockerfile Dockerfile + docker-compose.yml
skill Vitalis .sl Native JIT-compiled hot-path function
full_project Python Multi-file production project scaffold with tests & Docker
lean4_proof Lean 4 Formal mathematical proof & invariant specification (kernel trust level zero)

Scoring Pipeline

LLM Generation (4 models)
        ↓
Vitalis Heuristic Scoring (sub-µs, native Rust)
  • Line count, import density, error handling, complexity
        ↓
LLM Semantic Scoring (Gemini, cheapest model)
  • Correctness, completeness, security, quality, production-readiness
        ↓
Final Score = 40% LLM + 60% Heuristic
  (We trust math over LLM self-evaluation)
        ↓
Winner saved + auto-deployed with config files

Auto-Deployment

Every artifact type gets full deployment wiring:

Type Generated Files
mcp_server server.py, mcp.json (Cursor), vscode-mcp-snippet.json, README.md
api main.py, requirements.txt, Dockerfile, docker-compose.yml, .env.example
cli tool.py, pyproject.toml, run.sh
agent agent.py, requirements.txt, run.sh, agent.service (systemd)
rust_lib src/lib.rs, Cargo.toml
go_service main.go, go.mod, Makefile, Dockerfile
react_app Component.tsx, package.json
terraform main.tf, backend.tf, terraform.tfvars.example
full_project Multi-file tree parsed from # === FILE: path === markers + README.md
lean4_proof Proof.lean, lakefile.lean, lean-toolchain, README.md (kernel trust level zero)

🧬 Evolution Engine

Not a basic genetic algorithm. This is research-grade evolutionary computation powered by native Rust hotpaths and KLS Stochastic Localization.

Selection Algorithms

Algorithm Purpose
KLS Stochastic Localization Tilt Selection Continuous measure-tilting (stochastic_localization_select) over isotropic 64D n-gram embeddings with dimension-free $O(1)$ KLS/Poincaré spectral mixing (Song & Zhang 2026)
Multi-Trajectory Dead-End Pruning Eliminates stagnant lineages lagging the Pareto front and supports human-director trajectory steering (director_hook)
Boltzmann (Softmax) Selection Temperature-controlled exploration/exploitation. T→0 = greedy, T→∞ = random
Bayesian UCB1 Multi-armed bandit — try under-explored solutions more
Elite Passthrough Top N individuals survive unchanged
Quantum-Inspired Annealing Probabilistically accept worse solutions to escape local optima

Crossover Operators

Operator What It Does
Uniform Crossover For each line, randomly pick from parent A or B
Single-Point Crossover Swap tails at a random body line
AST-Aware Crossover Swap entire brace-depth blocks between parents (prevents syntax breaks)

Mutation Operators

Operator What It Does
Swap Lines Swap two adjacent body lines
Insert Guard Add an early-return guard clause
Change Constant Alter a numeric literal by a Lévy-flight step
Add Comment Inject a descriptive comment (drives novelty score)
Rename Variable Rename a variable for code distance

The 6 Fitness Dimensions

Dimension Weight Source
Correctness 30% Test case pass rate
Performance 25% Relative execution speed, algorithmic complexity
Code Quality 15% Structure, naming, documentation, type hints
Robustness 15% Error handling, input validation, edge cases
Efficiency 10% Memory patterns, allocations, streaming
Novelty 5% Code distance from population (prevents convergence)

🔒 The 7 Compiler Gates

Every submission passes through 7 gates before being scored:

Source → LEX → PARSE → TYPE CHECK → LINT → CAPABILITY → COMPILE → EXECUTE
          ↓      ↓         ↓          ↓        ↓          ↓         ↓
        Reject  Reject   Reject    Score    Reject     Reject    Score

If any gate fails, the submission is eliminated. The compiler is the impartial judge — it doesn't care which LLM wrote the code.


🧠 Three-Tier Memory

┌──────────────────────────────────────────┐
│  Tier 1: WORKING MEMORY (in-RAM)         │
│  Per-session, cosine dedup via Vitalis    │
│  Max 30 entries, importance-weighted      │
├──────────────────────────────────────────┤
│  Tier 2: EPISODIC MEMORY (JSON on disk)  │
│  EMA importance decay, 500 entry limit    │
│  Automatic eviction of low-importance     │
├──────────────────────────────────────────┤
│  Tier 3: SEMANTIC (Skills + Instructions)│
│  Injected into system prompts            │
│  Boltzmann-selected based on query match │
└──────────────────────────────────────────┘

Skills are context-aware prompt injections. When you ask about debugging, the debugging skill activates and enriches the system prompt. Skills have fitness scores that update via adaptive fitness scoring.

Instructions are standing orders (e.g., "Be concise", "Use type hints") that persist across sessions.


🛡️ Self-Improvement Engine

The Forge can modify its own source code:

User instruction → LLM generates line-range patches
                          ↓
                    JSON repair layer
                          ↓
                    AST syntax validation (Python)
                          ↓
              ┌─── Fitness Gate ───┐
              │  Baseline score    │
              │  Mutant score      │
              │  Regression? BLOCK │
              │  Below floor? BLOCK│
              └────────────────────┘
                          ↓
                    Auto-backup (.bak)
                          ↓
                    Overwrite + hot-swap

Safety layers:

  1. JSON repair (fix truncated LLM output)
  2. AST dry-run before overwrite
  3. 6-dimensional fitness scoring — no regressions allowed
  4. Quality floor (30/100 minimum)
  5. Auto-backup before every write
  6. Hot-swap only when patching the server itself

🔐 Security

The Forge's HTTP server can spend money, read/write files, and — if you opt in — run shell commands. It's hardened as follows:

Control Behavior
Auth Every /api/* route (except /api/health) requires an X-Forge-Key header (or Authorization: Bearer <key>). Set FORGE_API_KEY yourself, or let the server auto-generate one into .forge_key on first run (git-ignored).
Bind address Defaults to 127.0.0.1 (loopback-only). Set FORGE_BIND_HOST=0.0.0.0 only if you deliberately want LAN/remote access.
CORS Access-Control-Allow-Origin is only echoed back for localhost/127.0.0.1 origins — no wildcard for arbitrary sites.
Shell execution The cowork agent loop's <execute_powershell> tags and GUI keystroke automation are disabled by default. Enable with FORGE_ALLOW_SHELL_EXEC=true, and even then every command is checked against the governance PolicyEngine before it runs.
Path jailing Self-improve patch targets and generated-artifact deploys are resolved and confined to the project root — no writing outside the repo.
Secret files /api/analyze-file refuses to read files matching common credential patterns (.env, .pem, id_rsa, .aws/credentials, etc.).
Budget gate Every LLM-calling endpoint checks the cost tracker first and returns 402 once FORGE_BUDGET_USD is exhausted, instead of spending past the cap.
Fitness gate (fail-closed) If the self-improvement sandbox can't evaluate a patch, the patch is rejected rather than applied.
Governed deploys Every artifact from the Agent Factory is checked by the PolicyEngine (AST-based dangerous-call detection, not just substring matching) before deployer.py will compile and run it.

Local-only tool, not a public service. The Forge is designed to run on your own machine for your own use. Don't put it on the public internet — the auth key is a shared secret, not a full identity/authorization system, and features like self-improvement and shell exec are inherently high-privilege.


🔗 Governance & Provenance

SHA-256 Provenance Chain

Every action is recorded in a tamper-evident, hash-chained ledger:

entry = ProvenanceEntry(
    timestamp=time.time(),
    event_type="factory_complete",       # submission, compilation, mutation, promotion...
    entity_id="run_a1b2c3d4",
    actor="factory",
    data={"winner_provider": "claude", "score": 87.2},
    parent_hash="previous_entry_sha256",
    entry_hash="sha256(timestamp|type|id|actor|data|parent)",
)

Modify any entry → all subsequent hashes invalidate → tamper detected.

Policy Engine

Policy Enforcement
No file system access Compile-time capability check
No network access Compile-time capability check
No process execution Compile-time capability check
Budget enforcement Halt all calls when budget exhausted
Type safety Type-check must pass before JIT
Timeout enforcement Kill execution exceeding limit
Regression prevention Champion must beat current best
Novelty threshold Reject <10% code distance

Circuit Breaker

Protects against cascading API failures:

  • Closed → normal operation
  • Open → blocks all calls after N consecutive failures
  • Half-open → allows one test call after cooldown

💰 Budget & Cost Tracking

Every API call is traced with:

Metric Tracked
Input/output tokens Per request
Cost (USD) Per request, per provider
Latency Per request (ms)
EMA spike detection Alert on anomalous costs
Per-provider breakdown Who's expensive, who's cheap
Budget enforcement Hard cap with remaining balance
Optimization hints "Switch to Gemini for 3x savings"
tracker = get_tracker(BudgetConfig(max_budget_usd=50.0))
# Every call auto-records. Dashboard shows real-time spend.

🖥️ Live Dashboard

The Forge ships with a full interactive dashboard at http://localhost:8777:

Chat View with Model Badges

Tab Features
Chat Multi-model chat with vendor badges (DIRECT/OPENROUTER/LOCAL)
Cowork Desktop co-work agent with native OS hooks
Research Fan query to multiple models, consensus synthesis
Build Agent Factory — 4 models compete, leaderboard scoring
Compile Vitalis .sl code compilation & execution
Dashboard KPIs, Compute & Platform panel, Vendor Routing matrix
Orchestrate Multi-step complex task execution
Evolve Self-improvement engine with fitness gating
Trace Execution traces + Human-in-the-Loop approvals
Antigravity IDE export inbox

Dashboard Highlights

  • 6 KPI Cards: Total Cost, Tokens, Requests, Active Vendors, GPU Count, Vitalis Version
  • Compute & Platform Panel: Detected GPU (name, VRAM bar), OS badge, CPU cores, RAM, compute mode selector
  • Vendor Routing Matrix: Shows which vendors are ACTIVE/INACTIVE with IDE export targets
  • Real-time telemetry: CPU%, RAM%, GPU% with VRAM utilization in the top bar

🐍 Python SDK

from forge import Arena, ArenaConfig, Challenge

# Define a challenge
challenge = Challenge(
    name="Fibonacci",
    description="Compute the nth Fibonacci number",
    function_signature="fn fib(n: i64) -> i64",
)

# Create arena
arena = Arena(config=ArenaConfig(max_generations=50))
arena.register_provider("claude", my_claude_api)
arena.register_provider("gpt", my_gpt_api)

# Run tournament
tournament = arena.run(challenge)

# Get the champion
print(f"Winner: {tournament.champion.fitness.total}")
print(tournament.champion.source_code)

Multi-Agent Research

from forge import multi_agent_research, consensus

# Ask all models the same question
results = multi_agent_research("Best Rust error handling patterns")
# → {"claude": "...", "gpt": "...", "gemini": "...", "deepseek": "..."}

# Or get a synthesized consensus
result = consensus("Compare actor model vs CSP for Go concurrency")
# → {"individual": {...}, "consensus": "merged answer", "cost_usd": 0.003}

Smart Router

from forge import auto_route

# Automatically picks cheapest model that can handle the task
answer = auto_route("What's 2+2?")           # → Gemini Flash (cheapest)
answer = auto_route("Design a payment API")   # → Claude (premium)

🔧 Model Registry & Multi-Vendor Routing

October 2026 frontier and open-weight model matrix:

Name Model ID Tier Routing
claude-fable anthropic/claude-fable-5-1 Ultra / Elite Direct → OpenRouter fallback
claude-mythos anthropic/claude-mythos-5 Ultra / Elite Direct → OpenRouter fallback
claude-opus anthropic/claude-opus-5-5 Ultra / Elite Direct → OpenRouter fallback
claude anthropic/claude-sonnet-5-5 Premium Direct → OpenRouter fallback
gpt openai/gpt-6-astra Premium Direct → OpenRouter fallback
gpt-sol openai/gpt-6.1-sol Premium Direct → OpenRouter fallback
gemini google/gemini-4-argon Premium Direct → OpenRouter fallback
gemini-pro google/gemini-3.8-pro Premium Direct → OpenRouter fallback
grok x-ai/grok-4.7 Premium Direct (XAI_API_KEY) → OpenRouter fallback
deepseek-r1 deepseek/deepseek-r1 Premium Direct → OpenRouter fallback
o3 openai/o3 Premium Direct → OpenRouter fallback
o3-mini openai/o3-mini Premium Direct → OpenRouter fallback
claude-haiku anthropic/claude-haiku-5-5 Fast / Economy Direct → OpenRouter fallback
gpt-mini openai/gpt-5 Fast / Economy Direct → OpenRouter fallback
gpt-nano openai/o3-mini Fast / Economy Direct → OpenRouter fallback
gemini-lite google/gemini-3.8-flash Fast / Economy Direct → OpenRouter fallback
deepseek deepseek/deepseek-chat Fast / Economy Direct → OpenRouter fallback
llama-3.3 meta-llama/llama-3.3-70b-instruct Fast / Economy OpenRouter / Ollama
qwen-local qwen2.5-coder:7b Local Ollama (GPU/CPU/Split)
llama-local llama3.2:latest Local Ollama (GPU/CPU/Split)
codellama codellama:7b Local Ollama (GPU/CPU/Split)
mistral-local mistral:latest Local Ollama (GPU/CPU/Split)
phi-local phi3:mini Local Ollama (GPU/CPU/Split)

Note on reasoning & frontier models: direct Anthropic calls to the Claude 5.x family omit sampling parameters (temperature is rejected with a 400 on these models) — steering is prompt-only. Direct OpenAI calls to o1/o3/o4 reasoning models automatically send max_completion_tokens and omit temperature.

Smart Routing

The Forge uses a smart routing strategy:

  1. Direct vendor key present? → Call vendor API directly (lowest latency)
  2. No direct key? → Fall back to OpenRouter (universal relay)
  3. Local model? → Route to Ollama with hardware-aware num_gpu
Anthropic key → api.anthropic.com (direct, ~200ms)
No key         → openrouter.ai/api (relay, ~400ms)
qwen-local     → localhost:11434 (Ollama, GPU/CPU)

🖥 Compute & Hardware

The Forge auto-detects available hardware for local inference:

Platform GPU Detection RAM Detection
Windows nvidia-smi (NVIDIA) wmic / psutil
Linux nvidia-smi (NVIDIA), rocm-smi (AMD) psutil
macOS Apple Silicon (unified memory) psutil

Compute Modes (FORGE_COMPUTE)

Mode Behavior Use Case
auto Detect GPU, fallback to CPU Default — works everywhere
gpu Force all layers on GPU Dedicated GPU machines
cpu Force CPU-only (num_gpu=0) No GPU, 16GB+ RAM
split Split layers across GPU+CPU Limited VRAM (4-6GB)

The dashboard's Compute & Platform panel shows detected hardware in real-time:

  • GPU name, VRAM total/free with usage bar
  • Platform badge (🪟 Windows / 🐧 Linux / 🍎 macOS)
  • CPU cores, system RAM with capacity bar
  • Active compute mode selector visualization

📊 Statistical Rigor

The Forge doesn't use vibes. Every comparison uses proper statistics:

  • Welford's algorithm for numerically stable online mean/variance
  • 95% confidence intervals via Student's t distribution
  • Welch's t-test for comparing two candidates with unequal variance
  • Cohen's d effect size measurement
  • MAD-based outlier detection (modified Z-score)
  • Minimum 30 runs before declaring significance
  • Pareto front computation for multi-objective optimization

📁 Project Structure

the-forge/
├── forge/
│   ├── __init__.py           # Package exports (v2.4.0)
│   ├── models.py             # Data models (Challenge, Submission, FitnessScore, etc.)
│   ├── compiler.py           # Vitalis JIT + CLI + sandboxed pure-Python .sl interpreter (7 gates)
│   ├── benchmark.py          # Welford stats, Student's t 95% CI, Welch's t-test, MAD outliers
│   ├── evolution.py          # Crossover, mutation, Boltzmann/UCB selection, quantum annealing
│   ├── arena.py              # Multi-LLM tournament orchestrator with provenance & test runner
│   ├── factory.py            # Agent Factory (17 artifact types, 8 languages, auto-deploy)
│   ├── deployer.py           # Policy-governed auto-deployment wiring for all 17 artifact types
│   ├── fitness_engine.py     # 6-dimensional polyglot code scoring (Python/TS/Rust/Go/HCL/YAML/Docker/.sl)
│   ├── providers.py          # Smart-routed Direct Vendor + OpenRouter + Ollama LLM providers
│   ├── budget.py             # Thread-safe cost tracking, pre-update EMA spike detection
│   ├── governance.py         # SHA-256 provenance chain, 10-rule AST policy engine, circuit breaker
│   ├── memory.py             # Thread-safe 3-tier memory (working/episodic/semantic)
│   ├── marketplace.py        # Portable skill & artifact marketplace registry
│   ├── skills.py             # Cryptographic Skill DNA certification from compilation
│   ├── tracer.py             # Bounded execution traces + HITL approval gates
│   ├── replay.py             # Deterministic tournament replay & A/B testing (`run_ab_test`)
│   └── vitalis_ffi.py        # Vitalis Rust FFI bindings (234K LOC of bindings)
├── tests/
│   ├── test_forge_comprehensive.py # Full 11-part end-to-end verification suite
│   └── test_forge.py         # Test runner entry point
├── dashboard/
│   └── index.html            # Full interactive dashboard (single-file, zero external JS deps)
├── challenges/
│   └── sort_integers.json    # Example challenge definition
├── forge_server.py           # ThreadingHTTPServer API server (2,100+ lines)
├── forge_cli.py              # Full CLI entry point (9 subcommands)
├── forge_desktop.py          # Native Windows desktop tray & Explorer context menu bridge
├── forge_mcp.py              # MCP server interface (13 tools over JSON-RPC 2.0 stdio)
├── launch.ps1                # Windows PowerShell launcher
├── requirements.txt          # Minimal dependencies
└── README.md

🔌 API Reference

REST Endpoints

Method Endpoint Description
POST /api/chat Send message to any model
POST /api/research Fan query to selected models
POST /api/consensus All models + synthesis
POST /api/compile Compile .sl code via Vitalis
POST /api/build Agent Factory — build any artifact
POST /api/deploy Deploy a factory result
POST /api/orchestrate Multi-step complex task execution
POST /api/score Score code with fitness engine
POST /api/self-improve Self-improvement patching
POST /api/cowork Desktop co-work agent
POST /api/quick-chat Stateless single-shot chat
POST /api/analyze-file AI code review of local file
POST /api/export Export to IDE bridge (multi-target)
POST /api/native Native OS bridge (explorer/IDE/terminal)
POST /api/transcribe Local Whisper voice-to-text transcription
POST /api/hitl/resolve Approve or reject a pending Human-in-the-Loop request
GET /api/health System health + active vendors (public)
GET /api/auth-bootstrap Loopback-only API key bootstrap for local dashboard
GET /api/models Available models + pricing + vendor badges
GET /api/budget Cost & token report
GET /api/provenance Governance audit trail
GET /api/memory Memory system stats
GET /api/traces Execution traces with step durations
GET /api/hitl/pending Pending Human-in-the-Loop approval gates
GET /api/system Real-time CPU, RAM, and GPU telemetry
GET /api/artifact-types Supported Agent Factory artifact types & languages
GET /api/marketplace Published skills & artifacts in the marketplace
GET /api/ag-inbox Antigravity IDE inbox items
GET /api/vendor-health Vendor connection status
GET /api/compute Hardware detection (GPUs, CPU, RAM)
GET /api/ide-targets Configured IDE export targets

MCP Tools (forge_mcp.py — 13 Tools over JSON-RPC 2.0 stdio)

Tool Description
vitalis_score 6-dimensional polyglot code fitness evaluation (0-100 + grade A+ to F)
forge_compile Compile & execute .sl code through the 7-gate Vitalis pipeline
forge_benchmark Benchmark .sl code across $N$ runs with Welford stats & 95% Student's $t$ CI
forge_build Multi-LLM Agent Factory competition across 17 artifact types
forge_orchestrate Architect + multi-model competitive challenge generation & evolution
forge_research Multi-agent parallel research query
forge_consensus Multi-agent query + authoritative synthesis
forge_chat Cost-tracked chat with any configured cloud or local model
forge_budget Live spend, token counters, per-provider breakdown, and optimization hints
forge_market_search Search certified skills and artifacts in the Forge Marketplace
forge_market_publish Publish a code artifact or skill with SHA-256 integrity hashing
forge_provenance Inspect and verify the SHA-256 governance provenance chain
forge_provider_status Inspect active LLM vendors and hardware compute capabilities

🗺 Roadmap

  • Core engine (compiler, benchmark, evolution, arena)
  • CLI with demo mode
  • Vitalis JIT integration with native Rust hotpaths
  • Real LLM providers via OpenRouter (Claude, GPT, Gemini, DeepSeek)
  • Multi-vendor smart routing (direct Anthropic/OpenAI/Google/DeepSeek/xAI + OpenRouter fallback)
  • Cross-platform compute detection (NVIDIA, AMD ROCm, Apple Silicon, CPU-only)
  • IDE-agnostic export bridge (VS Code, Cursor, Windsurf, Antigravity, clipboard)
  • Budget & cost tracking with EMA spike detection
  • Enterprise governance (provenance chain, policy engine, circuit breaker)
  • Agent Factory (17 artifact types, 8 languages)
  • Auto-deployment wiring for all artifact types
  • Three-tier memory engine (working/episodic/semantic)
  • Self-improvement engine with fitness gating
  • Interactive dashboard with 10+ tabs
  • Native desktop bridge (File Explorer, VS Code, PowerShell)
  • Polyglot fitness engine (Python, Rust, Go, TypeScript, HCL, YAML, Dockerfile, Vitalis .sl)
  • Local model support via Ollama (GPU/CPU/split compute modes)
  • MCP server (13 tools, smart-routed, stdout-isolated JSON-RPC 2.0)
  • Deterministic tournament replay & A/B testing (create_replay_config, run_replay, run_ab_test)
  • KLS Stochastic Localization Tilt Selection, Poincaré Spectral Diagnostics & Lean 4 Proof Factory (v2.5.0)
  • SQLite evolution ledger
  • Multi-user collaboration mode
  • WebSocket real-time dashboard updates

📄 License

MIT License — see LICENSE for details.

🔧 Recent Changes (v2.5.0 — KLS Stochastic Localization, Multi-Trajectory Pruning & Lean 4 Proof Factory)

  • KLS Stochastic Localization Tilt Selection (forge/evolution.py) — Added StochasticLocalizationState and stochastic_localization_select() implementing Eldan / Song–Zhang (2026, arXiv:2610.01447) continuous measure-tilting over isotropically preconditioned 64D code embeddings with quadratic confinement and standardized advantage weighting.
  • KLS Isoperimetric & Poincaré Spectral Diagnostics (forge/benchmark.py) — Added kls_spectral_diagnostics() computing empirical fitness variance $\mathrm{Var}\mu(f)$, discrete Dirichlet gradient energy $\mathbb{E}\mu[|\nabla_{\mathcal{G}} f|^2]$, the Poincaré ratio $\hat{C}{\text{Poincaré}}$ (KLS500 bound verification $\le 500$), and Silverman KDE median hyperplane cut conductance $\hat{\psi}{\text{KLS}}$.
  • Multi-Trajectory Dead-End Pruning & Human-Director Steering (forge/arena.py) — Added _prune_dead_end_trajectories() and director_hook in Arena to prune stagnant lineages and focus population evaluations on high-gradient trajectories. Verified in a 10-seed A/B benchmark: +6.38 mean population fitness gain (92.31 vs 85.93), 59.5% variance reduction, Welch's $t = 4.59$ ($p &lt; 0.001$), and Cohen's $d = 2.0527$.
  • 18th Artifact Type: Lean 4 Formal Proof & Kernel Verification (forge/factory.py, forge/deployer.py, forge/fitness_engine.py) — Added lean4_proof (Proof.lean, lakefile.lean, lean-toolchain) and a dedicated Lean 4 fitness scorer that enforces zero sorry/admit axioms (SORRY_AXIOM_DETECTED) and verifies #print axioms kernel-trust-level-zero structure.
  • v2.4.0 Foundation — Sandboxed pure-Python .sl lexer/parser/type-checker/interpreter fallback, AST alias-resolving PolicyEngine, SHA-256 parent-link tamper detection, and stdout-isolated JSON-RPC 2.0 MCP server.

Built with 🔥 by ModernOps888

Where code is forged through competition, refined by evolution, and hardened by compilation.

About

Multi-Agent Code Evolution Platform: 4 LLMs compete, evolve, and breed code through a JIT compiler judge

Topics

Resources

Stars

14 stars

Watchers

1 watching

Forks

Releases

Packages

Contributors

Languages