diff --git a/README.md b/README.md index 6109ed5..987e1f3 100644 --- a/README.md +++ b/README.md @@ -31,7 +31,8 @@ accountpulse score --as-of 2017-11-01 --capacity 0.10 --track maven-locked-repla The sole local project environment is `$HOME/.local/share/accountpulse/project-venv`; GPU stages fail closed without one visible CUDA GPU. See `BLOCKERS.md`, -`SOURCE_MANIFEST.yaml`, `SPLIT_MANIFEST.yaml`, and the reports under `reports/`. +`SOURCE_MANIFEST.yaml`, `SPLIT_MANIFEST.yaml`, the reports under `reports/`, +and [research decisions and limitations](docs/RESEARCH_DECISIONS.md). The frozen scientific checkpoint is `accountpulse-v1.0-complete`. Subsequent slicing, calibration and drift analysis, GPU TreeSHAP, grouped permutation, PDP/ICE, and AP-EV component diagnostics are preserved separately on branch diff --git a/RESUME_EVIDENCE.md b/RESUME_EVIDENCE.md deleted file mode 100644 index fad182e..0000000 --- a/RESUME_EVIDENCE.md +++ /dev/null @@ -1,11 +0,0 @@ -# Resume Evidence - -Use only the bullets below, preserving their benchmark boundaries. - -- Built a resume-safe predictive decision-science pipeline spanning 8,800 fictitious Maven CRM opportunities, 8,000 Olist leads, and 824K customer-identified UCI transaction lines, with point-in-time contracts, maturity embargoes, DuckDB/Parquet evidence, MLflow tracking, and fail-closed CUDA execution. -- Executed a preregistered, one-shot Maven LOCKED evaluation after freezing source/split/model/code hashes; retained the business heuristic when AP-EV captured 24.2% versus 29.2% ValueCapture@10% (difference −5.0 points, 95% CI [−14.5, 8.1]). -- Benchmarked RFM, Logistic/XGBoost, Cox, a three-seed BF16 Transformer, PIT GraphSAGE, cached MiniLM text embeddings, and multimodal fusion on an RTX 4090 Laptop GPU; retained RFM because fusion's +0.30-point ValueCapture@10% estimate had a 95% CI crossing zero. -- Detected and corrected a temporal label-overlap defect through adversarial review, issued a new protocol identity, invalidated prior external-track results, and reran the full model ladder without opening protected CRM outcomes. -- Demonstrated a negative external result on sparse Olist data (AP-EV 10.4% versus CUDA XGBoost 17.4% ValueCapture@10%) and separately showed on verified randomized Criteo evidence that response and uplift top-decile lists overlapped only 64.2%, without claiming cross-domain transportability. - -Do not claim production deployment, enterprise CRM lift, AP-EV improvement, cold-account validation, or causal outreach impact outside the released Criteo benchmark. diff --git a/INTERVIEW_NOTES.md b/docs/RESEARCH_DECISIONS.md similarity index 98% rename from INTERVIEW_NOTES.md rename to docs/RESEARCH_DECISIONS.md index 74a588f..98cecf0 100644 --- a/INTERVIEW_NOTES.md +++ b/docs/RESEARCH_DECISIONS.md @@ -1,6 +1,6 @@ -# Interview Notes +# Research Decisions and Limitations -## Track-A A1 update +## Maven Track A: frozen evaluation The complete official Maven source contains 8,800 opportunities and passed all five frozen hashes. A1 uses a 60-day horizon with three 60-day purge gaps (FIT 1,670; VALIDATION 434; POLICY 273; LOCKED 403). PREASSIGN excludes assignment fields and historical aggregates use only outcomes resolved strictly before engagement. Model choice used VALIDATION; calibration and bounded AP-EV selection used POLICY.