Merge confirmed near-duplicate GPU records - #282
Conversation
The merged duplicates stored AMD stream processors as cuda_cores and NVIDIA CUDA cores as stream_processors. Every keeper already had the count in its own field, so the copies are dropped.
|
Review: the merge copied core counts into the other vendor's field ( |
🔎 Data verification — Tier 0 (offline existence/trust)Scored by Changed records in this PR148 record(s) scored. %%{init: {"theme":"base","themeVariables":{"pie1":"#3fb950","pie2":"#d29922","pie3":"#f85149","pieStrokeWidth":"0px","pieOpacity":"1"}}}%%
pie showData
title Verification bands — all records
"Green" : 115
"Yellow" : 33
"Red" : 0
Full-dataset baseline106339 record(s) scored. %%{init: {"theme":"base","themeVariables":{"pie1":"#3fb950","pie2":"#d29922","pie3":"#f85149","pieStrokeWidth":"0px","pieOpacity":"1"}}}%%
pie showData
title Verification bands — all records
"Green" : 24215
"Yellow" : 81029
"Red" : 1095
Hard violations (forced red):
green = authoritative source + complete + consistent · yellow = plausible, needs confirmation · red = sparse/weak source or a hard contradiction. Promotion to |
TechEngine change review: PASS
Changed data
Changed record examplesgpu modified
gpu deleted
Heuristic review
|
TechEngine validation stats: PASS
Data summary
Warning Tracked verified coverage is below 50% for tablet 7.9% (273/3455), watch 8.8% (39/442), soc 9.2% (193/2105), smartphone 18.7% (17501/93407), all 20.8% (22097/106339), gpu 49.4% (1026/2076). Validation notes
Key output:
|
GPU records merged
Kept ← removed (newly filled field):
All keeper records also gained unique source URLs from the removed record. Each merged pair has the same release year and agrees on populated memory capacity, bus width, and core counts.
git grepagainstorigin/develop -- data/laptopfound no laptopgpureferences to any removed slug.Skipped pairs
Validation
PYTHONIOENCODING=utf-8 python -m app.validatepassed.Closes #1