Skip to content

Merge confirmed near-duplicate GPU records - #282

Merged
Seungpyo1007 merged 2 commits into
developfrom
fix/gpu-near-duplicates
Sep 25, 2026
Merged

Seungpyo1007 merged 2 commits into
developfrom
fix/gpu-near-duplicates

Conversation

@Seungpyo1007

@Seungpyo1007 Seungpyo1007 commented Sep 25, 2026 •

Copy link
Copy Markdown
Member

GPU records merged

Kept ← removed (newly filled field):

  • instinct-mi250x ← radeon-instinct-mi250x — cuda_cores
  • instinct-mi300x ← radeon-instinct-mi300x — cuda_cores
  • instinct-mi350x ← radeon-instinct-mi350x — cuda_cores
  • instinct-mi355x ← radeon-instinct-mi355x — cuda_cores
  • radeon-rx-9060-xt-8gb ← radeon-rx-9060-xt-8-gb — cuda_cores
  • geforce-gtx-1060-3gb ← geforce-gtx-1060-3-gb — stream_processors
  • geforce-gtx-1060-6gb ← geforce-gtx-1060-6-gb — stream_processors
  • geforce-rtx-5060-laptop ← geforce-rtx-5060-mobile — stream_processors
  • geforce-rtx-5060-ti-8gb ← geforce-rtx-5060-ti-8-gb — stream_processors
  • geforce-rtx-5070-laptop ← geforce-rtx-5070-mobile — stream_processors
  • geforce-rtx-5070-ti-laptop ← geforce-rtx-5070-ti-mobile — stream_processors
  • geforce-rtx-5080-laptop ← geforce-rtx-5080-mobile — stream_processors
  • geforce-rtx-5090-laptop ← geforce-rtx-5090-mobile — stream_processors

All keeper records also gained unique source URLs from the removed record. Each merged pair has the same release year and agrees on populated memory capacity, bus width, and core counts. git grep against origin/develop -- data/laptop found no laptop gpu references to any removed slug.

Skipped pairs

  • instinct-mi210 / radeon-instinct-mi210 — release years 2022 and 2021 differ.
  • instinct-mi325x / radeon-instinct-mi325x — memory capacity conflicts (256 GB versus 288 GB).
  • geforce-rtx-3060-8gb / geforce-rtx-3060-8-gb — release years 2023 and 2022 differ.

Validation

PYTHONIOENCODING=utf-8 python -m app.validate passed.

Closes #1

@github-actions github-actions Bot added data Dataset changes enhancement New feature or request labels Sep 25, 2026
@Seungpyo1007 Seungpyo1007 added bug Something isn't working data Dataset changes labels Sep 25, 2026
@Seungpyo1007 Seungpyo1007 removed the enhancement New feature or request label Sep 25, 2026
The merged duplicates stored AMD stream processors as cuda_cores and NVIDIA
CUDA cores as stream_processors. Every keeper already had the count in its
own field, so the copies are dropped.
@Seungpyo1007

Copy link
Copy Markdown
Member Author

Review: the merge copied core counts into the other vendor's field (cuda_cores on AMD Instinct/RX, stream_processors on GeForce). All 13 keepers already held the same count in the correct field, so the latest commit nulls the copies. Pairs and skips look right.

@github-actions github-actions Bot added the enhancement New feature or request label Sep 25, 2026
@TechEngineBot

Copy link
Copy Markdown
Member

🔎 Data verification — Tier 0 (offline existence/trust)

Scored by app.verify; posted by TechEngineBot. Informational only — the structural gate (app.validate) is separate and authoritative for merge.

Changed records in this PR

148 record(s) scored.

%%{init: {"theme":"base","themeVariables":{"pie1":"#3fb950","pie2":"#d29922","pie3":"#f85149","pieStrokeWidth":"0px","pieOpacity":"1"}}}%%
pie showData
    title Verification bands — all records
    "Green" : 115
    "Yellow" : 33
    "Red" : 0
Loading
Category Distribution Total 🟢 🟡 🔴 🟢 %
soc 🟩🟩🟩🟨🟨🟨🟨🟨🟨🟨🟨🟨 9 2 7 0 22.2%
smartphone 🟩🟩🟩🟩🟩🟩🟩🟨🟨🟨🟨🟨 46 25 21 0 54.3%
tablet 🟩🟩🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨 5 1 4 0 20.0%
watch 🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟨 38 37 1 0 97.4%
gpu 🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩 13 13 0 0 100.0%
cpu 🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩 37 37 0 0 100.0%
All 🟩🟩🟩🟩🟩🟩🟩🟩🟩🟨🟨🟨 148 115 33 0 77.7%

Full-dataset baseline

106339 record(s) scored.

%%{init: {"theme":"base","themeVariables":{"pie1":"#3fb950","pie2":"#d29922","pie3":"#f85149","pieStrokeWidth":"0px","pieOpacity":"1"}}}%%
pie showData
    title Verification bands — all records
    "Green" : 24215
    "Yellow" : 81029
    "Red" : 1095
Loading
Category Distribution Total 🟢 🟡 🔴 🟢 %
brand 🟩🟩🟩🟩🟩🟩🟩🟨🟨🟨🟨🟨 207 122 85 0 58.9%
soc 🟩🟨🟨🟨🟨🟨🟥🟥🟥🟥🟥🟥 2105 253 831 1021 12.0%
smartphone 🟩🟩🟨🟨🟨🟨🟨🟨🟨🟨🟨🟥 93407 17956 75383 68 19.2%
tablet 🟩🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟥 3455 292 3162 1 8.5%
watch 🟩🟩🟨🟨🟨🟨🟨🟨🟨🟨🟨🟥 442 80 358 4 18.1%
pda 🟩🟩🟩🟩🟩🟩🟩🟨🟨🟨🟨🟨 140 83 57 0 59.3%
gpu 🟩🟩🟩🟩🟩🟩🟩🟨🟨🟨🟨🟨 2076 1266 810 0 61.0%
cpu 🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟨🟥 4507 4163 343 1 92.4%
All 🟩🟩🟩🟨🟨🟨🟨🟨🟨🟨🟨🟥 106339 24215 81029 1095 22.8%

Hard violations (forced red):

Count Check
1 !boost_ge_base

green = authoritative source + complete + consistent · yellow = plausible, needs confirmation · red = sparse/weak source or a hard contradiction. Promotion to verified runs in the scheduled verify-network workflow.

@Seungpyo1007
Seungpyo1007 merged commit 9b44ac7 into develop Sep 25, 2026
5 checks passed
@Seungpyo1007
Seungpyo1007 deleted the fix/gpu-near-duplicates branch September 25, 2026 12:41
@TechEngineBot

Copy link
Copy Markdown
Member

TechEngine change review: PASS

Check Result
python -m app.validate PASS
New hard integrity anomalies vs PR base PASS

Changed data

Category Added Modified Deleted Added verified Added unverified Added Kaggle-sourced
brand 0 0 0 0 0 0
soc 0 0 0 0 0 0
smartphone 0 0 0 0 0 0
tablet 0 0 0 0 0 0
watch 0 0 0 0 0 0
pda 0 0 0 0 0 0
gpu 0 13 13 0 0 0
cpu 0 0 0 0 0 0

Changed record examples

gpu modified

  • gpu/amd/2021/enterprise/instinct-mi250x.json - Instinct MI250X
  • gpu/amd/2023/enterprise/instinct-mi300x.json - Instinct MI300X
  • gpu/amd/2025/consumer/radeon-rx-9060-xt-8gb.json - Radeon RX 9060 XT 8GB
  • gpu/amd/2025/enterprise/instinct-mi350x.json - Instinct MI350X
  • gpu/amd/2025/enterprise/instinct-mi355x.json - Instinct MI355X
  • gpu/nvidia/2016/consumer/geforce-gtx-1060-3gb.json - GeForce GTX 1060 3GB
  • gpu/nvidia/2016/consumer/geforce-gtx-1060-6gb.json - GeForce GTX 1060 6GB
  • gpu/nvidia/2025/consumer/geforce-rtx-5060-laptop.json - GeForce RTX 5060 Laptop GPU
  • gpu/nvidia/2025/consumer/geforce-rtx-5060-ti-8gb.json - GeForce RTX 5060 Ti 8GB
  • gpu/nvidia/2025/consumer/geforce-rtx-5070-laptop.json - GeForce RTX 5070 Laptop GPU
  • gpu/nvidia/2025/consumer/geforce-rtx-5070-ti-laptop.json - GeForce RTX 5070 Ti Laptop GPU
  • gpu/nvidia/2025/consumer/geforce-rtx-5080-laptop.json - GeForce RTX 5080 Laptop GPU
  • gpu/nvidia/2025/consumer/geforce-rtx-5090-laptop.json - GeForce RTX 5090 Laptop GPU

gpu deleted

  • gpu/amd/2021/enterprise/radeon-instinct-mi250x.json - Radeon Instinct MI250X
  • gpu/amd/2023/enterprise/radeon-instinct-mi300x.json - Radeon Instinct MI300X
  • gpu/amd/2025/consumer/radeon-rx-9060-xt-8-gb.json - Radeon RX 9060 XT 8 GB
  • gpu/amd/2025/enterprise/radeon-instinct-mi350x.json - Radeon Instinct MI350X
  • gpu/amd/2025/enterprise/radeon-instinct-mi355x.json - Radeon Instinct MI355X
  • gpu/nvidia/2016/consumer/geforce-gtx-1060-3-gb.json - GeForce GTX 1060 3 GB
  • gpu/nvidia/2016/consumer/geforce-gtx-1060-6-gb.json - GeForce GTX 1060 6 GB
  • gpu/nvidia/2025/consumer/geforce-rtx-5060-mobile.json - GeForce RTX 5060 Mobile
  • gpu/nvidia/2025/consumer/geforce-rtx-5060-ti-8-gb.json - GeForce RTX 5060 Ti 8 GB
  • gpu/nvidia/2025/consumer/geforce-rtx-5070-mobile.json - GeForce RTX 5070 Mobile
  • gpu/nvidia/2025/consumer/geforce-rtx-5070-ti-mobile.json - GeForce RTX 5070 Ti Mobile
  • gpu/nvidia/2025/consumer/geforce-rtx-5080-mobile.json - GeForce RTX 5080 Mobile
  • gpu/nvidia/2025/consumer/geforce-rtx-5090-mobile.json - GeForce RTX 5090 Mobile

Heuristic review

  • Heuristic warnings: none found.

@TechEngineBot

Copy link
Copy Markdown
Member

TechEngine validation stats: PASS

Data summary

Category Total Verified Unverified Missing verified Tracked Verified % of tracked
brand 207 122 85 0 207 58.9%
soc 2105 193 1912 0 2105 9.2%
smartphone 93407 17501 75906 0 93407 18.7%
tablet 3455 273 3182 0 3455 7.9%
watch 442 39 403 0 442 8.8%
pda 140 74 66 0 140 52.9%
gpu 2076 1026 1050 0 2076 49.4%
cpu 4507 2869 1638 0 4507 63.7%
all 106339 22097 84242 0 106339 20.8%

Warning

Tracked verified coverage is below 50% for tablet 7.9% (273/3455), watch 8.8% (39/442), soc 9.2% (193/2105), smartphone 18.7% (17501/93407), all 20.8% (22097/106339), gpu 49.4% (1026/2076).
Tracked coverage excludes records missing the verified field; see the Missing verified column for those records.
This does not fail validation. Keep imported records verified: false until manual audit, but treat this as follow-up verification work before relying on the affected categories as curated data.

Validation notes

  • The integrity gate blocks only hard anomalies introduced by this PR relative to its merge base.
  • Full advisory outlier listings are suppressed on successful runs because they are dataset-wide and mostly stable between PRs.
  • Failure runs still include a detailed log excerpt for debugging.

Key output:

## app.validate
## integrity_check.py (PR head compared with PR base)
loaded CPU=4507 GPU=2076
Integrity section Flagged lines
structural 18
CPU name/tier consistency (desktop mainstream only) 0
CPU single>multi (cinebench/geekbench — should be multi>=single) 0
CPU era-vs-score outliers 8
CPU cross-source ratio outliers (possible wrong-variant) 155
GPU cross-source ratio outliers + sanity 18

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bug Something isn't working data Dataset changes enhancement New feature or request

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

TechAPI dataset roadmap and status: all categories (1989-2026)

2 participants