Skip to content

data(cpu): recover 210 CPUs the earlier batches skipped on naming mismatches - #137

Merged
Seungpyo1007 merged 2 commits into
mainfrom
data/cpu-specs-batch6
Jul 30, 2026
Merged

Seungpyo1007 merged 2 commits into
mainfrom
data/cpu-specs-batch6

Conversation

@Seungpyo1007

@Seungpyo1007 Seungpyo1007 commented Jul 30, 2026 •

Copy link
Copy Markdown
Member

What

210 records / 240 fields (process_node 205, l3_cache_mb 35). CPU process_node coverage 56% → 61%, l3_cache_mb 54% → 55%.

Why these were missed, not missing

After #132–#135 merged, 1,737 CPUs still had no process_node — and several whole families sat at 0% filled (A-Series 213/213, Ryzen 125/125, Core 2 124/124, Opteron 103/103, Atom 78/78). That looked like absent data. It wasn't; it was three naming mismatches:

  1. Model codes are not always digit-first. The table parser required a leading digit, so Core 2's E6600/Q6600 and Atom's N270/Z530 were discarded before any matching happened.
  2. The Atom page has no wikitext tables at all — 244 {{cpulist}} templates — and had only ever been run through the table parser.
  3. The Opteron page has a bare model-number column and no branding column, so nothing matched a family regex. The family name now comes from the page itself (that page lists only Opterons), with identity still carried by the cross-check.

Correctness

1,610 rows parsed → 1,053 matched a record → 885 passed the cross-check → 210 still had a gap to fill. Same rules as the merged batches: base clock within 0.05 GHz, TDP within 1 W, L3 must be a real cache capacity and must not equal the row's own TDP.

Spot-checked against known parts, all correct:

record filled correct for
i5-680, i5-660, i3-530 32 nm Clarkdale
i7-4770R, i5-4670R 22 nm Haswell
i7-5775R 14 nm Broadwell
Atom 330, D410, D425 45 nm Diamondville/Pineview
Atom D2500, D2550 32 nm Cedarview
Opteron 1385, 2382, 8378 L3 6 MB Shanghai

Older families were left empty on purpose. Core 2 E-series, Atom N270 and early Opteron rows did not pass the cross-check, so nothing was written for them rather than guessed — which is why no 65 nm or 130 nm values appear here at all.

All 4 source pages HTTP-verified; every record cites the page it came from. python -m app.validate → Data validation passed. Dump refreshed for the 210 changed pages only.

Closes #1

…kipped

Recovers records that the merged batches (#132-#135) left untouched because of
three separate mismatches in how the pages name things, not because the data
was unavailable:

- model codes are not always digit-first (Core 2 uses E6600, Atom uses N270),
  and the table parser required a leading digit;
- the Atom page is built entirely from {{cpulist}} templates and had never been
  run through that parser;
- the Opteron page lists a bare model-number column with no branding column, so
  the family name now comes from the page itself.

Same confirm-before-write rule as before (base clock within 0.05 GHz, TDP within
1 W, L3 must be a real capacity and must not equal the row's TDP): 1,610 rows
parsed, 1,053 matched a record, 885 passed, 210 still had a gap to fill.

Verified against known parts: Clarkdale i5-6xx/i3-5xx 32 nm, Haswell i7-4770R
22 nm, Broadwell i7-5775R 14 nm, Atom 330/D410 45 nm, Atom D2500 32 nm,
Opteron Shanghai 6 MB L3. Older families whose rows failed the cross-check
(Core 2 E-series, Atom N270, early Opteron) were left empty rather than guessed.

Refs #1
Regenerates site/public/v1/cpus for the 210 records changed in the previous
commit, with the engine at the pinned submodule commit. Only pages whose content
actually differs are committed; 7,745 timestamp-only pages are left alone.

Refs #1
@github-actions github-actions Bot added data Dataset changes enhancement New feature or request labels Jul 30, 2026
@Seungpyo1007 Seungpyo1007 moved this from Todo to In Progress in TechAPI-Project Jul 30, 2026
@Seungpyo1007
Seungpyo1007 merged commit 84442f8 into main Jul 30, 2026
5 checks passed
@github-project-automation github-project-automation Bot moved this from In Progress to Done in TechAPI-Project Jul 30, 2026
@Seungpyo1007
Seungpyo1007 deleted the data/cpu-specs-batch6 branch July 30, 2026 02:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

data Dataset changes enhancement New feature or request

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

TechAPI dataset roadmap and status: all categories (1989-2026)

1 participant