fix(data): add source citations for 45 laptop/monitor records - #337
Merged
Merged
Conversation
Upgrade uncited laptop/monitor records from dataset-only provenance to source-verified by adding authoritative manufacturer/Wikipedia citations that confirm the stored specs, and set verified:true. Original dataset provenance URLs are retained alongside the new sources. - 24 laptops: Apple MacBook 12/Air/Pro (2017), Microsoft Surface Laptop (1st gen), Google Pixelbook, ASUS Zenbook 14 OLED UX3405MA/UX3405CA; cited against Apple support pages, Wikipedia, Google and ASUS spec pages. - 21 monitors: Dell UltraSharp/S-series, Gigabyte AORUS/M/GS series, MSI G/MAG series, Samsung Odyssey, LG UltraGear, BenQ, ViewSonic; cited against manufacturer spec pages. Value corrections to match the cited source (never invented): - Google Pixelbook weight 1100 -> 1110 g (Google: 1.11 kg) - MacBook Air 2017 weight 1340 -> 1350 g (Apple: 1.35 kg) - Surface Laptop weight 1252 -> 1250 g (Wikipedia/Microsoft: 1.25 kg) - LG 24GN60R size 24.0 -> 23.8 in (LG spec) - Samsung Odyssey G9 49" DQHD resolution 3440x1440 -> 5120x1440, ppi 76 -> 109 Refs #296
Regenerate the static v1 dump for the laptop and monitor detail pages affected by the source-citation pass (python -m app.dump from TechEngine against this worktree's data). Picks up verified:true, the added source URLs, and the value corrections for the newly cited records. Refs #296
github-actions
Bot
added
bug
Member
🔎 Data verification — Tier 0 (offline existence/trust)Scored by 12/12 categories ? 191,819 records ? diff base develop@e5e18a1 Changed records in this PR45 record(s) assessed. %%{init: {"theme":"base","themeVariables":{"pie1":"#3fb950","pie2":"#d29922","pie3":"#f85149","pieStrokeWidth":"0px","pieOpacity":"1"}}}%%
pie showData
title Verification bands — all records
"Green" : 22
"Yellow" : 23
"Red" : 0
Full-dataset baseline191819 record(s) assessed. %%{init: {"theme":"base","themeVariables":{"pie1":"#3fb950","pie2":"#d29922","pie3":"#f85149","pieStrokeWidth":"0px","pieOpacity":"1"}}}%%
pie showData
title Verification bands — all records
"Green" : 32794
"Yellow" : 157970
"Red" : 1055
Hard violations (forced red):
green = authoritative source + complete + consistent · yellow = plausible, needs confirmation · red = sparse/weak source or a hard contradiction. Promotion to |
Member
TechEngine change review: PASS12/12 categories ? 191,819 records ? diff base develop@e5e18a1
Changed data
Changed record exampleslaptop modified
monitor modified
Heuristic review
|
Member
TechEngine validation stats: PASS12/12 categories ? 191,819 records ? diff base develop@e5e18a1
Data summary
Warning Tracked verified coverage is below 50% for software 0.8% (358/42493), monitor 2.4% (21/882), laptop 6.5% (129/1995), tablet 8.3% (288/3459), soc 13.4% (284/2117), all 16.8% (32302/191819), smartphone 18.8% (17581/93407), website 19.0% (7635/40084), and 1 more. Validation notes
Key output:
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Upgrades uncited
data/laptop/anddata/monitor/records fromdataset-only provenance (huggingface Ammok / abhinavflac GitHub / Kaggle
Amazon-monitor) to source-verified by adding authoritative
manufacturer, Wikipedia, or vendor spec-page citations that confirm the
stored values, and setting
verified: true. Original dataset provenanceURLs are retained alongside the new sources. No value was invented and no
citation was fabricated.
Methodology
data/laptop/anddata/monitor/live for records withverified != true. None had emptysource_urls— every record alreadycarried a bulk-dataset link, so the gap was uncited, not unsourced.
Live scope: laptop 1995 total / 1890 unverified;
monitor 882 total / 882 unverified.
manufacturer spec page (Apple / Microsoft / Google / ASUS / Dell /
Gigabyte / MSI / Samsung / LG / BenQ / ViewSonic) or the Wikipedia
infobox and compared the stored specs (size, resolution, refresh,
CPU/GPU, RAM, storage, weight).
verified: true.source (never invented) and cited it.
whose CPU/GPU contradicted the spec page with no clean single-source
fix) -> left the record as-is, uncited.
Counts
Records touched: 45 (24 laptop + 21 monitor)
Newly cited-and-verified (no value change): 35
Microsoft Surface Laptop (1st gen) x2, ASUS Zenbook 14 OLED
UX3405MA / UX3405CA x2, plus MacBook Air x2 (see below — 2 cited-only).
Gigabyte M27Q/M28U/M32UC/GS34WQC/AORUS FV43U, MSI G273CQ/G27C4X/
MAG274UPF, Samsung Odyssey Neo G8/G55A, LG 24GS60F, BenQ EX2710Q/
XL2566K, ViewSonic VX3218-PC-MHD.
Value-corrected-with-citation: 10
ppi 76 -> 109 (Samsung spec) x1
Left uncited (no confirmable source in this pass): 2727
(1866 laptop + 861 monitor) — remaining bulk-dataset records not
individually verified in this batch; untouched, keep existing provenance.
Verification
python -m app.validate-> passed.python integrity_check.py <data> --strict-> "integrity gate: no hardanomalies" (no verified-without-sources, no dup/slug issues).
python -m app.dumpfrom TechEngine againstthis worktree (fresh scratch
DATABASE_URL,TECHAPI_DATA_DIR-> thisworktree
data/) as the final commit; laptop/monitor detail pages reflectthe new citations and corrections. Unrelated scoring /
updated_atdriftfor other categories was excluded to keep the PR scoped.
Closes #296