data: import GSMArena cigarplug batch — 2,498 SoC-linked phones + tablets/watches/pdas#98
Conversation
GSMArena device dump (cigarplug/scrape-gsma) for Samsung Galaxy, Huawei and Honor lines, with SoC linked to the known SoC catalog. Bulk import, verified:false. Refs #1
GSMArena device dump (cigarplug/scrape-gsma) for LG, Xiaomi/Redmi/Poco, Oppo and Vivo lines. SoC-linked, verified:false. Refs #1
GSMArena device dump (cigarplug/scrape-gsma) for Motorola, HTC, ZTE and Sony Xperia lines. SoC-linked, verified:false. Refs #1
…, Realme GSMArena device dump (cigarplug/scrape-gsma) for Asus, Lenovo, Nokia, Meizu and Realme lines. SoC-linked, verified:false. Refs #1
GSMArena device dump (cigarplug/scrape-gsma) for the remaining brands (Infinix, BLU, Alcatel, Gionee, Allview, Wiko, Tecno, Microsoft, Micromax, Panasonic, BlackBerry, Archos, BQ and others). SoC-linked, verified:false. Refs #1
Additional GSMArena tablet records from the cigarplug/scrape-gsma dump not covered by the earlier batch. verified:false. Refs #1
…g dump) Remaining GSMArena smartwatch and PDA records from the cigarplug/scrape-gsma dump. verified:false. Refs #1
Add the 2,498 new GSMArena (cigarplug/scrape-gsma) records to the static v1 dump — smartphone/tablet/watch/pda detail + smartphone score entries — and bump the category index counts and manifest. Regenerated via TechEngine app.dump at pinned submodule c0928f9 (scoring v2.0.0); only the new records and affected indexes are committed. Refs #1
🤖 Review — PASS
Data-change summary
Example records
Heuristic warnings
Site build
|
📊 Dataset stats (post-merge projection)
Warning Verified ratio is 9.57% (down slightly from 9.80% as 2,498 new Campaign progress toward +50k: cigarplug/scrape-gsma is now largely exhausted (~2,871 total imported across PR #97 + #98). Remaining headroom needs additional datasets (Kaggle phone dumps, PhoneDB, AllPhones SKU variants) — tracked in #1. |
🔎 Data verification — Tier 0 (offline existence/trust)Scored by Changed records in this PRNo records scored. Full-dataset baseline104825 record(s) scored. %%{init: {"theme":"base","themeVariables":{"pie1":"#3fb950","pie2":"#d29922","pie3":"#f85149","pieStrokeWidth":"0px","pieOpacity":"1"}}}%%
pie showData
title Verification bands — all records
"Green" : 10029
"Yellow" : 92332
"Red" : 2464
green = authoritative source + complete + consistent · yellow = plausible, needs confirmation · red = sparse/weak source or a hard contradiction. Promotion to |
TechEngine change review: PASS
Changed data
Changed record examples
Heuristic review
|
TechEngine validation stats: PASS
Data summary
Warning Tracked verified coverage is below 50% for watch 2.5% (11/433), tablet 5.0% (174/3455), brand 5.3% (10/189), soc 5.8% (123/2104), smartphone 9.1% (8453/92497), all 9.6% (10028/104825), gpu 12.0% (244/2030), pda 19.3% (27/140), and 1 more. Validation notes
Key output:
|
What & why
Second GSMArena batch from the cigarplug/scrape-gsma dataset (10,679-row GSMArena scrape). PR #97 imported the tablet/watch/pda subset; this brings in 2,498 new records — mostly smartphones — with each phone linked to a real SoC in the catalog.
All records land
verified: false. Smartphones satisfy the stricter phone schema: integerram_gb, ranges (battery 500–12000 mAh, weight 50–500 g), and asocFK resolved to an existing SoC via a precise die-number + marketing-name matcher (unmatched chipsets are skipped, not guessed — avoids the fuzzy-match trap).Commits (each
Refs #1): 5 smartphone brand-group commits (Samsung/Huawei/Honor · LG/Xiaomi/Oppo/Vivo · Motorola/HTC/ZTE/Sony · Asus/Lenovo/Nokia/Meizu/Realme · remaining), tablet, watch+pda, and a surgical dump refresh.Closes #1
Source
GSMArena via
cigarplug/scrape-gsma(https://github.com/cigarplug/scrape-gsma),*-scrapegsma-<row>slugs.raw_sourcepreserves the original chipset/CPU/GPU/memory strings;variant.source_rowcites the CSV row.Dump
Regenerated via TechEngine
app.dumpat pinned submodulec0928f9(scoring v2.0.0). Only the 2,498 new records' detail+score files, the four category indexes and the manifest counts are committed (smartphones 90118→92497, tablets 3354→3455, watches 424→433, pdas 131→140) — no churn on unchanged records.Checklist
python -m app.validate— ✅ passed (full dataset)python TechEngine/integrity_check.py data --strict— ✅ no hard anomaliesgit diff --check— ✅ no whitespace errorsdata/<category>/<brand>/<year>/<base>/<slug>.jsonpaths, kebab-case unique slugssource_urlspresent on every record