Skip to content

data(mobile): import supplemental smartphone and tablet variants#39

Merged
Seungpyo1007 merged 7 commits into
mainfrom
data/import-staging
Jun 20, 2026
Merged

data(mobile): import supplemental smartphone and tablet variants#39
Seungpyo1007 merged 7 commits into
mainfrom
data/import-staging

Conversation

@Seungpyo1007

Copy link
Copy Markdown
Member

Summary

  • import 760 supplemental mobile records with variant-style paths
  • add 711 smartphone variants and 49 tablet variants
  • keep all imported records verified: false for later manual audit
  • normalize repeated brand prefixes in imported slugs/base_model_slug values
  • refresh public v1 dump for smartphones and tablets

Sources

  • lileejass/mobile-phone-dataset-prices-and-trend-analysis: 748 records
  • rajibdab/global-smartphone-database-2025: 8 cleanup records
  • devadigax/awesome-mobiles-database-by-aitoolbuzz-com: 4 cleanup records

Verification

  • python -m app.validate
  • python TechEngine\integrity_check.py data --strict
  • git diff --check origin/main...HEAD
  • cd site && npm.cmd run build

Closes #1

@TechEngineBot

Copy link
Copy Markdown
Member

TechEngine change review: PASS

Check Result
python -m app.validate PASS
python integrity_check.py TechAPI/data --strict PASS

Changed data

Category Added Modified Deleted Added verified Added unverified Added Kaggle-sourced
brand 0 0 0 0 0 0
soc 0 0 0 0 0 0
smartphone 711 0 0 0 711 707
tablet 49 0 0 0 49 49
watch 0 0 0 0 0 0
pda 0 0 0 0 0 0
gpu 0 0 0 0 0 0
cpu 0 0 0 0 0 0

Changed record examples

smartphone added

  • smartphone/apple/2017/iphone-x/apple-iphone-x-3gb-256gb.json - iPhone X 256GB
  • smartphone/apple/2017/iphone-x/apple-iphone-x-3gb-64gb.json - iPhone X 64GB
  • smartphone/apple/2018/iphone-xr/apple-iphone-xr-3gb-128gb-4g-lileejass-2.json - Apple iPhone XR (128GB)
  • smartphone/apple/2018/iphone-xr/apple-iphone-xr-3gb-128gb.json - iPhone XR 128GB
  • smartphone/apple/2018/iphone-xr/apple-iphone-xr-3gb-256gb-4g-lileejass-2.json - Apple iPhone XR (256GB)
  • smartphone/apple/2018/iphone-xr/apple-iphone-xr-3gb-256gb.json - iPhone XR 256GB
  • smartphone/apple/2018/iphone-xr/apple-iphone-xr-3gb-64gb.json - iPhone XR 64GB
  • smartphone/apple/2018/iphone-xs-max/apple-iphone-xs-max-4gb-256gb.json - iPhone XS Max 256GB
  • smartphone/apple/2018/iphone-xs-max/apple-iphone-xs-max-4gb-512gb.json - iPhone XS Max 512GB
  • smartphone/apple/2018/iphone-xs-max/apple-iphone-xs-max-4gb-64gb.json - iPhone XS Max 64GB
  • smartphone/apple/2018/iphone-xs/apple-iphone-xs-4gb-256gb.json - iPhone XS 256GB
  • smartphone/apple/2018/iphone-xs/apple-iphone-xs-4gb-512gb.json - iPhone XS 512GB
  • smartphone/apple/2018/iphone-xs/apple-iphone-xs-4gb-64gb.json - iPhone XS 64GB
  • smartphone/apple/2019/iphone-11-pro-max/apple-iphone-11-pro-max-4gb-256gb.json - iPhone 11 Pro Max 256GB
  • smartphone/apple/2019/iphone-11-pro-max/apple-iphone-11-pro-max-4gb-512gb.json - iPhone 11 Pro Max 512GB
  • ... 696 more

tablet added

  • tablet/apple/2019/ipad-mini-7-9-inch/apple-ipad-mini-7-9-inch-3gb-256gb.json - iPad Mini 7.9-inch 256GB
  • tablet/apple/2019/ipad-mini-7-9-inch/apple-ipad-mini-7-9-inch-3gb-64gb.json - iPad Mini 7.9-inch 64GB
  • tablet/apple/2020/ipad-10-2-inch/apple-ipad-10-2-inch-3gb-128gb.json - iPad 10.2-inch 128GB
  • tablet/apple/2020/ipad-10-2-inch/apple-ipad-10-2-inch-3gb-32gb.json - iPad 10.2-inch 32GB
  • tablet/apple/2020/ipad-air-10-9-inch/apple-ipad-air-10-9-inch-4gb-256gb.json - iPad Air 10.9-inch 256GB
  • tablet/apple/2020/ipad-air-10-9-inch/apple-ipad-air-10-9-inch-4gb-64gb.json - iPad Air 10.9-inch 64GB
  • tablet/apple/2020/ipad-pro-11-inch/apple-ipad-pro-11-inch-4gb-128gb.json - iPad Pro 11-inch 128GB
  • tablet/apple/2020/ipad-pro-11-inch/apple-ipad-pro-11-inch-4gb-256gb.json - iPad Pro 11-inch 256GB
  • tablet/apple/2020/ipad-pro-11-inch/apple-ipad-pro-11-inch-6gb-512gb.json - iPad Pro 11-inch 512GB
  • tablet/honor/2020/pad-6/honor-pad-6-4gb.json - Pad 6
  • tablet/honor/2020/pad-x6/honor-pad-x6-3gb.json - Pad X6
  • tablet/honor/2021/pad-7/honor-pad-7-4gb.json - Pad 7
  • tablet/honor/2021/tablet-v7-pro/honor-tablet-v7-pro-8gb.json - Tablet V7 Pro
  • tablet/honor/2021/tablet-v7/honor-tablet-v7-6gb.json - Tablet V7
  • tablet/honor/2022/pad-x8-lite/honor-pad-x8-lite-3gb.json - Pad X8 Lite
  • ... 34 more

Heuristic review

  • Added records by manufacturer/brand: oppo: 101, apple: 91, vivo: 83, samsung: 78, realme: 67, motorola: 62, oneplus: 47, tecno: 37
  • Added records by source class: kaggle: 756, other: 4
  • Heuristic warnings: none found.

@TechEngineBot

Copy link
Copy Markdown
Member

TechEngine validation stats: PASS

Data summary

Category Total Verified Unverified Missing verified Tracked Verified % of tracked
brand 189 0 60 129 60 0.0%
soc 2104 58 2046 0 2104 2.8%
smartphone 45771 184 45587 0 45771 0.4%
tablet 1352 0 1352 0 1352 0.0%
watch 194 0 194 0 194 0.0%
pda 110 0 110 0 110 0.0%
gpu 2030 0 2030 0 2030 0.0%
cpu 3977 976 3001 0 3977 24.5%
all 55727 1218 54380 129 55598 2.2%

Warning

Tracked verified coverage is below 50% for brand 0.0% (0/60), tablet 0.0% (0/1352), watch 0.0% (0/194), pda 0.0% (0/110), gpu 0.0% (0/2030), smartphone 0.4% (184/45771), all 2.2% (1218/55598), soc 2.8% (58/2104), and 1 more.
Tracked coverage excludes records missing the verified field; see the Missing verified column for those records.
This does not fail validation. Keep imported records verified: false until manual audit, but treat this as follow-up verification work before relying on the affected categories as curated data.

Validation notes

  • Full advisory outlier listings are suppressed on successful runs because they are dataset-wide and mostly stable between PRs.
  • Failure runs still include a detailed log excerpt for debugging.

Key output:

## app.validate
## integrity_check.py --strict
loaded CPU=3977 GPU=2030
✅ integrity gate: no hard anomalies.
Integrity section Flagged lines
structural 0
CPU name/tier consistency (desktop mainstream only) 0
CPU single>multi (cinebench/geekbench — should be multi>=single) 0
CPU era-vs-score outliers 8
CPU cross-source ratio outliers (possible wrong-variant) 152
GPU cross-source ratio outliers + sanity 18

@Seungpyo1007 Seungpyo1007 merged commit 72f2fee into main Jun 20, 2026
4 checks passed
@github-project-automation github-project-automation Bot moved this from In Progress to Done in TechAPI-Project Jun 20, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

data Dataset changes enhancement New feature or request site Homepage and public site changes

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

Massive dataset rebuild: CPU + brand + GPU + smartphone + SoC (1989-2026)

2 participants