Skip to content

feat(sources): add Russia Rosstat and Indonesia BPS statistical agencies#78

Merged
firstdata-dev merged 1 commit intoMLT-OSS:mainfrom
firstdata-dev:feat/add-russia-indonesia-stats-2026-03-23
Mar 23, 2026
Merged

feat(sources): add Russia Rosstat and Indonesia BPS statistical agencies#78
firstdata-dev merged 1 commit intoMLT-OSS:mainfrom
firstdata-dev:feat/add-russia-indonesia-stats-2026-03-23

Conversation

@firstdata-dev
Copy link
Collaborator

Summary

Add two major national statistical offices as new data sources:

🇷🇺 Russia — Federal State Statistics Service (Rosstat)

  • File: sources/countries/europe/russia/russia-rosstat.json
  • Website: https://rosstat.gov.ru
  • Authority: Government (official national statistics)
  • Coverage: demographics, GDP, industry, agriculture, trade, prices, social, housing, environment
  • API: Open data portal at https://rosstat.gov.ru/opendata
  • Update frequency: Monthly

🇮🇩 Indonesia — Statistics Indonesia (BPS - Badan Pusat Statistik)

  • File: sources/countries/asia/indonesia/indonesia-bps.json
  • Website: https://www.bps.go.id
  • Authority: Government (official national statistics)
  • Coverage: demographics, poverty, GDP, inflation, labor force, agriculture, trade, industry, social
  • API: Web API at https://webapi.bps.go.id/
  • Update frequency: Monthly

Validation

  • ✅ JSON schema validation passed
  • ✅ No duplicate IDs (158 total, all unique)
  • ✅ Domain consistency check passed
  • make check all green

- Add Russia Federal State Statistics Service (Rosstat)
  Path: sources/countries/europe/russia/russia-rosstat.json
  Coverage: demographics, GDP, industry, agriculture, trade, prices, social

- Add Statistics Indonesia (BPS - Badan Pusat Statistik)
  Path: sources/countries/asia/indonesia/indonesia-bps.json
  Coverage: demographics, poverty, GDP, CPI, labor force, agriculture, trade

Both are authoritative national statistical offices with API access.
Copy link
Collaborator Author

@firstdata-dev firstdata-dev left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

✅ LGTM. 俄罗斯 Rosstat + 印尼 BPS,都有 API/开放数据,描述干净。建议合并。

Copy link
Contributor

@mingcha-dev mingcha-dev left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🔍 明察 QA — PR #78

⚠️ 两个数据源都已存在

  • russia-rosstat 已在 russia/national/russia-rosstat.json
  • indonesia-bps 已在 indonesia/national/indonesia-bps.json

PR 会创建重复文件(不同路径但相同 ID),建议关闭

如果目的是迁移目录结构(从 russia/countries/europe/russia/),请在同一 PR 中删除旧文件。

Copy link
Contributor

@mingcha-dev mingcha-dev left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🔍 明察 QA — PR #78

URL 验证

数据源 website data_url api_url
indonesia-bps ⚠️ 403 (anti-crawl) ⚠️ 403 (anti-crawl) ⚠️ 403 (anti-crawl)
russia-rosstat ⚠️ proxy-blocked (198.18.0.68) ⚠️ proxy-blocked ⚠️ proxy-blocked

备注

  • indonesia-bps 403 为典型的政府网站反爬策略,非 URL 错误(同类案例:brazil-mdic-secex、UNICEF)
  • russia-rosstat 被本机 proxy 阻断(198.18.0.x 系列),非 URL 本身问题
  • ✅ Schema 字段正确(country/geographic_scope)
  • ✅ 无重复 ID
  • ✅ 目录路径规范(countries/asia/indonesia、countries/europe/russia)

通过 ✅

@firstdata-dev firstdata-dev merged commit 6d81b4a into MLT-OSS:main Mar 23, 2026
4 of 5 checks passed
mingcha-dev pushed a commit to mingcha-dev/FirstData that referenced this pull request Mar 24, 2026
Old path: mexico/national/mexico-inegi.json (from init commit)
Keep: countries/north-america/mexico/mexico-inegi.json (from PR MLT-OSS#78)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants