Skip to content

[Hubs] Support Alibaba cloud FOCUS data #1679

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 5 commits into from
Jun 19, 2025
Merged

[Hubs] Support Alibaba cloud FOCUS data #1679

merged 5 commits into from
Jun 19, 2025

Conversation

Copilot
Copy link
Contributor

@Copilot Copilot AI commented Jun 10, 2025

This PR adds support for Alibaba Cloud FOCUS data ingestion in FinOps hubs by implementing the required custom columns as specified in the Alibaba Cloud Standard Billing FOCUS documentation.

Changes Made

Added Alibaba Cloud FOCUS Columns

The following extended columns have been added to support Alibaba Cloud cost data:

  • x_CommodityCode - Commodity code identifier
  • x_CommodityName - Commodity name description
  • x_BillingItemCode - Billing item code identifier
  • x_BillingItemName - Billing item name description
  • x_InstanceID - Instance identifier

Files Modified

  1. src/templates/finops-hub/modules/scripts/IngestionSetup_RawTables.kql

    • Added Alibaba 1.0 reference to supported versions documentation
    • Added 5 new columns to Costs_raw table definition with appropriate data types
    • Added corresponding ingestion mappings for all 5 columns
  2. src/templates/finops-hub/modules/scripts/IngestionSetup_v1_0.kql

    • Added 5 new columns to ActualCosts_transform_v1_0() function with empty default values
    • Added 5 new columns to AmortizedCosts_transform_v1_0() function with empty default values
  3. docs-mslearn/toolkit/hubs/data-model.md

    • Updated documentation to include Alibaba Cloud in the list of supported cloud providers
  4. docs-mslearn/toolkit/hubs/data-processing.md

    • Added Alibaba Cloud FOCUS 1.0 to the list of supported but not natively integrated datasets

Implementation Notes

  • This implementation follows the exact same pattern used for Tencent cloud support (PR [Hubs] Support Tencent FOCUS data #1274)
  • All columns use the x_ prefix to denote them as extended FOCUS columns
  • Default values are set to empty strings to maintain compatibility with existing data
  • Changes are minimal and focused only on the required functionality
  • No breaking changes to existing functionality

Testing

  • Verified KQL syntax is correct across all modified files
  • Confirmed all 5 columns are properly defined in table schema
  • Validated all 5 columns have corresponding ingestion mappings
  • Ensured all 5 columns are included in both transform functions
  • Documentation updates reflect the new capability

This enables Alibaba Cloud users to ingest their FOCUS cost data into FinOps hubs with full support for Alibaba-specific billing metadata.

Fixes #1677.


💡 You can make Copilot smarter by setting up custom instructions, customizing its development environment and configuring Model Context Protocol (MCP) servers. Learn more Copilot coding agent tips in the docs.

Co-authored-by: flanakin <399533+flanakin@users.noreply.github.com>
Co-authored-by: flanakin <399533+flanakin@users.noreply.github.com>
@flanakin flanakin marked this pull request as ready for review June 10, 2025 09:14
@Copilot Copilot AI changed the title [WIP] [Hubs] Support Alibaba cloud FOCUS data [Hubs] Support Alibaba cloud FOCUS data Jun 10, 2025
Copilot finished work on behalf of flanakin June 10, 2025 09:15
Co-authored-by: flanakin <399533+flanakin@users.noreply.github.com>
Copilot finished work on behalf of flanakin June 10, 2025 09:18
Co-authored-by: flanakin <399533+flanakin@users.noreply.github.com>
Copilot finished work on behalf of flanakin June 11, 2025 01:38
@flanakin flanakin added this to the 2025-06 - June milestone Jun 11, 2025
@flanakin flanakin enabled auto-merge (squash) June 18, 2025 15:40
@flanakin flanakin disabled auto-merge June 19, 2025 18:47
@flanakin flanakin merged commit d19facd into dev Jun 19, 2025
4 checks passed
@flanakin flanakin deleted the copilot/fix-1677 branch June 19, 2025 18:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Needs: Review 👀 PR that is ready to be reviewed Skill: DevOps GitHub setup and automation Skill: Documentation Documentation updates Skill: KQL KQL queries and Data Explorer integration Tool: FinOps guide Implementing FinOps guide Tool: FinOps hubs Data pipeline solution
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Hubs] Support Alibaba cloud FOCUS data
10 participants