SAP ODP hierarchy extraction limitations are not clear

[fmms]

Currently the page states:

https://learn.microsoft.com/en-us/azure/data-factory/sap-change-data-capture-management

Here are current limitations of the SAP CDC connector in Data Factory:
You can't use SAP hierarchies with the solution.

However, at https://learn.microsoft.com/en-us/azure/data-factory/sap-change-data-capture-prerequisites-configuration you state:

1931427 - To use ODP API 2.0 that supports SAP hierarchies

How do the two information relate to each other, what exactly is supported with which versions? What error message do I get if I try to extract a hierarchy? Currently we get:

at Source 'SRCSAPODP': Please check error message, if it contains SAP server related error stacktrace, please contact SAP admin for assistance. Otherwise, please contact Microsoft support for further assistance. Error Message: Found duplicate column(s) in the data schema: `HEADERID`, `LANGU`, `NODENAME`, `TXTMD`, `TXTLG`, `TXTSH`;, Exception: org.apache.spark.sql.util.SchemaUtils$.checkColumnNameDuplication(SchemaUtils.scala:85)

Most likely because we are not able to select a segment of the hierarchy...

---

Document Details

⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

• ID: c5675caf-2954-fc94-7b64-c220e1442f8d
• Version Independent ID: 761c956e-5283-3764-eed4-39de54d0c41e
• Content: Manage the SAP CDC process - Azure Data Factory
• Content Source: articles/data-factory/sap-change-data-capture-management.md
• Service: data-factory
• Sub-service: data-movement
• GitHub Login: @ukchrist
• Microsoft Alias: ulrichchrist

[RamanathanChinnappan-MSFT]

@fmms

Thanks for your feedback! We will investigate and update as appropriate.

[RamanathanChinnappan-MSFT]

@fmms

The two pieces of information are not directly related. The first statement you mentioned is a limitation of the SAP CDC connector in Data Factory, which means that you cannot use SAP hierarchies with the solution. The second statement is a prerequisite for using ODP API 2.0 that supports SAP hierarchies.

Regarding the error message you received, it seems to be related to a duplicate column name in the data schema. It is not directly related to the use of hierarchies. However, if you are trying to select a segment of the hierarchy that is not supported by the connector, you may receive an error message indicating that the hierarchy is not supported.

To determine which versions of ODP API support SAP hierarchies, you may need to consult the SAP documentation or contact SAP support.

For an issue like this, I'd recommend you create a support ticket since the support team will be able to respond much more quickly and have a conversation with you to figure out what could be going on.

[fmms]

@RamanathanChinnappan-MSFT I do not understand your response. My SAP system supports ODP API 2.0. Validated by ensuring RODPS_REPL_ODP_ACTIVATE_CONT does exist.

Why does the documentation mention that ODP v2.0 does support hierarchies if the ADF implementation does not support hierarchies at all?

If there would be an error message stating that hierarchies are not supported, I would not raise this request against the documentation. However, I have tried for 0COSTCENTER_0101_HIER , 0GL_ACCOUNT_T011_HIER and 0COSTELMNT_0102_HIER none of them raise an error message.

How can I even select a specific segment of a hierarchy?

[kutny]

Hi @fmms , I got into a similar problem. Did you find the solution?

I am trying to ingest the I_CostCenterHierarchyNode CDSview (SQL view name: IFICOSTCENTERHN) and got the Found duplicate column(s) in the data schema: HEADERID, LANGU, FOLDERNAME, TXTMD, TXTLG, TXTSH; error as well.

[fmms]

@kutny unfortunately, I have gone through multiple weeks of mails with support. However, the result was that hierarchies are not supported and I should open a corresponding idea. I have done this. you find it at https://feedback.azure.com/d365community/idea/09e74f82-c20e-ee11-a81c-000d3a0d3715 . Please add your vote. If you find any other work around, please come back here. For me it would be super awesome if hierarchy extractors would just work.