Data Quality - Blank profiler page

[pmbrull]

Affected module
Frontend

Describe the bug
After running ingestion + profiling, the profiler tab goes blank.

To Reproduce

This is the payload from http://localhost:8585/api/v1/tables/name/aws_redshift.public.category?fields=columns,usageSummary,followers,joins,tags,owner,dataModel,tableProfile,tests&include=all

{
    "id": "04a6a9a3-e94e-4240-b678-33e17572552f",
    "name": "category",
    "displayName": "category",
    "fullyQualifiedName": "aws_redshift.public.category",
    "description": "",
    "version": 0.1,
    "updatedAt": 1646642435432,
    "updatedBy": "anonymous",
    "href": "http://localhost:8585/api/v1/tables/04a6a9a3-e94e-4240-b678-33e17572552f",
    "tableType": "Regular",
    "columns": [
        {
            "name": "catid",
            "displayName": "catid",
            "dataType": "SMALLINT",
            "dataTypeDisplay": "smallint",
            "fullyQualifiedName": "aws_redshift.public.category.catid",
            "tags": []
        },
        {
            "name": "catgroup",
            "displayName": "catgroup",
            "dataType": "VARCHAR",
            "dataLength": 1,
            "dataTypeDisplay": "varchar",
            "fullyQualifiedName": "aws_redshift.public.category.catgroup",
            "tags": []
        },
        {
            "name": "catname",
            "displayName": "catname",
            "dataType": "VARCHAR",
            "dataLength": 1,
            "dataTypeDisplay": "varchar",
            "fullyQualifiedName": "aws_redshift.public.category.catname",
            "tags": []
        },
        {
            "name": "catdesc",
            "displayName": "catdesc",
            "dataType": "VARCHAR",
            "dataLength": 1,
            "dataTypeDisplay": "varchar",
            "fullyQualifiedName": "aws_redshift.public.category.catdesc",
            "tags": []
        }
    ],
    "database": {
        "id": "76f6dcab-3d2b-4efd-aff7-719038b42fae",
        "type": "database",
        "name": "aws_redshift.public",
        "displayName": "public",
        "href": "http://localhost:8585/api/v1/databases/76f6dcab-3d2b-4efd-aff7-719038b42fae"
    },
    "service": {
        "id": "4e5da620-0851-482f-96ef-2ec034803de7",
        "type": "databaseService",
        "name": "aws_redshift",
        "description": ""
    },
    "serviceType": "Redshift",
    "tags": [],
    "usageSummary": {
        "dailyStats": {
            "count": 0,
            "percentileRank": 0
        },
        "weeklyStats": {
            "count": 0,
            "percentileRank": 0
        },
        "monthlyStats": {
            "count": 0,
            "percentileRank": 0
        },
        "date": "2022-03-07"
    },
    "followers": [],
    "joins": {
        "startDate": "2022-02-05",
        "dayCount": 30,
        "columnJoins": []
    },
    "tableProfile": [
        {
            "profileDate": "2022-03-07",
            "columnCount": 4,
            "rowCount": 11,
            "columnProfile": [
                {
                    "name": "catid",
                    "valuesCount": 11,
                    "nullCount": 0,
                    "nullProportion": 0,
                    "uniqueCount": 11,
                    "uniqueProportion": 1,
                    "min": 1,
                    "max": 11,
                    "mean": 6,
                    "sum": 66,
                    "stddev": 3.16227766016838,
                    "histogram": {
                        "boundaries": [
                            "0.0000 to 2.5000",
                            "2.5000 to 5.0000",
                            "5.0000 to 7.5000",
                            "7.5000 to 10.0000",
                            "10.0000 to 12.5000"
                        ],
                        "frequencies": [
                            2,
                            2,
                            3,
                            2,
                            2
                        ]
                    }
                },
                {
                    "name": "catgroup",
                    "valuesCount": 11,
                    "nullCount": 0,
                    "nullProportion": 0,
                    "uniqueCount": 3,
                    "uniqueProportion": 0.2727272727272727,
                    "minLength": 5,
                    "maxLength": 8,
                    "mean": 6
                },
                {
                    "name": "catname",
                    "valuesCount": 11,
                    "nullCount": 0,
                    "nullProportion": 0,
                    "uniqueCount": 11,
                    "uniqueProportion": 1,
                    "minLength": 3,
                    "maxLength": 9,
                    "mean": 4
                },
                {
                    "name": "catdesc",
                    "valuesCount": 11,
                    "nullCount": 0,
                    "nullProportion": 0,
                    "uniqueCount": 11,
                    "uniqueProportion": 1,
                    "minLength": 15,
                    "maxLength": 42,
                    "mean": 25
                }
            ]
        }
    ],
    "deleted": false
}

Expected behavior
A clear and concise description of what you expected to happen.

Version:

• OS: [e.g. iOS]
• Python version:
• OpenMetadata version: [e.g. 0.8]
• OpenMetadata Ingestion package version: [e.g. openmetadata-ingestion[docker]==XYZ]

Additional context
Add any other context about the problem here.

[pmbrull]

cc @Sachin-chaurasiya @ShaileshParmar11 let's try to prioritize this

[ShaileshParmar11]

Hi we have tested out with above data but unable to reproduce the scenario.
below steps we followed.

• Took fresh pull from main and did mvn build
• did drop-create-all
• fresh ingested data

[pmbrull]

error related to histogram https://github.com/open-metadata/OpenMetadata/blob/main/catalog-rest-service/src/main/resources/json/schema/entity/data/table.json#L353

Note the payload:

columnProfile: [,…]
0: {name: "catid", valuesCount: 11, nullCount: 0, nullProportion: 0, uniqueCount: 11, uniqueProportion: 1,…}
histogram: {,…}
boundaries: ["0.0000 to 2.5000", "2.5000 to 5.0000", "5.0000 to 7.5000", "7.5000 to 10.0000", "10.0000 to 12.5000"]
0: "0.0000 to 2.5000"
1: "2.5000 to 5.0000"
2: "5.0000 to 7.5000"
3: "7.5000 to 10.0000"
4: "10.0000 to 12.5000"
frequencies: [2, 2, 3, 2, 2]
0: 2
1: 2
2: 3
3: 2
4: 2

[pmbrull]

Error: react-dom.development.js?61bb:13413 Uncaught Error: Objects are not valid as a React child (found: object with keys {boundaries, frequencies}). If you meant to render a collection of children, use an array instead

Note the histogram definition, which is an object

[pmbrull]

can be patched now for a workaround with

const excludedMetrics = [
  'profilDate',
  'name',
  'nullCount',
  'nullProportion',
  'uniqueCount',
  'uniqueProportion',
  'rows',
  'histogram',
];