Skip to content

[feature][COM][storage] add resultset field masking and truncation support#5384

Merged
casionone merged 1 commit intoapache:dev-1.9.0from
aiceflower:relaese-1.9.0-spark-sup-diagnosis
Mar 26, 2026
Merged

[feature][COM][storage] add resultset field masking and truncation support#5384
casionone merged 1 commit intoapache:dev-1.9.0from
aiceflower:relaese-1.9.0-spark-sup-diagnosis

Conversation

@aiceflower
Copy link
Member

@aiceflower aiceflower commented Mar 26, 2026

Search before asking

  • I had searched in the issues and found no similar feature requirement.

Problem Description

Linkis resultset needs field masking for sensitive data and truncation for oversized fields.

Description

Add resultset field masking and truncation support for data security and handling large fields.

Use case

  1. Mask sensitive fields (e.g., phone numbers, IDs) in query results
  2. Truncate oversized fields to prevent memory issues

Solutions

  1. Added FieldTruncationResult and OversizedFieldInfo classes
  2. Modified storage layer to support field masking and truncation
  3. Enhanced resultset serialization

Anything else

None.

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

- 在EntranceConfiguration中新增任务诊断配置项,包括启用开关、引擎类型、超时时间等
- 添加DOCTOR_REALTIME_DIAGNOSE_URL配置项和延长诊断请求超时时间至300秒
- 在AI SQL支持创建者列表中增加nodeexecution选项
@aiceflower aiceflower changed the title [feat][EC][spark] add Spark timeout task diagnosis and configuration optimization [feature][COM][storage] add resultset field masking and truncation support Mar 26, 2026
@aiceflower aiceflower changed the title [feature][COM][storage] add resultset field masking and truncation support [feature][com][storage] add resultset field masking and truncation support Mar 26, 2026
@aiceflower aiceflower changed the title [feature][com][storage] add resultset field masking and truncation support [feature][COM][storage] add resultset field masking and truncation support Mar 26, 2026
Copy link
Contributor

@casionone casionone left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM.

@casionone casionone merged commit 0ec73b1 into apache:dev-1.9.0 Mar 26, 2026
6 of 11 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants