Skip to content

[docs] Update quickstart-flink doc to use kv.snapshot.interval 0s to avoid client obtain token issue#2660

Merged
wuchong merged 2 commits intoapache:mainfrom
luoyuxia:quickstart-doc-fix
Feb 12, 2026
Merged

[docs] Update quickstart-flink doc to use kv.snapshot.interval 0s to avoid client obtain token issue#2660
wuchong merged 2 commits intoapache:mainfrom
luoyuxia:quickstart-doc-fix

Conversation

@luoyuxia
Copy link
Contributor

@luoyuxia luoyuxia commented Feb 12, 2026

Purpose

Linked issue: close #xxx
To fix client obtain token issue

Brief change log

Tests

API and Format

Documentation

s3.secret-key: rustfsadmin
s3.path-style-access: true
kv.snapshot.interval: 60s
kv.snapshot.interval: 0s
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Unfortunately, we'll still need it. Otherwise, it'll throw exception

org.apache.fluss.exception.SecurityTokenException: Failed to get file access security token: The security token included in the request is invalid. (Service: AWSSecurityTokenService; Status Code: 403; Error Code: InvalidClientTokenId; Request ID: fabc25ae-dffb-43bf-af19-f2896f00d918; Proxy: null)

when client try to get sts token from server.
Similar to #2148

But to support it, we may need change the code the generate sts token in s3 filesystem.
See:
https://github.com/orgs/rustfs/discussions/1239

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@luoyuxia Thank you, could you open an issue in fluss to fix the way to generate sts token for s3?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

create in #2661

datalake.iceberg.s3.path-style-access: true
datalake.iceberg.client.region: us-east-1
volumes:
- ./lib/fluss-lake-iceberg-$FLUSS_DOCKER_VERSION$.jar:/opt/fluss/plugins/iceberg/fluss-lake-iceberg-$FLUSS_DOCKER_VERSION$.jar
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we don't need to mount the iceberg plugin jar

@luoyuxia luoyuxia changed the title [docs] Update quickstart-flink doc to use kv.snapshot.interval 0s to … [docs] Update quickstart-flink doc to use kv.snapshot.interval 0s to avoid client obtain token issue Feb 12, 2026
@luoyuxia
Copy link
Contributor Author

cc @wuchong @leekeiabstraction

s3.secret-key: rustfsadmin
s3.path-style-access: true
kv.snapshot.interval: 60s
kv.snapshot.interval: 0s
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@luoyuxia Thank you, could you open an issue in fluss to fix the way to generate sts token for s3?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Remove this line as well.

@leekeiabstraction
Copy link
Contributor

@luoyuxia did you verify if this is an issue in Flink QuickStart?

I was able to make this work with Flink QuickStart.

It was only the paimon/iceberg one that was failing

@luoyuxia
Copy link
Contributor Author

@wuchong Thanks for review. Comments addressed.

@luoyuxia
Copy link
Contributor Author

@luoyuxia did you verify if this is an issue in Flink QuickStart?

I was able to make this work with Flink QuickStart.

It was only the paimon/iceberg one that was failing

If just follow the steps of Flink QuickStart. I won't meet this problem. But if I sumibit a sql to query all data of a primary key table, the issue will hapeen

@leekeiabstraction
Copy link
Contributor

If just follow the steps of Flink QuickStart. I won't meet this problem. But if I sumibit a sql to query all data of a primary key table, the issue will hapeen

I see, maybe not as part of this PR, let's also try to add specific SQL query that cause the issue in? So that when we revisit this after fixing, we can naturally validate by running the additional query.

Thank you for catching!

@wuchong wuchong merged commit f97cf6c into apache:main Feb 12, 2026
2 checks passed
wuchong pushed a commit that referenced this pull request Feb 12, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants