Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

e2e: Generate a percentage of invalid txs with load command #617

Open
Tracked by #51
hvanz opened this issue Mar 30, 2023 · 4 comments
Open
Tracked by #51

e2e: Generate a percentage of invalid txs with load command #617

hvanz opened this issue Mar 30, 2023 · 4 comments
Labels
e2e Related to our end-to-end tests enhancement New feature or request

Comments

@hvanz
Copy link
Member

hvanz commented Mar 30, 2023

Feature Request

Problem Definition

The load command in the e2e runner generates only valid transactions. A transaction is valid in the e2e app if it's of the form ".+=.+". This is not realistic because in production environments some transactions sent to the nodes are invalid. For instance, Gaia nodes receive between 20 to 30% of transactions that are rejected by the Hub application.

Proposal

Add a new field to the e2e manifest for controlling the percentage of invalid txs that load will generate.

@hvanz hvanz added enhancement New feature or request e2e Related to our end-to-end tests labels Mar 30, 2023
@hvanz hvanz self-assigned this Mar 30, 2023
@cason
Copy link
Contributor

cason commented Apr 3, 2023

Are duplicated transactions also deemed as invalid? This is also a scenario to consider.

@lasarojc
Copy link
Contributor

lasarojc commented Apr 3, 2023

Are duplicated transactions also deemed as invalid? This is also a scenario to consider.

Agree, but this would be a test to the test application, rather then CometBFT, since the application is expected to handle duplications.

@hvanz
Copy link
Member Author

hvanz commented Apr 4, 2023

For testing invalid transactions, I think it doesn't matter the reason why the application considers it invalid. Duplicate transactions is an interesting scenario for testing other parts of the code. We could add a separate field to the manifest to control the percentage of duplicate transactions.

@cason
Copy link
Contributor

cason commented Apr 5, 2023

This pretty old issue is probably still observable in the current implementation. The only to prevent this from happening, is to have the application properly rejecting duplicated transactions: tendermint/tendermint#3865

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
e2e Related to our end-to-end tests enhancement New feature or request
Projects
No open projects
Status: Todo
Development

No branches or pull requests

3 participants