Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Already on GitHub? Sign in to your account

Repeatedly executing a smoke test scenario #23

Closed
lalau opened this Issue Oct 15, 2012 · 1 comment

Comments

Projects
None yet
2 participants

lalau commented Oct 15, 2012

One thing I want to add to the arrow command line is the ability to execute a smoke test scenario repeatedly for a specified number of times, say 100. We collect test result each time and report on how many times it fails. It would be useful to see if the feature is stable or the test setup itself is stable. Sometimes I write a test and it pass locally for once or twice but after checking in the code, it would pass and fail intermittently. If I can simulate the repeated testing in the pipeline environment locally, it would increase my confidence that my test and the feature is stable. What do you think about this? It would be something like "--repeat=100".

@ktslwy can we do this through some shell script outside arrow ? this does not add any feature, and sounds more like a test. Thoughts ?

@lalau lalau closed this Oct 29, 2012

@proverma proverma pushed a commit that referenced this issue Mar 25, 2013

@wangjungithub wangjungithub Merge pull request #23 from liangji101/upstream
fix ut
b070b01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment