Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Run same test in parallel by multiple test executors #1914

Open
plajjan opened this issue Sep 11, 2024 · 0 comments
Open

Run same test in parallel by multiple test executors #1914

plajjan opened this issue Sep 11, 2024 · 0 comments
Assignees
Labels
enhancement New feature or request

Comments

@plajjan
Copy link
Contributor

plajjan commented Sep 11, 2024

While working on a new module (that uses a C module under the hood) with some test I realized that I'm probably doing something that's not thread safe. I can run any single test for an extended period of time and perf tests runs fine (it runs one test at a time) but as soon as I run the normal acton test I'm getting failures, which indicates that there is some interaction between them. I reckon it's not thread safe enough.

Now I want our default execution strategy to be such that we exercise a function multiple times to get better timing measurements but also find flaky tests. I think we should extend this to also run the same test function in parallel so that we increase the chance of finding thread issues. It would only be applicable for things with C function (well, presuming no bugs in RTS / builtins / stdlib) but still, that's something, right?

@plajjan plajjan added the enhancement New feature or request label Sep 11, 2024
@plajjan plajjan self-assigned this Sep 11, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
Status: No status
Development

No branches or pull requests

1 participant