Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow unsorted tests #217

Open
ylavoie opened this issue Apr 5, 2021 · 1 comment
Open

Allow unsorted tests #217

ylavoie opened this issue Apr 5, 2021 · 1 comment

Comments

@ylavoie
Copy link
Contributor

ylavoie commented Apr 5, 2021

yath sorts test files before testing.

There should be a way to either shuffle the selected tests or follow the order provided in the argument list.

@exodist
Copy link
Member

exodist commented Apr 5, 2021

I will look into this when I have a chance. The problem here is that yath was built around running tests concurrently, with tests re-ordered (when possible) so that the slowest run first on N-1 of the concurrency slots, in order to avoid running a single super long tests at the end with other slots being empty. So while your request is totally reasonable, the test-reordering design may make it difficult as things were built with the assumption that test order could be altered at any time, and thus the order is assumed unimportant in many places.

If there is an easy way to fix this I will do it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants