Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Lint baseline usage feature #107

Open
awelzel opened this issue Nov 26, 2024 · 0 comments
Open

Lint baseline usage feature #107

awelzel opened this issue Nov 26, 2024 · 0 comments

Comments

@awelzel
Copy link
Contributor

awelzel commented Nov 26, 2024

@bbannier mentioned a stray baseline check script in Spicy. Essentially it lists all tests and reports extra/unused directories in the Baseline directory.

https://github.com/zeek/spicy/blob/main/tests/Scripts/stray_baselines.py

Chatting a bit with, maybe this could be a built-in btest lint baselines command instead.

Further, it would be cool if we could figure out concrete baseline instances, rather than just the top level directories. This likely involves some heuristics matching on <prefix>-EXEC.*btest-diff\s+<name> within the tests themselves (or using individual commands directly) given that there is no native @TEST-BASELINE-DIFF command.

Conversely, explicitly reporting baselines might be a use-case, too.

Background: zeek/zeek#4034 (comment)

@awelzel awelzel changed the title Lint baseline Lint baseline usage feature Nov 26, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants