Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

bug: Fix unreliable tests in coverage builds, and re-enable coverage reports #7828

Closed
1 of 6 tasks
teor2345 opened this issue Oct 25, 2023 · 2 comments
Closed
1 of 6 tasks
Labels
A-rust Area: Updates to Rust code C-bug Category: This is a bug C-testing Category: These are tests I-integration-fail Continuous integration fails, including build and test failures S-needs-triage Status: A bug report needs triage

Comments

@teor2345
Copy link
Contributor

teor2345 commented Oct 25, 2023

Scheduling

We haven't had coverage for a year and none of our developers think it is an important priority, so this ticket is optional.

What happened?

I expected to see this happen:

Tests consistently pass in the coverage workflow.

Instead, this happened:

Some tests fail in unrelated PRs, including:
primitives::redjubjub::tests::batch_flushes_on_max_items_test
primitives::redjubjub::tests::batch_flushes_on_max_latency_test
primitives::redpallas::tests::batch_flushes_on_max_items
primitives::redpallas::tests::batch_flushes_on_max_latency
transaction::tests::v4_with_modified_joinsplit_is_rejected

What were you doing when the issue happened?

Making an unrelated change in PR #7819.

Zebra logs

failures:
primitives::redjubjub::tests::batch_flushes_on_max_items_test
primitives::redjubjub::tests::batch_flushes_on_max_latency_test
primitives::redpallas::tests::batch_flushes_on_max_items
primitives::redpallas::tests::batch_flushes_on_max_latency
transaction::tests::v4_with_modified_joinsplit_is_rejected

test result: FAILED. 111 passed; 5 failed; 0 ignored; 0 measured; 0 filtered out; finished in 72.27s

https://github.com/ZcashFoundation/zebra/actions/runs/6645922313/job/18058933174#step:7:2868

Zebra Version

zebrad 1.3.0 PR #7819

Which operating systems does the issue happen on?

  • Linux
  • macOS
  • Windows
  • Other OS

OS details

CI

Additional information

I have turned off the coverage workflow and the coverage branch protection rule.

After this PR merges, coverage needs to be restored:

@teor2345 teor2345 added C-bug Category: This is a bug A-rust Area: Updates to Rust code S-needs-triage Status: A bug report needs triage I-integration-fail Continuous integration fails, including build and test failures P-Optional ✨ C-testing Category: These are tests labels Oct 25, 2023
@mpguerra mpguerra added this to Zebra Oct 25, 2023
@github-project-automation github-project-automation bot moved this to 🆕 New in Zebra Oct 25, 2023
@teor2345 teor2345 added A-network Area: Network protocol updates or fixes and removed A-network Area: Network protocol updates or fixes labels Oct 30, 2023
@mpguerra
Copy link
Contributor

mpguerra commented Nov 6, 2023

We need to figure out what kind of code quality metrics we want to provide and ensure that they are accurate.

Un-scheduling again for now.

@mpguerra
Copy link
Contributor

This doesn't seem to be a priority

@mpguerra mpguerra closed this as not planned Won't fix, can't repro, duplicate, stale Oct 18, 2024
@github-project-automation github-project-automation bot moved this from New to Done in Zebra Oct 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
A-rust Area: Updates to Rust code C-bug Category: This is a bug C-testing Category: These are tests I-integration-fail Continuous integration fails, including build and test failures S-needs-triage Status: A bug report needs triage
Projects
Archived in project
Development

No branches or pull requests

2 participants