Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Data Verification #239

Open
blinkdog opened this issue Oct 31, 2022 · 0 comments
Open

Data Verification #239

blinkdog opened this issue Oct 31, 2022 · 0 comments
Assignees

Comments

@blinkdog
Copy link
Contributor

There was a bundle generated with broken files (#238).
This is what (#211) is intended to prevent, but wasn't/isn't implemented yet.

I thought about making this part of (#236) but it seems like a large enough thing to do on it's own.

In essence, bring every single bundle back and make sure all the checksums match.
Note any bundles that are broken, and regenerate them (if possible).

When the new k8s based pipelines are redeployed, this should also be the idle task for the pipeline;
if we're not transferring something else, we should pull bundles from tape to check that they're still good.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant