SPARK CAR checksums

[bajtos]

eta: 2024-04-15
description: Enhance the SPARK module to compute a checksum of downloaded CAR files. Implement a fraud-detection step that will reject measurements where the checksum disagrees with the majority.

See https://www.notion.so/pl-strflt/SPARK-roadmap-to-LabWeek-23-5d41e603859a4e32908d3c818e3d4542?pvs=4#a00f37b6998b485c9e628604cde3af2e

Tasks

Preview Give feedback

1. Enhance the SPARK module to compute and submit a SHA-256 hash of the CAR file downloaded
2. Publish a new SPARK & Station Core & Station Desktop version
3. Update SPARK API to record the new measurement field
4. Add another fraud-detection step to reject measurements with incorrect checksum
5. Update the Grafana dashboard to give us visibility into behaviour of this new feature

[patrickwoodhead]

@bajtos what is the latest on this one? Shall we update the ETA and/or convert the subtasks into issues?

[bajtos]

I updated ETA.

IMO, there is little value in collecting CAR checksums when >95% of retrievals fail and therefore, only <5% of measurements include checksums.