Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Hugely inflated converted light files for single module runs #130

Open
sam-fogarty opened this issue Jun 23, 2024 · 0 comments
Open

Hugely inflated converted light files for single module runs #130

sam-fogarty opened this issue Jun 23, 2024 · 0 comments

Comments

@sam-fogarty
Copy link
Member

I have noticed when converting light data files from module1 that the converted files are much larger than their original .data files. For example, the original .data files for timestamp 20220208_124818 are 15.2 + 15.2 = 30.4 GB. While the data converted with the adc64 formatter tool directly is 6.6 + 6.7 = 13.3 GB. Using ndlar_flow's version of the converter, the new file is 80.8 GB. Then when I try to run the light event building + reconstruction, the new file ends up being ~150 GB. I haven't checked with the other modules, but I suspect the issue will exist with them too (should be checked). I don't think the issue exists for 2x2 since I looked at a file from the first ramp up (mpd_run_hvramp_rctl_079_p0.data), and the .data file has 4.5GB while the converted file has 4.4GB. So the issue seems to be isolated to the adc64 formatter in flow, not the mpd version for 2x2.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant