You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
If an output file exists and the hash is the same then it should be skipped.
Notably, a few steps will need additional files created i.e. FastANI. In cases like this where multiple threads are processing data then the writer thread should write these results to disk (e.g. every 500 results).
Perhaps each major/minor step could interface through JSON/YAML files which would serve nicely as a method for checkpointing.
The text was updated successfully, but these errors were encountered:
If an output file exists and the hash is the same then it should be skipped.
Notably, a few steps will need additional files created i.e. FastANI. In cases like this where multiple threads are processing data then the writer thread should write these results to disk (e.g. every 500 results).
Perhaps each major/minor step could interface through JSON/YAML files which would serve nicely as a method for checkpointing.
The text was updated successfully, but these errors were encountered: