Add a way to download full dataset archive (including PDFs) from the web.

[J08nY]

As it says in the title. This is useful if someone wants to have the full dataset.
I think a utility method that would download dataset + auxiliary datasets while not downloading all the PDFs would also be quite helpful and would actually be what 90% people want.

Wdyt @adamjanovsky ?

[adamjanovsky]

That would be a nice addition. Did you consider not adding new method? Instead we could add download_artifacts: bool = False optional argument into from_web_latest() method. What do you think?

[J08nY]

Yes I did consider it, but right now that method downloads a "pathless" dataset just into memory, while this one needs a path(directory) where to save it. So it would need two arguments, which was a bigger change but we can go that route, we just need to figure out a sensible behavior for the combinations of arguments.

[codecov]

Codecov Report

Attention: Patch coverage is 33.33333% with 48 lines in your changes missing coverage. Please review.

Project coverage is 67.46%. Comparing base (c8c91a0) to head (e7ba5ef).
Report is 5 commits behind head on main.

Files with missing lines	Patch %	Lines
src/sec_certs/dataset/dataset.py	13.52%	32 Missing ⚠️
src/sec_certs/dataset/cc.py	46.43%	15 Missing ⚠️
src/sec_certs/dataset/fips.py	80.00%	1 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main     #446      +/-   ##
==========================================
- Coverage   67.77%   67.46%   -0.31%     
==========================================
  Files          62       62              
  Lines        7567     7608      +41     
==========================================
+ Hits         5128     5132       +4     
- Misses       2439     2476      +37     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.