Adds ability to set alternate local folder for config/metadata directory

[cfleur]

User can configure location of config directory by setting an environment variable. Rebases #109 off of v1.4.1. Closes #108. NOTE: documentation update needed!

[netlify]

✅ Deploy Preview for em27-retrieval-pipeline ready!

Name	Link
🔨 Latest commit	88220f4
🔍 Latest deploy log	https://app.netlify.com/sites/em27-retrieval-pipeline/deploys/6749860f2ba7cb00088d9dc0
😎 Deploy Preview	https://deploy-preview-111--em27-retrieval-pipeline.netlify.app
📱 Preview on mobile	Toggle QR Code... Use your smartphone camera to open QR code link.

---

To edit notification comments on pull requests, go to your Netlify site configuration.

[cfleur]

@dostuffthatmatters where should documentation for this be updated?
Also a question regarding logging: I noticed the main module in retrievals wraps the config loading in a try-except block. I was thinking of doing the same for the bundles and profiles as well, and I noticed the logging is defined inside the retrieval utils. Could you share a bit on the logic for that? Is a different logging used is different places? Does this have to do something with the containers? What is the best practice to log exceptions outside of the retrievals module?
Lastely let me know if you have any comments on the new envutils module? I was not sure whether this logic should belong to a class in types or this way as utility functions?

[cfleur]

@dostuffthatmatters I think this PR is now ready, the documentation has also been updated. Let me know if you have any comments.

[dostuffthatmatters]

Thank you for the implementation! Looks very minimal and useful. Good work.

I only have three remarks:

• the small adjustments to the docs
• avoid the chained calls
• refactor the import style

Also, could you please rename the utils.envutils to utils.environment?

[cfleur]

@dostuffthatmatters I think the requested changes have been updated, and there are a few threads on some of the comments that you can have a look at.

[dostuffthatmatters]

Hi @cfleur,

apologies for the late reply. There was other rather urgent things to do.

Thank you for the refactoring. I marked some required changes above.

Best,
Moritz

[cfleur]

Updates to location of functions getting the config directory environment variable has been changed from utils.environment -> types.Config in latest commit.

A consequence of this is that it allows to input directly the value of the environment variable into Config.load method, reverting the original changes from this PR to calls to Config.load with an argument.

However changes to file imports in these files remain, as they update import order to follow the PEP 8 style guide for imports, namely grouping imports by type and separating them by a space.

[cfleur]

@dostuffthatmatters are you okay with this or do you prefer the imports reverted in the now unchanged files?
Also would you like the commits to be squashed in the branch or remain like this?

[dostuffthatmatters]

Hi @cfleur,

no all good now. Thank you very much for implementing all the requested changes. The improvement looks very clean now! I will merge it in a bit after I run the complete tests.