Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Run Tests in GitHub Actions using the Production DEA ODC Database #1152

Open
wants to merge 8 commits into
base: develop
Choose a base branch
from

Conversation

omad
Copy link
Contributor

@omad omad commented Nov 22, 2023

Proposed changes

This PR makes use of some AWS infrastructure I've setup to enable GitHub Actions to connect to the Production DEA ODC PostgreSQL database.

This will allow us to run automated tests of all our code and notebooks using real data, without having to maintain an extracted subset, or any other awkward workarounds.

It uses the existing OIDC authentication to AWS to create a temporary network tunnel using Basti.

Still to do

This PR only contains a framework and setup for setting up this connection and running the tests.

Still to do is:

  • Removing or merging the other GitHub Actions running tests.
  • Removing sample data and references that are being used.
  • Trying to speed things up so it doesn't take an hour to run.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant