Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

HJ-87 and HJ-88: model changes #5600

Open
wants to merge 36 commits into
base: main
Choose a base branch
from

Conversation

thingscouldbeworse
Copy link
Contributor

Prereq migration and model change for HJ-87 & HJ-88

Description Of Changes

Write some things here about the changes and any potential caveats

Code Changes

  • list your code changes here

Steps to Confirm

  1. list any manual steps for reviewers to confirm the changes

Pre-Merge Checklist

  • Issue requirements met
  • All CI pipelines succeeded
  • CHANGELOG.md updated
  • Followup issues:
    • Followup issues created (include link)
    • No followup issues
  • Database migrations:
    • Ensure that your downrev is up to date with the latest revision on main
    • Ensure that your downgrade() migration is correct and works
      • If a downgrade migration is not possible for this change, please call this out in the PR description!
    • No migrations
  • Documentation:
    • Documentation complete, PR opened in fidesdocs
    • Documentation issue created in fidesdocs
    • If there are any new client scopes created as part of the pull request, remember to update public-facing documentation that references our scope registry
    • No documentation updates required

Copy link

vercel bot commented Dec 12, 2024

The latest updates on your projects. Learn more about Vercel for Git ↗︎

1 Skipped Deployment
Name Status Preview Comments Updated (UTC)
fides-plus-nightly ⬜️ Ignored (Inspect) Visit Preview Dec 20, 2024 10:05pm

Copy link

cypress bot commented Dec 12, 2024

fides    Run #11632

Run Properties:  status check passed Passed #11632  •  git commit fd6d67c918 ℹ️: Merge 5e0afc137fbf857700209cb3bf9caa0f64324922 into f77633e33a7b3e77e127caedfbd5...
Project fides
Branch Review refs/pull/5600/merge
Run status status check passed Passed #11632
Run duration 00m 48s
Commit git commit fd6d67c918 ℹ️: Merge 5e0afc137fbf857700209cb3bf9caa0f64324922 into f77633e33a7b3e77e127caedfbd5...
Committer Kirk Hardy
View all properties for this run ↗︎

Test results
Tests that failed  Failures 0
Tests that were flaky  Flaky 0
Tests that did not run due to a developer annotating a test with .skip  Pending 0
Tests that did not run due to a failure in a mocha hook  Skipped 0
Tests that passed  Passing 4
⚠️ You've recorded test results over your free plan limit.
Upgrade your plan to view test results.
View all changes introduced in this branch ↗︎

Copy link

codecov bot commented Dec 13, 2024

Codecov Report

Attention: Patch coverage is 85.71429% with 3 lines in your changes missing coverage. Please review.

Project coverage is 87.13%. Comparing base (f77633e) to head (5e0afc1).

Files with missing lines Patch % Lines
src/fides/api/models/detection_discovery.py 75.00% 1 Missing and 2 partials ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main    #5600      +/-   ##
==========================================
- Coverage   87.14%   87.13%   -0.01%     
==========================================
  Files         388      388              
  Lines       24000    24016      +16     
  Branches     2594     2595       +1     
==========================================
+ Hits        20914    20927      +13     
- Misses       2525     2526       +1     
- Partials      561      563       +2     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Copy link
Contributor

@adamsachs adamsachs left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

generally looks solid but there are a few points that need cleanup i think

Copy link
Contributor

@adamsachs adamsachs left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ok thanks for making the requested updates! this is looking good, just a few minor nits that'd be nice to get addressed if you can.

separately, there seems to be a test failure? it seems unlikely to me that it'd b caused by your changes, but i don't see it on main in the past few commits. maybe it'll go away with merging main in?

and last note is just to keep an eye on the downrev in your migration. i know there's at least one other in-flight PR that updates our migrations, so if it gets merged before yours, you'll just have to remember to bump your downrev to the new head

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: i'd probably update the filename here just to be consistent with the new functionality - it can be hard to track down migrations sometimes and relying on the filename can help with looking it up, so this could add a bit of confusion moving forward!

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

changed in 61f38a4#diff-6ea847dd5dab7785c69f11369a07c894290e837501325a3b8eb5f003059c33ea and made sure column isn't pluralized in the comment

CHANGELOG.md Outdated
@@ -21,6 +21,7 @@ The types of changes are:
- New page in the Cookie House sample app to demonstrate the use of embedding the FidesJS SDK on the page [#5564](https://github.com/ethyca/fides/pull/5564)
- Added event based communication example to the Cookie House sample app [#5597](https://github.com/ethyca/fides/pull/5597)
- Added new erasure tests for BigQuery Enterprise [#5554](https://github.com/ethyca/fides/pull/5554)
- Migration to add the `hidden` and `data_use` columns to `stagedresource` table, prereqs for Data Catalog work in Fidesplus [#5600](https://github.com/ethyca/fides/pull/5600/)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit

Suggested change
- Migration to add the `hidden` and `data_use` columns to `stagedresource` table, prereqs for Data Catalog work in Fidesplus [#5600](https://github.com/ethyca/fides/pull/5600/)
- Migration to add the and `data_use` column to `stagedresource` table, prereq for Data Catalog work in Fidesplus [#5600](https://github.com/ethyca/fides/pull/5600/)

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@@ -273,6 +274,26 @@ def test_patch_connection_secrets_removes_access_token_for_client_config(
assert resp.status_code == HTTP_200_OK
assert resp.json()["items"][0]["authorized"] is False

def test_system_patch_hidden(
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

it'd be nice for this test to assert that the updates are actually reflected in the db! there have been many times where an endpoint gives a 200 and the correct response body but it doesn't actually make the intended change to the db :)

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@adamsachs adamsachs mentioned this pull request Dec 17, 2024
13 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants