Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Kernel] Remove Coordinated Commits from public API #3938

Conversation

scottsand-db
Copy link
Collaborator

Which Delta project/connector is this regarding?

  • Spark
  • Standalone
  • Flink
  • Kernel
  • Other (fill in here)

Description

We are re-thinking the design of the Coordinated Commits table feature (currently still in RFC). Thus, we should remove it from the public Kernel API for Delta 3.3 release.

To summarize the changes of this PR

  • I remove getCommitCoordinatorClientHandler from the Engine interface
  • I move various previously public CC interfaces and classes to be internal now
  • SnapshotImpl::getTableCommitCoordinatorClientHandlerOpt is hardcoded to return an empty optional
  • Delete failing test suites and unapplicable utils

How was this patch tested?

Existing CI tests.

Does this PR introduce any user-facing changes?

We remove coordinated commits from the public kernel API.

Copy link
Collaborator

@vkorukanti vkorukanti left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM % CI failure

Copy link
Collaborator

@allisonport-db allisonport-db left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! Please cherry-pick to branch-3.3 as well

Copy link
Collaborator

@dhruvarya-db dhruvarya-db left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@scottsand-db scottsand-db force-pushed the kernel_remove_coordinated_commits_from_public_api branch from c3ea45b to 7c47c5a Compare December 13, 2024 17:49
@scottsand-db scottsand-db merged commit fc81d12 into delta-io:master Dec 13, 2024
19 checks passed
scottsand-db added a commit to scottsand-db/delta that referenced this pull request Dec 13, 2024
- [ ] Spark
- [ ] Standalone
- [ ] Flink
- [X] Kernel
- [ ] Other (fill in here)

We are re-thinking the design of the Coordinated Commits table feature
(currently still in RFC). Thus, we should remove it from the public
Kernel API for Delta 3.3 release.

To summarize the changes of this PR

- I remove `getCommitCoordinatorClientHandler` from the `Engine`
interface
- I move various previously `public` CC interfaces and classes to be
`internal` now
- `SnapshotImpl::getTableCommitCoordinatorClientHandlerOpt` is hardcoded
to return an empty optional
- Delete failing test suites and unapplicable utils

Existing CI tests.

We remove coordinated commits from the public kernel API.
scottsand-db added a commit that referenced this pull request Dec 13, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants