Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[CPU] FullyConnected: sparsity weights decompression leftovers #14901

Closed

Conversation

antonvor
Copy link
Contributor

@antonvor antonvor commented Jan 3, 2023

This PR contains some fixes for previous PR: #13775

  • fixed CPU_SPARSE_WEIGHTS_DECOMPRESSION_RATE property
  • fixed primitive caching for sparse decompression case
  • removed unused code in oneDNN
  • removed min sparse rate = 0.5 limitation
  • added tests
  • doc fixes

TODO:

  • add key description for CPU_SPARSE_WEIGHTS_DECOMPRESSION_RATE
  • additional tests for key

PR in oneDNN: openvinotoolkit/oneDNN#171

@antonvor antonvor self-assigned this Jan 3, 2023
@antonvor antonvor requested review from a team as code owners January 3, 2023 07:26
@antonvor antonvor force-pushed the feature/sparsity_leftovers branch from 423e4d0 to 92ed322 Compare January 3, 2023 07:42
@antonvor antonvor added this to the 2023.0 milestone Jan 3, 2023
@@ -47,7 +47,7 @@ namespace intel_cpu {
*/
static constexpr Property<bool> denormals_optimization{"CPU_DENORMALS_OPTIMIZATION"};

static constexpr Property<float> sparse_weights_decompression_rate{"SPARSE_WEIGHTS_DECOMPRESSION_RATE"};
static constexpr Property<float> sparse_weights_decompression_rate{"CPU_SPARSE_WEIGHTS_DECOMPRESSION_RATE"};
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I suppose it's not a BW compatible change if users used string name?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Unfortunately, yes, I didn't fix it after merging my previous PR #13775

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

so, why do we need to change the name now?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

because it's a bug that's hasn't been fixed. Currently, we can't use c++ or python api to set this property, we will get error " [ NOT_FOUND ] Unsupported property SPARSE_WEIGHTS_DECOMPRESSION_RATE by CPU plugin"

@antonvor antonvor changed the title [CPU] FullyConnected: sparsity weights decompression leftovers WIP: [CPU] FullyConnected: sparsity weights decompression leftovers Jan 3, 2023
@antonvor antonvor requested a review from a team as a code owner January 3, 2023 10:06
@github-actions github-actions bot added category: CPP API OpenVINO CPP API bindings category: CPU OpenVINO CPU plugin category: inference OpenVINO Runtime library - Inference category: Python API OpenVINO Python bindings labels Jan 3, 2023
@antonvor antonvor force-pushed the feature/sparsity_leftovers branch from 20edcb3 to 47faadd Compare January 5, 2023 09:07
@antonvor antonvor requested a review from a team as a code owner January 5, 2023 09:07
@antonvor antonvor requested review from kblaszczak-intel and removed request for a team January 5, 2023 09:07
@github-actions github-actions bot added the category: docs OpenVINO documentation label Jan 5, 2023
@antonvor antonvor changed the title WIP: [CPU] FullyConnected: sparsity weights decompression leftovers [CPU] FullyConnected: sparsity weights decompression leftovers Jan 5, 2023
@antonvor
Copy link
Contributor Author

antonvor commented Jan 5, 2023

@dmitry-gorokhov could you please start review?

…n case

[CPU][oneDNN] sparsity: some fixes and removed unused code

[CPU][TESTS] FullyConnected: sparsity weights decompression tests

[CPU] FullyConnected: removed min sparse rate = 0.5 limitation

[CPU] fixed property CPU_SPARSE_WEIGHTS_DECOMPRESSION_RATE

[CPU][TESTS] added CPU_SPARSE_WEIGHTS_DECOMPRESSION_RATE test

[CPU][DOC] doc dixes
@antonvor
Copy link
Contributor Author

changes have been included in this PR #15918

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
category: CPP API OpenVINO CPP API bindings category: CPU OpenVINO CPU plugin category: docs OpenVINO documentation category: inference OpenVINO Runtime library - Inference category: Python API OpenVINO Python bindings
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants