-
Notifications
You must be signed in to change notification settings - Fork 191
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Verify minicpm 2b dpo #738
Conversation
@@ -349,6 +349,55 @@ jobs: | |||
&& timeout 50s ./build/samples/cpp/beam_search_causal_lm/beam_search_causal_lm ./notus-7b-v1/ 69 | |||
| diff <(timeout 50s ./samples/python/beam_search_causal_lm/beam_search_causal_lm.py ./notus-7b-v1/ 69) - | |||
|
|||
cpp-beam_search_causal_lm-MiniCPM-2B-dpo: | |||
runs-on: ubuntu-20.04-16-cores |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
runs-on: ubuntu-20.04-16-cores | |
runs-on: ubuntu-20.04 |
Try a smaller runner. If it fails, switch to ubuntu-20.04-4-cores
source ./ov/setupvars.sh | ||
python -m pip install --upgrade-strategy eager -r ./samples/requirements.txt --pre --extra-index-url https://storage.openvinotoolkit.org/simple/wheels/nightly | ||
python -m pip install ./thirdparty/openvino_tokenizers/[transformers] --pre --extra-index-url https://storage.openvinotoolkit.org/simple/wheels/nightly | ||
optimum-cli export openvino --trust-remote-code --weight-format fp16 --model openbmb/MiniCPM-2B-dpo-fp16 MiniCPM-2B-dpo-fp16 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The model doesn't have a license. https://huggingface.co/openbmb/MiniCPM-2B-dpo-fp16/tree/main. We can't test it until it gets a compatible license. Please, submit an issue to https://huggingface.co/openbmb/MiniCPM-2B-dpo-fp16/ asking to add the license. I didn't think about it earlier. Sorry. I updated #259 to reflect the license question.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
There was
- Extend the
nightly_models
listwith the given model and run nightly tests for that model: https://github.com/openvinotoolkit/openvino.genai/tree/master/tests/python_tests#customise-tests-run. Report if there are failing tests and comment out the model in the
nightly_models = [ nightly_models
list. Add this change to your pull request (PR).
recently added. Please do that after MiniCPM-2B-dpo-fp16 gets a compatible license.
hey @pohsengl will you find a time to update a PR, please? |
This should close #261, I have updated the model list, and added tests taking reference from issue description at #259.
@Wovchena, Please let me know if there is any changes needed. Thanks!