Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SOLR-17525 backport to 9.x #2921

Merged
merged 5 commits into from
Dec 20, 2024
Merged

Conversation

alessandrobenedetti
Copy link
Contributor

* added support to store Large Language Models external endpoints config for text to vector encoding
* added a query parser that can use such external models to encode text to vector and run a KNearest Neighbour search

---------

Co-authored-by: Christine Poerschke <[email protected]>
Co-authored-by: Christos  Malliaridis <[email protected]>
Co-authored-by: David Smiley <[email protected]>

(cherry picked from commit e8803e6)
@alessandrobenedetti
Copy link
Contributor Author

So @malliaridis , I started the backporting, you see the cherry picked commit and some gradle changes that should be what we want for 9.x.

I'm waiting for the gradle checks to run and be green.
You additional validation would be really helpful to close this story :)
Thanks!

@malliaridis
Copy link
Contributor

I've looked into the gradle changes and they look good so far. Only one note, there is a checksum file langchain4j-0.35.0.jar.sha1 that is being removed when running gradlew updateLicenses. So you may want to commit the removal as well.

Additionally, 9x workflows sometimes stuck during compilation and take up to 6h to be interrupted at the end. So you may want to restart the action if it takes more than 30 minutes on the same gradle task.

@alessandrobenedetti
Copy link
Contributor Author

Sure, I'll do this and when green merge, thanks for the support!

@alessandrobenedetti
Copy link
Contributor Author

alessandrobenedetti commented Dec 20, 2024

Uhm Locally I have a green gradle check, I'm tented to merge as the remote gradle job on github is taking forever, it's the 3-4 time I restarted it...

@alessandrobenedetti alessandrobenedetti merged commit 0abf40d into apache:branch_9x Dec 20, 2024
1 of 2 checks passed
alessandrobenedetti added a commit that referenced this pull request Dec 20, 2024
* SOLR-17525: Text Embedder Query Parser (#2809)

* added support to store Large Language Models external endpoints config for text to vector encoding
* added a query parser that can use such external models to encode text to vector and run a KNearest Neighbour search

---------

Co-authored-by: Christine Poerschke <[email protected]>
Co-authored-by: Christos  Malliaridis <[email protected]>
Co-authored-by: David Smiley <[email protected]>

(cherry picked from commit e8803e6)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants