本代码是多模态RAG的示例，通过语言检索图像。并跟本地多模态大模型进行交互获取最终响应。
alphabet = list("ABCDEFGHIJKLMNOPQRSTUVWXYZ") + ["SPACE"]
for letter in alphabet: 代码逐个字母查询 “怎么用ASL手势表示字母{letter}”
代码逐个字母对比所有多模态图片的Embedding内容，并且给出相似度分数。上面例子可以看出来27个图片的多模态查询准确率 可以达到100%
-
Notifications
You must be signed in to change notification settings - Fork 0
monkeywl2020/27asl_muti_model_rag
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
27个ASL手势的多模态RAG相似度对比
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published