New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

How to avoid insert same doc while rebuild? #43

Open

Xuanwo opened this issue Apr 10, 2023 · 1 comment

Contributor

Xuanwo commented Apr 10, 2023 •

edited

Loading

I found we will insert all content during rebuild while may double the OpenAI token cost. Is it possible to avoid it?

Contributor

BohuTANG commented Apr 10, 2023

Now, we use $ to reduce complexity:) but it's already quite cheap.
We will plan how to make incremental embedding later on.

AGDholo mentioned this issue

支持增量更新数据吗？ xiaohuoni/umi-hzb#2

Closed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment