Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Very slow usage with large REDIS KEYS count #105

Closed
jquick opened this issue Jan 10, 2023 · 1 comment
Closed

Very slow usage with large REDIS KEYS count #105

jquick opened this issue Jan 10, 2023 · 1 comment

Comments

@jquick
Copy link

jquick commented Jan 10, 2023

Hello,

We are using version 2.3 of this client and its been working great until the Redis DB started to balloon. We are writing metrics to REDIS in PHP threads which is causing lots of duplicates and total number of keys. We can see anywhere from 100-200k KEYS. This causes the RenderTextFormat to never return.

We are looking into maybe just flushing the DB every render to keep it small (every 10 sec). Is there a better way to handle this or some way to set generic/non-changing key names instead of:

PROMETHEUS_summary_METRIC_KEYS:panda_requests_trackerall:W10=:value:63bdd2f417f0e4.82673862
PROMETHEUS_summary_METRIC_KEYS:panda_requests_trackerall:W10=:value:63bdd38696a042.04345791
PROMETHEUS_summary_METRIC_KEYS:panda_requests_trackerall:W10=:value:63bdd33908d485.81089573
PROMETHEUS_summary_METRIC_KEYS:panda_requests_trackerall:W10=:value:63bdd488b3f4b7.30254979

So they just get overwritten?

Thanks for help!

@LKaemmerling
Copy link
Member

Hey @jquick,

please have a look at #99. This will be a new storage engine that comes with the next release. Could you please test it against your workload?

Basically, your issue is already handled in #92, I would therefore like to move it to this issue :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants