Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] Add telemetry #965

Draft
wants to merge 5 commits into
base: develop
Choose a base branch
from

Conversation

valentimarco
Copy link
Collaborator

@valentimarco valentimarco commented Nov 5, 2024

Description

I'd like to propose my idea of telemetry!

What is collected?

  • LLM and Embedder name
  • Country
  • Version
  • System data like cpus and total memory

What is missing?

  • Backend where store all this data with some simple analytics(Simple html or Grafana)
  • Way to retrieve the country without using external APIs (tried locale and /etc/localtime but must be set by the user)
  • Possible tests??

Possible problems

  • Because of the GPDR, we must introduce a form to request the deletion of the data registered (But the telemetry id must be genereted one time and stored in the db). Reference from qdrant docs
  • Can be a moment where the telemetry data is updated and at the same time is sent to the backend. This can be resolved by implementing a mutex on the function job in order to block any possible update of the data.
  • How much time must pass before send the next telemetry packet? Every 24 hours can be enough?

Reference

Related to Roadmaps' objective

Type of change

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to not work as expected)
  • This change requires a documentation update

Checklist:

  • My code follows the style guidelines of this project
  • I have performed a self-review of my own code
  • I have commented my code, particularly in hard-to-understand areas

@valentimarco valentimarco requested a review from sambarza November 7, 2024 20:19
@valentimarco valentimarco added the enhancement New feature or request label Nov 7, 2024
@valentimarco valentimarco linked an issue Nov 7, 2024 that may be closed by this pull request
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Base telemetry
1 participant