Meta PR - changes from private branch to be pulled in

[dalehamel]

This is not in a mergeable state, this is just to share and discuss some of the changes we've done.

In order to move faster, this work was developed collaboratively on a private branch, prioritizing prototyping and building out features over a clean commit history. The branch history contains work that was reverted, and there isn't any need to clutter the public history with this. The branch has also diverged a bit with the current master branch.

It will take a bit of time to cut this up into smaller, more reviewable PRs and while maintaining attribution for authorship. Rather than delay on making these changes available, this is the full file-based diff of the changes, which encompass:

• A complete overhaul of the integration test suite, adding support for minikube and KiND backends, and using buildkit to optimize image builds.

  • All tests run in their own k8s namespace, so it saves on set up / teardown time to just reuse a cluster locally

• Support for process selectors, which can be used to pick a process to target for tracing more dynamically

• Start of a "trace uploader" which is called after a trace succeeds right now.

  • Currently only supports GCS, though it should be trivial to add S3, azure backends, we just started with GCS.

• Generic tracers, the latest version of the work from feat: Refactor bpftrace functionality to generic tracer #136

  • We've added rbspy as the first generic tracer besides bcc, but have several others we'd like to add soon.

  Note also https://github.com/dalehamel/kubectl-trace/pull/1/files which builds on this and is the initial operator support for Idea - kubectl-trace operator #85

[tsunamishaun]

hey @dalehamel! Excited to see all of these land as it would be a game changer for us, especially the operator/upload capabilities. Thanks for putting in all the work to make this happen.

[dalehamel]

These have all landed, there are some other things i'll be following up with but I'm going to close this off.