Add Kafka exporter and receiver configuration

[joeyyy09]

Which problem is this PR solving?

• Resolves [Jaeger v2] Add Kafka exporter and receiver #4868

Description of the changes

• Add config files for replacement of jaeger-collector and jaeger-ingester.
• Add the architecture for the integration tests for kafka.
• Add e2e integration tests for Kafka.

How was this change tested?

• Manually ran the collector, ingester configs to check if the data is being pushed and pulled the right way and verified the architecture.

Checklist

• I have read https://github.com/jaegertracing/jaeger/blob/master/CONTRIBUTING_GUIDELINES.md
• I have signed all commits
• I have added unit tests for the new functionality
• I have run lint and test steps successfully
  • for jaeger: make lint test
  • for jaeger-ui: yarn lint and yarn test

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 96.66%. Comparing base (d8b2110) to head (d7c70cf).

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #5703      +/-   ##
==========================================
+ Coverage   96.65%   96.66%   +0.01%     
==========================================
  Files         342      342              
  Lines       16515    16515              
==========================================
+ Hits        15962    15964       +2     
+ Misses        363      362       -1     
+ Partials      190      189       -1     

Flag	Coverage Δ
badger_v1	8.05% <ø> (ø)
badger_v2	1.81% <ø> (ø)
cassandra-3.x-v1	16.61% <ø> (ø)
cassandra-3.x-v2	1.74% <ø> (ø)
cassandra-4.x-v1	16.61% <ø> (ø)
cassandra-4.x-v2	1.74% <ø> (ø)
elasticsearch-6.x-v1	18.77% <ø> (-0.02%)	⬇️
elasticsearch-7.x-v1	18.83% <ø> (-0.02%)	⬇️
elasticsearch-8.x-v1	19.02% <ø> (ø)
elasticsearch-8.x-v2	1.81% <ø> (?)
grpc_v1	9.52% <ø> (ø)
grpc_v2	7.14% <ø> (ø)
kafka	9.74% <ø> (ø)
memory_v2	1.81% <ø> (ø)
opensearch-1.x-v1	18.89% <ø> (ø)
opensearch-2.x-v1	18.88% <ø> (-0.02%)	⬇️
opensearch-2.x-v2	1.81% <ø> (ø)
unittests	95.08% <ø> (+0.01%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[yurishkuro]

Lgtm, but we need e2e tests

[joeyyy09]

Lgtm, but we need e2e tests

Yeah, will get started on it!

[yurishkuro]

Do you need to add this new test to the gh workflow? I don't see how it's getting run now.

[joeyyy09]

Do you need to add this new test to the gh workflow? I don't see how it's getting run now.

Yes, I'll be doing that

[yurishkuro]

.

[yurishkuro]

I think we should merge this is the build is green. It's not running the e2e test, but we can add that in a separate PR.

[joeyyy09]

I think we should merge this is the build is green. It's not running the e2e test, but we can add that in a separate PR.

Yeah sure, i'll open another PR for the e2e test