Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Helm support for Confluent Kafka setups #283

Open
arov00 opened this issue Dec 14, 2024 · 0 comments
Open

Helm support for Confluent Kafka setups #283

arov00 opened this issue Dec 14, 2024 · 0 comments
Labels

Comments

@arov00
Copy link
Contributor

arov00 commented Dec 14, 2024

The existing helm chart PR sets up cost control for a Strimzi environment. It would be good if we could extend it to also support Kafka clusters that are not deployed using Strimzi. For example, the value file could look as follows:

kafkaType: confluent

# this is not active (and could be omitted) because kafkaType is confluent
strimzi:
  clusterName: my-cluster
  bootstrapServer: my-cluster-kafka-bootstrap:9094
  # more strimzi settings here...

# If confluent is enabled, the chart generates a telegraf config that queries the confluent metrics api + some other confluent-specific things are set up (and strimzi-specific things are deactivated)
confluent:
  bootstrapServer: my-cluster-kafka-bootstrap:9094
  metricsApiSecret:
    name: metrics-api-secret
    apiKeyProperty: key
    apiSecretProperty: secret
  # more confluent settings here...

If Confluent is enabled, then we are no longer able to rely on Strimzi's KafkaConnect and KafkaConnector resources for sinking metrics to timescaleDB. In this case, the setup from Kustomize should be used (spin up a Kafka Connect deployment, instead of using custom resources).

@arov00 arov00 added the helm label Dec 14, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant