Skip to content

Latest commit

 

History

History
48 lines (36 loc) · 1.3 KB

README.md

File metadata and controls

48 lines (36 loc) · 1.3 KB
Raw

Apache Kafka in Docker

TAG names are based on Kafka binaries version as

thebinary/kafka:{scala_version}-{kafka_version}

eg: thebinary/kafka:2.13-2.7.0

Use as Kafka Server

  1. Run a zookeeper service
    Kafka is dependent on zookeeper service.
docker run -d -it --network kafka --name zookeeper zookeeper
  1. Create a server.properties config file
# server.properties
broker.id=0
listeners=PLAINTEXT://:9092
log.dirs=/tmp/kafka-logs
num.partitions=1
offsets.topic.replication.factor=1
transaction.state.log.replication.factor=1
transaction.state.log.min.isr=1
zookeeper.connect=zookeeper:2181
  1. Run kafka
docker run --network kafka -it -d -v $(PWD)/server.properties:/etc/kafka/config/server.properties thebinary/kafka

Use as Kafka Tools

All kafka shell tools (scripts) can be used directly from these docker images. This can be used to run these kafka tools to interact with external kafka-brokers/kafka-zookeepers. Some examples are given below:

  1. Create Kafka Topic
docker run --rm -it thebinary/kafka kafka-topics.sh --bootstrap-sever ext-kafka-01.thebinary.org --create --replication-factor 1 --partitions 1 --topic kafkatopic
  1. List Kafka Topics
docker run --rm -it thebinary/kafka kafka-topics.sh --bootstrap-sever ext-kafka-01.thebinary.org --list