Skip to content

Latest commit

 

History

History
46 lines (34 loc) · 1004 Bytes

README.md

File metadata and controls

46 lines (34 loc) · 1004 Bytes
Raw

Kafka Cluster Testbed

A Kafka cluster testbed for testing & development.

Services

  • Zookeeper (3 nodes)
  • Kafka (2 nodes)

Dependencies

  • docker.io
  • docker-compose
  • libnss-docker (optional)
  • kafkacat (optional, for testing)

Usage

# Prepare cluster
$ docker-compose build
$ docker-compose up (Ctrl-C to stop)

# Create a new topic
$ docker-compose exec kc1.docker kafka-topics --zookeeper zoo1,zoo2 --topic top1 --partitions 2 --replication-factor 2 --create
top1
$ docker-compose exec kc1.docker kafka-topics --zookeeper zoo1,zoo2 --describe
Topic:top1	PartitionCount:2	ReplicationFactor:2	Configs:
	Topic: top1	Partition: 0	Leader: 1	Replicas: 1,2	Isr: 1,2
	Topic: top1	Partition: 1	Leader: 2	Replicas: 2,1	Isr: 2,1

# Pub/Sub
$ echo "Hello Kafka" | kafkacat -P -b kc1.docker -t top1
$ kafkacat -C -b kc1.docker -t top1 -c 1
Hello Kafka

# Rafka
$ redis-cli -p 6380 rpushx topics:top1 "hello there"

# Remove everything
$ docker-compose down