Kafka-compatible streaming. Stateless brokers. S3 storage. Self-hosted.

Stateless Kafka on S3, compatible with your clients.

Run Kafka APIs without stateful disks. Kafscale stores log segments in S3, keeps brokers ephemeral, and uses etcd for metadata so you scale fast and recover cleanly.

Get started View on GitHub

Why teams adopt Kafscale

Stateless brokers

Spin brokers up and down without disk shuffles. S3 is the source of truth.

S3-native durability

Immutable segments, predictable retention, and lifecycle policies in object storage.

etcd metadata

Offsets, topics, and group state live in etcd for fast consensus and control.

Kubernetes operator

CRDs manage clusters, topics, snapshots, and UI access with clean drift control.

Quickstart in minutes

1. Install operator

helm upgrade --install kafscale deploy/helm/kafscale \
  --namespace kafscale --create-namespace \
  --set operator.etcdEndpoints={} \
  --set operator.image.tag=latest \
  --set console.image.tag=latest

2. Create your first topic

kubectl apply -n kafscale -f - <<'EOF'
apiVersion: kafscale.novatechflow.io/v1alpha1
kind: KafscaleTopic
metadata:
  name: orders
spec:
  clusterRef: demo
  partitions: 3
EOF

3. Produce and consume

kafka-console-producer --bootstrap-server 127.0.0.1:9092 --topic orders
kafka-console-consumer --bootstrap-server 127.0.0.1:9092 --topic orders --from-beginning

Read the full quickstart