bijukunjummen / sample-spring-kafka-producer-consumer

Sample demonstrating Spring-Kafka project based Producer/Consumers

Getting Started

These instructions will show how to run kafka locally and how to install kafkacat, a tool to display messages in a kafka topic

Run kafka locally

In a terminal cd to the root of this project and run

docker-compose up -d

Check both kafka and zookeeper are running

docker ps

Install kafkacat

Install kafkacat utility using the local package manager.

sudo apt-get install kafkacat

Start up the Producer, from the root of the project

cd sample-spring-kafka-producer
../gradlew bootRun

Start up the Consumer

cd sample-spring-kafka-consumer
../gradlew bootRun

At this point some sample messages can be generated using this endpoint:

http://localhost:8080/generateWork?id=1&definition=thisIsCool

The producer should print a message on the console that the Work unit has been dispatched and the consumer should receive and process the Work unit

sample-spring-kafka-producer-consumer's Issues

EmbedKafkaTest.testEmbeddedRawKafka() doesn't work

Hello!

Thank you for the sample code.

I am trying to use Spring KafkaEmbedded for my Junit test. I tried the test case EmbedKafkaTest.testEmbeddedRawKafka() but it doesn't work. It seems that the producer can't send the message. I got the following exception,

ERROR com.oracle.oal.event.notification.query.eventcollecting.controller.advice.ControllersAdvice - Error in event controller org.apache.kafka.common.errors.UnknownServerException: The server experienced an unexpected error when processing the request
java.util.concurrent.ExecutionException: org.apache.kafka.common.errors.UnknownServerException: The server experienced an unexpected error when processing the request
	at org.apache.kafka.clients.producer.internals.FutureRecordMetadata.valueOrError(FutureRecordMetadata.java:70) ~[kafka-clients-0.10.2.1.jar:?]
	at org.apache.kafka.clients.producer.internals.FutureRecordMetadata.get(FutureRecordMetadata.java:57) ~[kafka-clients-0.10.2.1.jar:?]
	at org.apache.kafka.clients.producer.internals.FutureRecordMetadata.get(FutureRecordMetadata.java:25) ~[kafka-clients-0.10.2.1.jar:?]
	at 

Could you help?

Best regards.
Heidi