Spring Cloud Stream Kafka(3.2.2版本)使用

问题

正在尝试只用Spring Cloud Stream Kafka。

步骤

配置

spring:cloud:function:definition: project2Building    stream:kafka:binder:brokers: xxxx:9002configuration:enable.auto.commit: falsesession.timeout.ms: 30000max.poll.records: 30allow.auto.create.topics: falseauto.offset.reset: earliest# 反序列化配置key.serializer: org.apache.kafka.common.serialization.StringDeserializervalue.deserializer: org.apache.kafka.common.serialization.StringDeserializer# JAAS配置security.protocol: SASL_PLAINTEXTsasl.mechanism: PLAINsasl.jaas.config: "org.apache.kafka.common.security.plain.PlainLoginModule required username=\"xxx\" password=\"xxx\";"autoCreateTopics: falsebindings:# 自定义消费bean的方法名称project2Building-in-0:# 消费组group: xxxx# 主题destination: xxxx

消费方法

package xxxxx.config;import lombok.extern.slf4j.Slf4j;
import org.springframework.context.annotation.Bean;
import org.springframework.context.annotation.Configuration;
import org.springframework.kafka.support.Acknowledgment;
import org.springframework.kafka.support.KafkaHeaders;
import org.springframework.messaging.Message;import java.util.function.Consumer;/*** 与xxxx的kafka对接处理* @author zyl*/
@Slf4j
@Configuration
public class MainConfig {@Beanpublic Consumer<Message<String>> project2Building(){return msg ->{log.info(String.format("Kafka消息：%s",msg.getPayload()));// TODO 手动提交kafkaAcknowledgment acknowledgment = msg.getHeaders().get(KafkaHeaders.ACKNOWLEDGMENT, Acknowledgment.class);if (acknowledgment != null) {acknowledgment.acknowledge();}};}}

总结

我用的这个版本Spring Cloud Stream Kafka(3.2.2版本)相对于Spring Boot 的Kafka库有点重量级了。这就是Spring Cloud 基于Kafka的流处理框架。

参考：

• Spring Cloud Stream Kafka Binder Reference Guide
• Kafka With Spring Cloud Streams Using Function-based Mode
• Spring Cloud Stream - functional and reactive