kafka3.8的基本操作
Kafka基础理论与常用命令详解(超详细)_kafka常用命令和解释-CSDN博客
[root@k1 bin]# netstat -tunlp|grep 90
tcp6 0 0 :::9092 :::* LISTEN 14512/java
[root@k1 bin]# ./kafka-topics.sh --list --bootstrap-server 192.168.207.131:9092
topic_jyc01
[root@k1 bin]# ./kafka-topics.sh --list --bootstrap-server 192.168.207.132:9092
topic_jyc01
[root@k1 bin]# ./kafka-topics.sh --list --bootstrap-server 192.168.207.133:9092
topic_jyc01
[root@k1 bin]# ./kafka-topics.sh --create --bootstrap-server 192.168.207.131:9092 --replication-factor 2 --partitions 1 --topic topic_jyc02
WARNING: Due to limitations in metric names, topics with a period ('.') or underscore ('_') could collide. To avoid issues it is best to use either, but not both.
Created topic topic_jyc02.
[root@k1 bin]# ./kafka-topics.sh --list --bootstrap-server 192.168.207.132:9092
topic_jyc01
topic_jyc02
[root@k1 bin]# ./kafka-topics.sh --describe --zookeeper localhost:12181 --topic topic_jyc02
zookeeper is not a recognized option
joptsimple.UnrecognizedOptionException: zookeeper is not a recognized option
at joptsimple.OptionException.unrecognizedOption(OptionException.java:108)
at joptsimple.OptionParser.handleLongOptionToken(OptionParser.java:510)
at joptsimple.OptionParserState$2.handleArgument(OptionParserState.java:56)
at joptsimple.OptionParser.parse(OptionParser.java:396)
at org.apache.kafka.tools.TopicCommand$TopicCommandOptions.<init>(TopicCommand.java:828)
at org.apache.kafka.tools.TopicCommand.execute(TopicCommand.java:98)
at org.apache.kafka.tools.TopicCommand.mainNoExit(TopicCommand.java:88)
at org.apache.kafka.tools.TopicCommand.main(TopicCommand.java:83)
[root@k1 bin]# ./kafka-topics.sh --describe --bootstrap-server 192.168.207.131:12181 --topic topic_jyc02
Error while executing topic command : Timed out waiting for a node assignment. Call: listTopics
[2024-09-20 09:31:53,869] ERROR org.apache.kafka.common.errors.TimeoutException: Timed out waiting for a node assignment. Call: listTopics
(org.apache.kafka.tools.TopicCommand)
[root@k1 bin]# ./kafka-topics.sh --describe --bootstrap-server 192.168.207.131:12181 --topic topic_jyc01
^C[root@k1 bin]# find / -name ./zkCli.sh
find: warning: Unix filenames usually don't contain slashes (though pathnames do). That means that '-name ‘./zkCli.sh’' will probably evaluate to false all the time on this system. You might find the '-wholename' test more useful, or perhaps '-samefile'. Alternatively, if you are using GNU grep, you could use 'find ... -print0 | grep -FzZ ‘./zkCli.sh’'.
[root@k1 bin]# find / -name zkCli.sh
/opt/zookeeper/zookeeper-3.9.2/bin/zkCli.sh
[root@k1 bin]# /opt/zookeeper/zookeeper-3.9.2/bin/zkCli.sh -server 192.168.207.131:12181
Connecting to 192.168.207.131:12181
2024-09-20 09:33:40,091 [myid:] - INFO [main:o.a.z.Environment@98] - Client environment:zookeeper.version=3.9.2-e454e8c7283100c7caec6dcae2bc82aaecb63023, built on 2024-02-12 20:59 UTC
2024-09-20 09:33:40,095 [myid:] - INFO [main:o.a.z.Environment@98] - Client environment:host.name=k1
2024-09-20 09:33:40,095 [myid:] - INFO [main:o.a.z.Environment@98] - Client environment:java.version=1.8.0_412
2024-09-20 09:33:40,096 [myid:] - INFO [main:o.a.z.Environment@98] - Client environment:java.vendor=Red Hat, Inc.
2024-09-20 09:33:40,096 [myid:] - INFO [main:o.a.z.Environment@98] - Client environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.412.b08-1.el7_9.x86_64/jre
2024-09-20 09:33:40,096 [myid:] - INFO [main:o.a.z.Environment@98] - Client environment:java.class.path=/opt/zookeeper/zookeeper-3.9.2/bin/../zookeeper-metrics-providers/zookeeper-prometheus-metrics/target/classes:/opt/zookeeper/zookeeper-3.9.2/bin/../zookeeper-server/target/classes:/opt/zookeeper/zookeeper-3.9.2/bin/../build/classes:/opt/zookeeper/zookeeper-3.9.2/bin/../zookeeper-metrics-providers/zookeeper-prometheus-metrics/target/lib/*.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../zookeeper-server/target/lib/*.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../build/lib/*.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/zookeeper-prometheus-metrics-3.9.2.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/zookeeper-jute-3.9.2.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/zookeeper-3.9.2.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/snappy-java-1.1.10.5.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/slf4j-api-1.7.30.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/simpleclient_servlet-0.9.0.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/simpleclient_hotspot-0.9.0.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/simpleclient_common-0.9.0.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/simpleclient-0.9.0.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/netty-transport-native-unix-common-4.1.105.Final.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/netty-transport-native-epoll-4.1.105.Final-linux-x86_64.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/netty-transport-classes-epoll-4.1.105.Final.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/netty-transport-4.1.105.Final.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/netty-tcnative-classes-2.0.61.Final.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/netty-tcnative-boringssl-static-2.0.61.Final-windows-x86_64.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/netty-tcnative-boringssl-static-2.0.61.Final-osx-x86_64.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/netty-tcnative-boringssl-static-2.0.61.Final-osx-aarch_64.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/netty-tcnative-boringssl-static-2.0.61.Final-linux-x86_64.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/netty-tcnative-boringssl-static-2.0.61.Final-linux-aarch_64.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/netty-tcnative-boringssl-static-2.0.61.Final.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/netty-resolver-4.1.105.Final.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/netty-handler-4.1.105.Final.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/netty-common-4.1.105.Final.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/netty-codec-4.1.105.Final.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/netty-buffer-4.1.105.Final.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/metrics-core-4.1.12.1.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/logback-core-1.2.13.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/logback-classic-1.2.13.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/jline-2.14.6.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/jetty-util-ajax-9.4.53.v20231009.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/jetty-util-9.4.53.v20231009.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/jetty-servlet-9.4.53.v20231009.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/jetty-server-9.4.53.v20231009.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/jetty-security-9.4.53.v20231009.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/jetty-io-9.4.53.v20231009.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/jetty-http-9.4.53.v20231009.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/javax.servlet-api-3.1.0.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/jackson-databind-2.15.2.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/jackson-core-2.15.2.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/jackson-annotations-2.15.2.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/commons-io-2.11.0.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/commons-cli-1.5.0.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/audience-annotations-0.12.0.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../zookeeper-*.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../zookeeper-server/src/main/resources/lib/*.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../conf:
2024-09-20 09:33:40,096 [myid:] - INFO [main:o.a.z.Environment@98] - Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
2024-09-20 09:33:40,096 [myid:] - INFO [main:o.a.z.Environment@98] - Client environment:java.io.tmpdir=/tmp
2024-09-20 09:33:40,096 [myid:] - INFO [main:o.a.z.Environment@98] - Client environment:java.compiler=<NA>
2024-09-20 09:33:40,097 [myid:] - INFO [main:o.a.z.Environment@98] - Client environment:os.name=Linux
2024-09-20 09:33:40,097 [myid:] - INFO [main:o.a.z.Environment@98] - Client environment:os.arch=amd64
2024-09-20 09:33:40,097 [myid:] - INFO [main:o.a.z.Environment@98] - Client environment:os.version=3.10.0-1160.el7.x86_64
2024-09-20 09:33:40,097 [myid:] - INFO [main:o.a.z.Environment@98] - Client environment:user.name=root
2024-09-20 09:33:40,097 [myid:] - INFO [main:o.a.z.Environment@98] - Client environment:user.home=/root
2024-09-20 09:33:40,097 [myid:] - INFO [main:o.a.z.Environment@98] - Client environment:user.dir=/opt/kafka/kafka_2.13-3.8.0/bin
2024-09-20 09:33:40,097 [myid:] - INFO [main:o.a.z.Environment@98] - Client environment:os.memory.free=105MB
2024-09-20 09:33:40,098 [myid:] - INFO [main:o.a.z.Environment@98] - Client environment:os.memory.max=228MB
2024-09-20 09:33:40,098 [myid:] - INFO [main:o.a.z.Environment@98] - Client environment:os.memory.total=119MB
2024-09-20 09:33:40,102 [myid:] - INFO [main:o.a.z.ZooKeeper@637] - Initiating client connection, connectString=192.168.207.131:12181 sessionTimeout=30000 watcher=org.apache.zookeeper.ZooKeeperMain$MyWatcher@4678c730
2024-09-20 09:33:40,115 [myid:] - INFO [main:o.a.z.c.X509Util@88] - Setting -D jdk.tls.rejectClientInitiatedRenegotiation=true to disable client-initiated TLS renegotiation
2024-09-20 09:33:40,360 [myid:] - INFO [main:o.a.z.c.X509Util@110] - Default TLS protocol is TLSv1.3, supported TLS protocols are [TLSv1.3, TLSv1.2, TLSv1.1, TLSv1, SSLv3, SSLv2Hello]
2024-09-20 09:33:40,377 [myid:] - INFO [main:o.a.z.ClientCnxnSocket@233] - jute.maxbuffer value is 1048575 Bytes
2024-09-20 09:33:40,390 [myid:] - INFO [main:o.a.z.ClientCnxn@1726] - zookeeper.request.timeout value is 0. feature enabled=false
Welcome to ZooKeeper!
2024-09-20 09:33:40,407 [myid:192.168.207.131:12181] - INFO [main-SendThread(192.168.207.131:12181):o.a.z.ClientCnxn$SendThread@1162] - Opening socket connection to server k1/192.168.207.131:12181.
2024-09-20 09:33:40,407 [myid:192.168.207.131:12181] - INFO [main-SendThread(192.168.207.131:12181):o.a.z.ClientCnxn$SendThread@1164] - SASL config status: Will not attempt to authenticate using SASL (unknown error)
JLine support is enabled
2024-09-20 09:33:40,417 [myid:192.168.207.131:12181] - INFO [main-SendThread(192.168.207.131:12181):o.a.z.ClientCnxn$SendThread@998] - Socket connection established, initiating session, client: /192.168.207.131:38474, server: k1/192.168.207.131:12181
2024-09-20 09:33:40,458 [myid:192.168.207.131:12181] - INFO [main-SendThread(192.168.207.131:12181):o.a.z.ClientCnxn$SendThread@1432] - Session establishment complete on server k1/192.168.207.131:12181, session id = 0x1000045e0670010, negotiated timeout = 30000
WATCHER::
WatchedEvent state:SyncConnected type:None path:null zxid: -1
[zk: 192.168.207.131:12181(CONNECTED) 0] ls /
[admin, brokers, cluster, config, consumers, controller, controller_epoch, feature, isr_change_notification, latest_producer_id_block, log_dir_event_notification, zookeeper]
[zk: 192.168.207.131:12181(CONNECTED) 1] get /bo$<3$<3$<3$<3>
get [-s] [-w] path
[zk: 192.168.207.131:12181(CONNECTED) 2] get /brokers/ids/0
Node does not exist: /brokers/ids/0
[zk: 192.168.207.131:12181(CONNECTED) 3] ls /brokers
[ids, seqid, topics]
[zk: 192.168.207.131:12181(CONNECTED) 4] ls /brokers/ids
[1, 2, 3]
[zk: 192.168.207.131:12181(CONNECTED) 5] l /b /br /br[root@k1 bin]#
[root@k1 bin]# /opt/zookeeper/zookeeper-3.9.2/bin/zkCli.sh -server 192.168.207.131:12181
Connecting to 192.168.207.131:12181
2024-09-20 09:36:06,891 [myid:] - INFO [main:o.a.z.Environment@98] - Client environment:zookeeper.version=3.9.2-e454e8c7283100c7caec6dcae2bc82aaecb63023, built on 2024-02-12 20:59 UTC
2024-09-20 09:36:06,895 [myid:] - INFO [main:o.a.z.Environment@98] - Client environment:host.name=k1
2024-09-20 09:36:06,895 [myid:] - INFO [main:o.a.z.Environment@98] - Client environment:java.version=1.8.0_412
2024-09-20 09:36:06,896 [myid:] - INFO [main:o.a.z.Environment@98] - Client environment:java.vendor=Red Hat, Inc.
2024-09-20 09:36:06,896 [myid:] - INFO [main:o.a.z.Environment@98] - Client environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.412.b08-1.el7_9.x86_64/jre
2024-09-20 09:36:06,896 [myid:] - INFO [main:o.a.z.Environment@98] - Client environment:java.class.path=/opt/zookeeper/zookeeper-3.9.2/bin/../zookeeper-metrics-providers/zookeeper-prometheus-metrics/target/classes:/opt/zookeeper/zookeeper-3.9.2/bin/../zookeeper-server/target/classes:/opt/zookeeper/zookeeper-3.9.2/bin/../build/classes:/opt/zookeeper/zookeeper-3.9.2/bin/../zookeeper-metrics-providers/zookeeper-prometheus-metrics/target/lib/*.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../zookeeper-server/target/lib/*.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../build/lib/*.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/zookeeper-prometheus-metrics-3.9.2.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/zookeeper-jute-3.9.2.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/zookeeper-3.9.2.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/snappy-java-1.1.10.5.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/slf4j-api-1.7.30.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/simpleclient_servlet-0.9.0.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/simpleclient_hotspot-0.9.0.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/simpleclient_common-0.9.0.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/simpleclient-0.9.0.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/netty-transport-native-unix-common-4.1.105.Final.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/netty-transport-native-epoll-4.1.105.Final-linux-x86_64.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/netty-transport-classes-epoll-4.1.105.Final.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/netty-transport-4.1.105.Final.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/netty-tcnative-classes-2.0.61.Final.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/netty-tcnative-boringssl-static-2.0.61.Final-windows-x86_64.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/netty-tcnative-boringssl-static-2.0.61.Final-osx-x86_64.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/netty-tcnative-boringssl-static-2.0.61.Final-osx-aarch_64.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/netty-tcnative-boringssl-static-2.0.61.Final-linux-x86_64.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/netty-tcnative-boringssl-static-2.0.61.Final-linux-aarch_64.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/netty-tcnative-boringssl-static-2.0.61.Final.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/netty-resolver-4.1.105.Final.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/netty-handler-4.1.105.Final.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/netty-common-4.1.105.Final.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/netty-codec-4.1.105.Final.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/netty-buffer-4.1.105.Final.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/metrics-core-4.1.12.1.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/logback-core-1.2.13.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/logback-classic-1.2.13.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/jline-2.14.6.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/jetty-util-ajax-9.4.53.v20231009.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/jetty-util-9.4.53.v20231009.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/jetty-servlet-9.4.53.v20231009.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/jetty-server-9.4.53.v20231009.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/jetty-security-9.4.53.v20231009.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/jetty-io-9.4.53.v20231009.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/jetty-http-9.4.53.v20231009.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/javax.servlet-api-3.1.0.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/jackson-databind-2.15.2.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/jackson-core-2.15.2.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/jackson-annotations-2.15.2.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/commons-io-2.11.0.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/commons-cli-1.5.0.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../lib/audience-annotations-0.12.0.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../zookeeper-*.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../zookeeper-server/src/main/resources/lib/*.jar:/opt/zookeeper/zookeeper-3.9.2/bin/../conf:
2024-09-20 09:36:06,896 [myid:] - INFO [main:o.a.z.Environment@98] - Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
2024-09-20 09:36:06,896 [myid:] - INFO [main:o.a.z.Environment@98] - Client environment:java.io.tmpdir=/tmp
2024-09-20 09:36:06,896 [myid:] - INFO [main:o.a.z.Environment@98] - Client environment:java.compiler=<NA>
2024-09-20 09:36:06,896 [myid:] - INFO [main:o.a.z.Environment@98] - Client environment:os.name=Linux
2024-09-20 09:36:06,897 [myid:] - INFO [main:o.a.z.Environment@98] - Client environment:os.arch=amd64
2024-09-20 09:36:06,897 [myid:] - INFO [main:o.a.z.Environment@98] - Client environment:os.version=3.10.0-1160.el7.x86_64
2024-09-20 09:36:06,897 [myid:] - INFO [main:o.a.z.Environment@98] - Client environment:user.name=root
2024-09-20 09:36:06,897 [myid:] - INFO [main:o.a.z.Environment@98] - Client environment:user.home=/root
2024-09-20 09:36:06,897 [myid:] - INFO [main:o.a.z.Environment@98] - Client environment:user.dir=/opt/kafka/kafka_2.13-3.8.0/bin
2024-09-20 09:36:06,897 [myid:] - INFO [main:o.a.z.Environment@98] - Client environment:os.memory.free=105MB
2024-09-20 09:36:06,898 [myid:] - INFO [main:o.a.z.Environment@98] - Client environment:os.memory.max=228MB
2024-09-20 09:36:06,898 [myid:] - INFO [main:o.a.z.Environment@98] - Client environment:os.memory.total=119MB
2024-09-20 09:36:06,902 [myid:] - INFO [main:o.a.z.ZooKeeper@637] - Initiating client connection, connectString=192.168.207.131:12181 sessionTimeout=30000 watcher=org.apache.zookeeper.ZooKeeperMain$MyWatcher@4678c730
2024-09-20 09:36:06,914 [myid:] - INFO [main:o.a.z.c.X509Util@88] - Setting -D jdk.tls.rejectClientInitiatedRenegotiation=true to disable client-initiated TLS renegotiation
2024-09-20 09:36:07,166 [myid:] - INFO [main:o.a.z.c.X509Util@110] - Default TLS protocol is TLSv1.3, supported TLS protocols are [TLSv1.3, TLSv1.2, TLSv1.1, TLSv1, SSLv3, SSLv2Hello]
2024-09-20 09:36:07,182 [myid:] - INFO [main:o.a.z.ClientCnxnSocket@233] - jute.maxbuffer value is 1048575 Bytes
2024-09-20 09:36:07,195 [myid:] - INFO [main:o.a.z.ClientCnxn@1726] - zookeeper.request.timeout value is 0. feature enabled=false
Welcome to ZooKeeper!
2024-09-20 09:36:07,213 [myid:192.168.207.131:12181] - INFO [main-SendThread(192.168.207.131:12181):o.a.z.ClientCnxn$SendThread@1162] - Opening socket connection to server k1/192.168.207.131:12181.
2024-09-20 09:36:07,214 [myid:192.168.207.131:12181] - INFO [main-SendThread(192.168.207.131:12181):o.a.z.ClientCnxn$SendThread@1164] - SASL config status: Will not attempt to authenticate using SASL (unknown error)
2024-09-20 09:36:07,222 [myid:192.168.207.131:12181] - INFO [main-SendThread(192.168.207.131:12181):o.a.z.ClientCnxn$SendThread@998] - Socket connection established, initiating session, client: /192.168.207.131:39134, server: k1/192.168.207.131:12181
JLine support is enabled
2024-09-20 09:36:07,259 [myid:192.168.207.131:12181] - INFO [main-SendThread(192.168.207.131:12181):o.a.z.ClientCnxn$SendThread@1432] - Session establishment complete on server k1/192.168.207.131:12181, session id = 0x1000045e0670011, negotiated timeout = 30000
WATCHER::
WatchedEvent state:SyncConnected type:None path:null zxid: -1
[zk: 192.168.207.131:12181(CONNECTED) 0] ls /
[admin, brokers, cluster, config, consumers, controller, controller_epoch, feature, isr_change_notification, latest_producer_id_block, log_dir_event_notification, zookeeper]
[zk: 192.168.207.131:12181(CONNECTED) 1] ls /brokers/ids/1
[]
[zk: 192.168.207.131:12181(CONNECTED) 2] get /brokes/ids/1
Node does not exist: /brokes/ids/1
[zk: 192.168.207.131:12181(CONNECTED) 3] get /brokers/ids/1
{"features":{},"listener_security_protocol_map":{"PLAINTEXT":"PLAINTEXT"},"endpoints":["PLAINTEXT://k1:9092"],"jmx_port":9999,"port":9092,"host":"k1","version":5,"timestamp":"1726738262403"}
[zk: 192.168.207.131:12181(CONNECTED) 4] get /brokers/topics/
Path must not end with / character
[zk: 192.168.207.131:12181(CONNECTED) 5] ls /brokers/topics
[topic_jyc01, topic_jyc02]
[zk: 192.168.207.131:12181(CONNECTED) 6] ls /brokers/topics/topic_jyc01
[partitions]
[zk: 192.168.207.131:12181(CONNECTED) 7] ls /brokers/topics/topic_jyc01/partitions
[0, 1]
[zk: 192.168.207.131:12181(CONNECTED) 8] ls /brokers/topics/topic_jyc01/partitions/0
[state]
[zk: 192.168.207.131:12181(CONNECTED) 9] get /brokers/topics/topic_jyc01/partitions/0
null
[zk: 192.168.207.131:12181(CONNECTED) 10] get /brokers/topics/topic_jyc01/partitions/$<3>1
null
[zk: 192.168.207.131:12181(CONNECTED) 11] get /brokers/topics/topic_jyc01/partitions/1
null
[zk: 192.168.207.131:12181(CONNECTED) 12]
相关参考:
Kafka【第一篇】Kafka集群搭建_kafka 搭建-CSDN博客
http://192.168.207.131:8048/
admin/23456



内存不足问题:
vi kafka-server-start.sh
if [ "x$KAFKA_HEAP_OPTS" = "x" ]; then
export KAFKA_HEAP_OPTS="-server -Xms2G -Xmx2G -XX:PermSize=128m -XX:+UseG1GC -XX:MaxGCPauseMillis=200 -XX:ParallelGCThreads=8 -XX:ConcGCThreads=5 -XX:InitiatingHeapOccupancyPercent=70"
export JMX_PORT="9999"
fi
kafka-eagle无法获取kafka cluster info_kafka cluster info 不显示-CSDN博客
[root@k1 bin]# cat /etc/hosts
127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4
::1 localhost localhost.localdomain localhost6 localhost6.localdomain6
192.168.207.131 k1
192.168.207.132 k2
192.168.207.133 k3
[root@k1 bin]#
生产者:
[root@k1 bin]# ./kafka-console-producer.sh --broker-list "192.168.207.131:9092,192.168.207.132:9092,192.168.207.133:9092" --topic topic_jyc01
>Hello Kafka!
>你好 kafka!
>test
>
消费者:
[root@k1 bin]# ./kafka-console-consumer.sh --bootstrap-server "192.168.207.131:9092,192.168.207.132:9092,192.168.207.133:9092" --topic topic_jyc01
Hello Kafka!
你好 kafka!
test
一、无key型消息
默认情况下,所生产的消息是没有 key 的,命令如下:
bin/kafka-console-producer.sh --bootstrap-server localhost:9092 --topic topicName
1
执行上述命令后,就会在控制台等待键入消息体,直接输入消息值(value)即可,每行(以换行符分隔)表示一条消息,如下所示。
>Hello Kafka!
>你好 kafka!
1
2
正常情况,每次回车表示触发“发送”操作,回车后可直接使用“Ctrl + c”退出生产者控制台,再使用 kafka-console-consumer.sh 脚本验证本次的生产情况。
二、有key型消息
当需要为消息指定 key 时,可使用如下命令:
bin/kafka-console-producer.sh --bootstrap-server localhost:9092 --topic topicName --property parse.key=true
1
默认消息键与消息值间使用“Tab键”进行分隔,切勿使用转义字符(\t),如下所示:
>Lei Li Hello Kafka!
>Meimei Han 你好 kafka!
1
2
键入如上信息表示所生产的消息“Lei Li”为消息键,“Hello Kafka”为消息值。
https://blog.csdn.net/qq_29116427/article/details/105912397

kafka使用kafka-console-consumer.sh和kafka-console-producer.sh生产消费数据样例_kafka-console-consumer显示消息的key-CSDN博客
相关文章:
kafka3.8的基本操作
Kafka基础理论与常用命令详解(超详细)_kafka常用命令和解释-CSDN博客 [rootk1 bin]# netstat -tunlp|grep 90 tcp6 0 0 :::9092 :::* LISTEN 14512/java [rootk1 bin]# ./kafka-topics.s…...
如何检测并阻止机器人活动
恶意机器人流量逐年增加,占 2023 年所有互联网流量的近三分之一。恶意机器人会访问敏感数据、实施欺诈、窃取专有信息并降低网站性能。新技术使欺诈者能够更快地发动攻击并造成更大的破坏。机器人的无差别和大规模攻击对所有行业各种规模的企业都构成风险。 但您的…...
《linux系统》基础操作
二、综合应用题(共50分) 随着云计算技术、容器化技术和移动技术的不断发展,Unux服务器已经成为全球市场的主导者,因此具备常用服务器的配置与管理能力很有必要。公司因工作需要,需要建立相应部门的目录,搭建samba服务器和FTP服务器,要求将销售部的资料存放在samba服务器…...
EMT-LTR--学习任务间关系的多目标多任务优化
EMT-LTR–学习任务间关系的多目标多任务优化 title: Learning Task Relationships in Evolutionary Multitasking for Multiobjective Continuous Optimization author: Zefeng Chen, Yuren Zhou, Xiaoyu He, and Jun Zhang. journal: IEE…...
MySQL record 08 part
数据库连接池: Java DataBase Connectivity(Java语言连接数据库) 答: 使用连接池能解决此问题, 连接池,自动分配连接对象,并对闲置的连接进行回收。 常用的数据库连接池: 建立数…...
打造以太坊数据监控利器:InfluxDB与Grafana构建Geth可视化分析平台
前言 以太坊客户端收集大量数据,这些数据可以按时间顺序数据库的形式读取。为了简化监控,这些数据可以输入到数据可视化软件中。在此页面上,将配置 Geth 客户端以将数据推送到 InfluxDB 数据库,并使用 Grafana 来可视化数据。 一…...
对onlyoffice进行定制化开发
基于onlyoffice8.0源码,进行二次开发,可实现包括但不限于以下的功能 1、内容控件的插入 2、内容空间的批量替换 3、插入文本 4、插入图片 5、添加,去除水印 6、修改同时在线人数限制 7、内容域的删除 8、页面UI的定制化 9、新增插件开发 10、…...
使用llama.cpp 在推理MiniCPM-1.2B模型
llama.cpp 是一个开源项目,它允许用户在C中实现与LLaMA(Large Language Model Meta AI)模型的交互。LLaMA模型是由Meta Platforms开发的一种大型语言模型,虽然llama.cpp本身并不包含LLaMA模型的训练代码或模型权重,但它…...
分布式环境中,接口超时重试带来的的幂等问题如何解决?
目录标题 幂等不能解决接口超时吗?幂等的重要性什么是幂等?为什么需要幂等?接口超时了,到底如何处理? 如何设计幂等?幂等设计的基本流程实现幂等的8种方案1.selectinsert主键/唯一索引冲突(常用)2.直接insert 主键…...
设计一个推荐系统:使用协同过滤算法
设计一个推荐系统:使用协同过滤算法 在当今数据驱动的时代,推荐系统已经成为了许多在线平台(如电商、社交媒体和流媒体服务)不可或缺的一部分。推荐系统通过分析用户的行为和偏好,向用户推荐可能感兴趣的内容或产品。本文将详细介绍如何设计一个基于协同过滤算法的推荐系…...
Linux 基本指令(二)
目录 1. more指令 2. less指令(重要) 3. head指令 4. tail指令 5. date指令 (1)可以通过选项来指定格式: 编辑 (2)在设定时间方面 (3)时间戳 6. cal指令 7. find指令 8. grep指令 9. alias指令 10. zip指令与unzip指令 (1). zip指令 (2). unzip指令…...
Facebook的用户隐私保护:从争议到革新
Facebook早期的数据收集方式引发了隐私担忧。平台的快速增长和用户数据的大规模收集使得隐私问题逐渐显现。尤其是在2018年,剑桥分析事件暴露了数千万用户数据被不当使用的问题。这一事件揭示了Facebook在数据保护方面的严重漏洞,引发了公众对隐私保护的…...
计算机前沿技术-人工智能算法-大语言模型-最新论文阅读-2024-09-23
计算机前沿技术-人工智能算法-大语言模型-最新论文阅读-2024-09-23 本期,我们对大语言模型在表情推荐, 软件安全和 自动化软件漏洞检测等方面如何应用,提供几篇最新的参考文章。 1 Semantics Preserving Emoji Recommendation with Large Language Mod…...
C++(学习)2024.9.20
目录 C面向对象的基础知识 this指针 概念 功能 1.类内调用成员 2.区分重名的成员变量和局部变量 3. 链式调用 static关键字 1.静态局部变量 2.静态成员变量 3.静态成员函数 4.单例设计模式 const关键字 1.const修饰成员函数 2.const修饰对象 3.const修饰成员变量…...
让AI激发创作力:OpenAI分享5位专业作家利用ChatGPT写作的案例技巧
大家好,我是木易,一个持续关注AI领域的互联网技术产品经理,国内Top2本科,美国Top10 CS研究生,MBA。我坚信AI是普通人变强的“外挂”,专注于分享AI全维度知识,包括但不限于AI科普,AI工…...
UEFI EDK2框架学习 (一)
01 Shell界面打印 执行qemu指令后 qemu-system-x86_64 -drive ifpflash,formatraw,fileOVMF.fd -nographic -net none出现shell界面 02 在UEFI shell中创建APP 创建SimplestApp文件夹以及SimplestApp.c、SimplestApp.inf cd edk2 mkdir SimplestAppuuidgen // generate …...
基于 BERT 的自定义中文命名实体识别实现
基于 BERT 的自定义中文命名实体识别实现 在自然语言处理中,命名实体识别(Named Entity Recognition,NER)是一项重要的任务,旨在识别文本中的特定实体,如人名、地名、组织机构名等。本文将介绍如何使用 BERT 模型实现自定义中文命名实体识别,并提供详细的代码分析和解读…...
中秋节特别游戏:给玉兔投喂月饼
🖼️ 效果展示 📜 游戏背景 在中秋这个充满诗意的节日里,玉兔因为贪玩被赶下人间。在这个温柔的夜晚,我们希望通过一个小游戏,让玉兔感受到人间的温暖和关怀。🐰🌙 🎮 游戏设计 人…...
python pdf转word或excel
python pdf转word或excel 直接上源码 main import gradio as gr import pdf2docx as p2d import Pdf2Excel as p2e import utils.id.IdUtil as idUtildef convert_pdf_to(pdf_file, pdf_pwd, pdf_to_type):if pdf_to_type "docx":# Convert PDF to DOCXcv p2d.C…...
GNU链接器(LD):位置计数器(.)功能及实例解析
0 参考资料 GNU-LD-v2.30-中文手册.pdf GNU linker.pdf1 前言 一个完整的编译工具链应该包含以下4个部分: (1)编译器 (2)汇编器 (3)链接器 (4)lib库 在GNU工具链中&…...
【磁盘】每天掌握一个Linux命令 - iostat
目录 【磁盘】每天掌握一个Linux命令 - iostat工具概述安装方式核心功能基础用法进阶操作实战案例面试题场景生产场景 注意事项 【磁盘】每天掌握一个Linux命令 - iostat 工具概述 iostat(I/O Statistics)是Linux系统下用于监视系统输入输出设备和CPU使…...
SpringBoot+uniapp 的 Champion 俱乐部微信小程序设计与实现,论文初版实现
摘要 本论文旨在设计并实现基于 SpringBoot 和 uniapp 的 Champion 俱乐部微信小程序,以满足俱乐部线上活动推广、会员管理、社交互动等需求。通过 SpringBoot 搭建后端服务,提供稳定高效的数据处理与业务逻辑支持;利用 uniapp 实现跨平台前…...
C++八股 —— 单例模式
文章目录 1. 基本概念2. 设计要点3. 实现方式4. 详解懒汉模式 1. 基本概念 线程安全(Thread Safety) 线程安全是指在多线程环境下,某个函数、类或代码片段能够被多个线程同时调用时,仍能保证数据的一致性和逻辑的正确性…...
Typeerror: cannot read properties of undefined (reading ‘XXX‘)
最近需要在离线机器上运行软件,所以得把软件用docker打包起来,大部分功能都没问题,出了一个奇怪的事情。同样的代码,在本机上用vscode可以运行起来,但是打包之后在docker里出现了问题。使用的是dialog组件,…...
安卓基础(aar)
重新设置java21的环境,临时设置 $env:JAVA_HOME "D:\Android Studio\jbr" 查看当前环境变量 JAVA_HOME 的值 echo $env:JAVA_HOME 构建ARR文件 ./gradlew :private-lib:assembleRelease 目录是这样的: MyApp/ ├── app/ …...
嵌入式学习笔记DAY33(网络编程——TCP)
一、网络架构 C/S (client/server 客户端/服务器):由客户端和服务器端两个部分组成。客户端通常是用户使用的应用程序,负责提供用户界面和交互逻辑 ,接收用户输入,向服务器发送请求,并展示服务…...
Python Ovito统计金刚石结构数量
大家好,我是小马老师。 本文介绍python ovito方法统计金刚石结构的方法。 Ovito Identify diamond structure命令可以识别和统计金刚石结构,但是无法直接输出结构的变化情况。 本文使用python调用ovito包的方法,可以持续统计各步的金刚石结构,具体代码如下: from ovito…...
深入浅出WebGL:在浏览器中解锁3D世界的魔法钥匙
WebGL:在浏览器中解锁3D世界的魔法钥匙 引言:网页的边界正在消失 在数字化浪潮的推动下,网页早已不再是静态信息的展示窗口。如今,我们可以在浏览器中体验逼真的3D游戏、交互式数据可视化、虚拟实验室,甚至沉浸式的V…...
验证redis数据结构
一、功能验证 1.验证redis的数据结构(如字符串、列表、哈希、集合、有序集合等)是否按照预期工作。 2、常见的数据结构验证方法: ①字符串(string) 测试基本操作 set、get、incr、decr 验证字符串的长度和内容是否正…...
Python异步编程:深入理解协程的原理与实践指南
💝💝💝欢迎莅临我的博客,很高兴能够在这里和您见面!希望您在这里可以感受到一份轻松愉快的氛围,不仅可以获得有趣的内容和知识,也可以畅所欲言、分享您的想法和见解。 持续学习,不断…...
