rawmind0 / alpine-kafka Goto Github PK

Hi, I try to use your catalog entries to setup a kafka cluster (template 1.0.0-rancher1) also with zookeeper (template 3.4.10-rancher1).
As I read "Kafka can now be accessed over the Rancher network.", is it also possible to acccess the kafka cluster from outsite? We like to use it in different rancher environments or completely from outsite.

I already tried with having 2 hosts, with 3 scaled kafka container and a LoadBalancer on each host mapping port 9092. But kafka doesn't react when sending a message.

telnet kafka01.mydomain.de 9092
Trying 123.12.12.123...
Connected to kafka01.mydomain.de.

So the initial connection works.

Do you have any idea?

It's impossible to expose access to client outside of rancher. There is proxy between rancher and clients. So, should let user to set their advertise.listeners.

Like https://github.com/rawmind0/alpine-zk , you should probably be able to control which hosts will schedule these container.

This is a request to add the config param for setting io.rancher.scheduler.affinity:host_label on brokers.

I used alpine-kafka:1.1.0-1 for rancher 1.6. and 3 brokers.

now kakfa service restart every 3 min.
I over it in 3 days and can't find any way to finish it.
how can i do ?
In logs,it only says:
" kafka process is not running, kafka trying to restart. kafka start : /opt/kafka/bin/kafka-service.sh start '

'kafka' process is not running
2019/12/18 上午9:43:13'kafka' process is not running
2019/12/18 上午9:43:13'kafka' trying to restart
2019/12/18 上午9:43:13'kafka' start: '/opt/kafka/bin/kafka-service.sh start'
2019/12/18 上午9:43:13Wed Dec 18 01:43:13 UTC 2019 - [ Starting kafka... ]
2019/12/18 上午9:43:13Wed Dec 18 01:43:13 UTC 2019 - [ Checking kafka configuration... ]
2019/12/18 上午9:43:13Wed Dec 18 01:43:13 UTC 2019 - [ Applying dinamic kafka configuration... ]
2019/12/18 上午9:43:13Wed Dec 18 01:43:13 UTC 2019 - [ Redirecting kafka log to stdout... ]
2019/12/18 上午9:43:13Wed Dec 18 01:43:13 UTC 2019 - [ kafka is already running]
2019/12/18 上午9:43:13Wed Dec 18 01:43:13 UTC 2019 - [ Restarting kafka... ]
2019/12/18 上午9:43:13Wed Dec 18 01:43:13 UTC 2019 - [ Stoping kafka... ]
2019/12/18 上午9:43:13/opt/kafka/bin/kafka-service.sh: line 58: kill: (16958) - No such process
2019/12/18 上午9:43:13Wed Dec 18 01:43:13 UTC 2019 - [ Starting kafka... ]
2019/12/18 上午9:43:13Wed Dec 18 01:43:13 UTC 2019 - [ Checking kafka configuration... ]
2019/12/18 上午9:43:13Wed Dec 18 01:43:13 UTC 2019 - [ Applying dinamic kafka configuration... ]
2019/12/18 上午9:43:13Wed Dec 18 01:43:13 UTC 2019 - [ Redirecting kafka log to stdout... ]
2019/12/18 上午9:43:13nohup: appending output to nohup.out
2019/12/18 上午9:43:13Reinitializing monit daemon
2019/12/18 上午9:43:13Reinitializing Monit -- control file '/opt/monit/etc/monitrc'
2019/12/18 上午9:43:14'kafka-broker-1' Monit reloaded
2019/12/18 上午9:43:14[2019-12-18 01:43:14,429] INFO Registered kafka:type=kafka.Log4jController MBean (kafka.utils.Log4jControllerRegistration$)
2019/12/18 上午9:43:15[2019-12-18 01:43:15,629] INFO starting (kafka.server.KafkaServer)
2019/12/18 上午9:43:15[2019-12-18 01:43:15,631] INFO Connecting to zookeeper on 10.42.102.147:2181,10.42.96.49:2181,10.42.65.176:2181 (kafka.server.KafkaServer)
2019/12/18 上午9:43:15[2019-12-18 01:43:15,667] INFO [ZooKeeperClient] Initializing a new session to 10.42.102.147:2181,10.42.96.49:2181,10.42.65.176:2181. (kafka.zookeeper.ZooKeeperClient)
2019/12/18 上午9:43:15[2019-12-18 01:43:15,677] INFO Client environment:zookeeper.version=3.4.10-39d3a4f269333c922ed3db283be479f9deacaa0f, built on 03/23/2017 10:13 GMT (org.apache.zookeeper.ZooKeeper)
2019/12/18 上午9:43:15[2019-12-18 01:43:15,677] INFO Client environment:host.name=kafka-broker-1 (org.apache.zookeeper.ZooKeeper)
2019/12/18 上午9:43:15[2019-12-18 01:43:15,677] INFO Client environment:java.version=1.8.0_181 (org.apache.zookeeper.ZooKeeper)
2019/12/18 上午9:43:15[2019-12-18 01:43:15,677] INFO Client environment:java.vendor=Oracle Corporation (org.apache.zookeeper.ZooKeeper)
2019/12/18 上午9:43:15[2019-12-18 01:43:15,678] INFO Client environment:java.home=/opt/jre1.8.0_181 (org.apache.zookeeper.ZooKeeper)
2019/12/18 上午9:43:15[2019-12-18 01:43:15,678] INFO Client environment:java.class.path=/opt/kafka/bin/../libs/aopalliance-repackaged-2.5.0-b32.jar:/opt/kafka/bin/../libs/argparse4j-0.7.0.jar:/opt/kafka/bin/../libs/commons-lang3-3.5.jar:/opt/kafka/bin/../libs/connect-api-1.1.0.jar:/opt/kafka/bin/../libs/connect-file-1.1.0.jar:/opt/kafka/bin/../libs/connect-json-1.1.0.jar:/opt/kafka/bin/../libs/connect-runtime-1.1.0.jar:/opt/kafka/bin/../libs/connect-transforms-1.1.0.jar:/opt/kafka/bin/../libs/guava-20.0.jar:/opt/kafka/bin/../libs/hk2-api-2.5.0-b32.jar:/opt/kafka/bin/../libs/hk2-locator-2.5.0-b32.jar:/opt/kafka/bin/../libs/hk2-utils-2.5.0-b32.jar:/opt/kafka/bin/../libs/jackson-annotations-2.9.4.jar:/opt/kafka/bin/../libs/jackson-core-2.9.4.jar:/opt/kafka/bin/../libs/jackson-databind-2.9.4.jar:/opt/kafka/bin/../libs/jackson-jaxrs-base-2.9.4.jar:/opt/kafka/bin/../libs/jackson-jaxrs-json-provider-2.9.4.jar:/opt/kafka/bin/../libs/jackson-module-jaxb-annotations-2.9.4.jar:/opt/kafka/bin/../libs/javassist-3.20.0-GA.jar:/opt/kafka/bin/../libs/javassist-3.21.0-GA.jar:/opt/kafka/bin/../libs/javax.annotation-api-1.2.jar:/opt/kafka/bin/../libs/javax.inject-1.jar:/opt/kafka/bin/../libs/javax.inject-2.5.0-b32.jar:/opt/kafka/bin/../libs/javax.servlet-api-3.1.0.jar:/opt/kafka/bin/../libs/javax.ws.rs-api-2.0.1.jar:/opt/kafka/bin/../libs/jersey-client-2.25.1.jar:/opt/kafka/bin/../libs/jersey-common-2.25.1.jar:/opt/kafka/bin/../libs/jersey-container-servlet-2.25.1.jar:/opt/kafka/bin/../libs/jersey-container-servlet-core-2.25.1.jar:/opt/kafka/bin/../libs/jersey-guava-2.25.1.jar:/opt/kafka/bin/../libs/jersey-media-jaxb-2.25.1.jar:/opt/kafka/bin/../libs/jersey-server-2.25.1.jar:/opt/kafka/bin/../libs/jetty-client-9.2.24.v20180105.jar:/opt/kafka/bin/../libs/jetty-continuation-9.2.24.v20180105.jar:/opt/kafka/bin/../libs/jetty-http-9.2.24.v20180105.jar:/opt/kafka/bin/../libs/jetty-io-9.2.24.v20180105.jar:/opt/kafka/bin/../libs/jetty-security-9.2.24.v20180105.jar:/opt/kafka/bin/../libs/jetty-server-9.2.24.v20180105.jar:/opt/kafka/bin/../libs/jetty-servlet-9.2.24.v20180105.jar:/opt/kafka/bin/../libs/jetty-servlets-9.2.24.v20180105.jar:/opt/kafka/bin/../libs/jetty-util-9.2.24.v20180105.jar:/opt/kafka/bin/../libs/jopt-simple-5.0.4.jar:/opt/kafka/bin/../libs/kafka-clients-1.1.0.jar:/opt/kafka/bin/../libs/kafka-log4j-appender-1.1.0.jar:/opt/kafka/bin/../libs/kafka-streams-1.1.0.jar:/opt/kafka/bin/../libs/kafka-streams-examples-1.1.0.jar:/opt/kafka/bin/../libs/kafka-streams-test-utils-1.1.0.jar:/opt/kafka/bin/../libs/kafka-tools-1.1.0.jar:/opt/kafka/bin/../libs/kafka_2.12-1.1.0-sources.jar:/opt/kafka/bin/../libs/kafka_2.12-1.1.0-test-sources.jar:/opt/kafka/bin/../libs/kafka_2.12-1.1.0.jar:/opt/kafka/bin/../libs/log4j-1.2.17.jar:/opt/kafka/bin/../libs/lz4-java-1.4.jar:/opt/kafka/bin/../libs/maven-artifact-3.5.2.jar:/opt/kafka/bin/../libs/metrics-core-2.2.0.jar:/opt/kafka/bin/../libs/osgi-resource-locator-1.0.1.jar:/opt/kafka/bin/../libs/plexus-utils-3.1.0.jar:/opt/kafka/bin/../libs/reflections-0.9.11.jar:/opt/kafka/bin/../libs/rocksdbjni-5.7.3.jar:/opt/kafka/bin/../libs/scala-library-2.12.4.jar:/opt/kafka/bin/../libs/scala-logging_2.12-3.7.2.jar:/opt/kafka/bin/../libs/scala-reflect-2.12.4.jar:/opt/kafka/bin/../libs/slf4j-api-1.7.25.jar:/opt/kafka/bin/../libs/slf4j-log4j12-1.7.25.jar:/opt/kafka/bin/../libs/snappy-java-1.1.7.1.jar:/opt/kafka/bin/../libs/validation-api-1.1.0.Final.jar:/opt/kafka/bin/../libs/zkclient-0.10.jar:/opt/kafka/bin/../libs/zookeeper-3.4.10.jar (org.apache.zookeeper.ZooKeeper)
2019/12/18 上午9:43:15[2019-12-18 01:43:15,678] INFO Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib (org.apache.zookeeper.ZooKeeper)
2019/12/18 上午9:43:15[2019-12-18 01:43:15,679] INFO Client environment:java.io.tmpdir=/tmp (org.apache.zookeeper.ZooKeeper)
2019/12/18 上午9:43:15[2019-12-18 01:43:15,679] INFO Client environment:java.compiler= (org.apache.zookeeper.ZooKeeper)
2019/12/18 上午9:43:15[2019-12-18 01:43:15,679] INFO Client environment:os.name=Linux (org.apache.zookeeper.ZooKeeper)
2019/12/18 上午9:43:15[2019-12-18 01:43:15,679] INFO Client environment:os.arch=amd64 (org.apache.zookeeper.ZooKeeper)
2019/12/18 上午9:43:15[2019-12-18 01:43:15,679] INFO Client environment:os.version=3.10.0-514.el7.x86_64 (org.apache.zookeeper.ZooKeeper)
2019/12/18 上午9:43:15[2019-12-18 01:43:15,679] INFO Client environment:user.name=kafka (org.apache.zookeeper.ZooKeeper)
2019/12/18 上午9:43:15[2019-12-18 01:43:15,679] INFO Client environment:user.home=/opt/kafka (org.apache.zookeeper.ZooKeeper)
2019/12/18 上午9:43:15[2019-12-18 01:43:15,679] INFO Client environment:user.dir=/opt/kafka (org.apache.zookeeper.ZooKeeper)
2019/12/18 上午9:43:15[2019-12-18 01:43:15,687] INFO Initiating client connection, connectString=10.42.102.147:2181,10.42.96.49:2181,10.42.65.176:2181 sessionTimeout=6000 watcher=kafka.zookeeper.ZooKeeperClient$ZooKeeperClientWatcher$@3ba9ad43 (org.apache.zookeeper.ZooKeeper)
2019/12/18 上午9:43:15[2019-12-18 01:43:15,713] INFO Opening socket connection to server 10.42.102.147/10.42.102.147:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn)
2019/12/18 上午9:43:15[2019-12-18 01:43:15,716] INFO [ZooKeeperClient] Waiting until connected. (kafka.zookeeper.ZooKeeperClient)
2019/12/18 上午9:43:15[2019-12-18 01:43:15,725] INFO Socket connection established to 10.42.102.147/10.42.102.147:2181, initiating session (org.apache.zookeeper.ClientCnxn)
2019/12/18 上午9:43:15[2019-12-18 01:43:15,735] INFO Session establishment complete on server 10.42.102.147/10.42.102.147:2181, sessionid = 0x16f071b78b60356, negotiated timeout = 6000 (org.apache.zookeeper.ClientCnxn)
2019/12/18 上午9:43:15[2019-12-18 01:43:15,744] INFO [ZooKeeperClient] Connected. (kafka.zookeeper.ZooKeeperClient)
2019/12/18 上午9:43:16[2019-12-18 01:43:16,158] INFO Cluster ID = 04lOdbSHRSuTpXT835o0Pw (kafka.server.KafkaServer)
2019/12/18 上午9:43:16[2019-12-18 01:43:16,366] INFO KafkaConfig values:
2019/12/18 上午9:43:16 advertised.host.name = null
2019/12/18 上午9:43:16 advertised.listeners = PLAINTEXT://10.42.43.230:9092
2019/12/18 上午9:43:16 advertised.port = null
2019/12/18 上午9:43:16 alter.config.policy.class.name = null
2019/12/18 上午9:43:16 alter.log.dirs.replication.quota.window.num = 11
2019/12/18 上午9:43:16 alter.log.dirs.replication.quota.window.size.seconds = 1
2019/12/18 上午9:43:16 authorizer.class.name =
2019/12/18 上午9:43:16 auto.create.topics.enable = true
2019/12/18 上午9:43:16 auto.leader.rebalance.enable = true
2019/12/18 上午9:43:16 background.threads = 10
2019/12/18 上午9:43:16 broker.id = 1
2019/12/18 上午9:43:16 broker.id.generation.enable = true
2019/12/18 上午9:43:16 broker.rack = null
2019/12/18 上午9:43:16 compression.type = producer
2019/12/18 上午9:43:16 connections.max.idle.ms = 600000
2019/12/18 上午9:43:16 controlled.shutdown.enable = true
2019/12/18 上午9:43:16 controlled.shutdown.max.retries = 3
2019/12/18 上午9:43:16 controlled.shutdown.retry.backoff.ms = 5000
2019/12/18 上午9:43:16 controller.socket.timeout.ms = 30000
2019/12/18 上午9:43:16 create.topic.policy.class.name = null
2019/12/18 上午9:43:16 default.replication.factor = 1
2019/12/18 上午9:43:16 delegation.token.expiry.check.interval.ms = 3600000
2019/12/18 上午9:43:16 delegation.token.expiry.time.ms = 86400000
2019/12/18 上午9:43:16 delegation.token.master.key = null
2019/12/18 上午9:43:16 delegation.token.max.lifetime.ms = 604800000
2019/12/18 上午9:43:16 delete.records.purgatory.purge.interval.requests = 1
2019/12/18 上午9:43:16 delete.topic.enable = false
2019/12/18 上午9:43:16 fetch.purgatory.purge.interval.requests = 1000
2019/12/18 上午9:43:16 group.initial.rebalance.delay.ms = 3000
2019/12/18 上午9:43:16 group.max.session.timeout.ms = 300000
2019/12/18 上午9:43:16 group.min.session.timeout.ms = 6000
2019/12/18 上午9:43:16 host.name =
2019/12/18 上午9:43:16 inter.broker.listener.name = null
2019/12/18 上午9:43:16 inter.broker.protocol.version = 1.1-IV0
2019/12/18 上午9:43:16 leader.imbalance.check.interval.seconds = 300
2019/12/18 上午9:43:16 leader.imbalance.per.broker.percentage = 10
2019/12/18 上午9:43:16 listener.security.protocol.map = PLAINTEXT:PLAINTEXT,SSL:SSL,SASL_PLAINTEXT:SASL_PLAINTEXT,SASL_SSL:SASL_SSL
2019/12/18 上午9:43:16 listeners = PLAINTEXT://0.0.0.0:9092
2019/12/18 上午9:43:16 log.cleaner.backoff.ms = 15000
2019/12/18 上午9:43:16 log.cleaner.dedupe.buffer.size = 134217728
2019/12/18 上午9:43:16 log.cleaner.delete.retention.ms = 86400000
2019/12/18 上午9:43:16 log.cleaner.enable = true
2019/12/18 上午9:43:16 log.cleaner.io.buffer.load.factor = 0.9
2019/12/18 上午9:43:16 log.cleaner.io.buffer.size = 524288
2019/12/18 上午9:43:16 log.cleaner.io.max.bytes.per.second = 1.7976931348623157E308
2019/12/18 上午9:43:16 log.cleaner.min.cleanable.ratio = 0.5
2019/12/18 上午9:43:16 log.cleaner.min.compaction.lag.ms = 0
2019/12/18 上午9:43:16 log.cleaner.threads = 1
2019/12/18 上午9:43:16 log.cleanup.policy = [delete]
2019/12/18 上午9:43:16 log.dir = /tmp/kafka-logs
2019/12/18 上午9:43:16 log.dirs = /opt/kafka/logs
2019/12/18 上午9:43:16 log.flush.interval.messages = 9223372036854775807
2019/12/18 上午9:43:16 log.flush.interval.ms = null
2019/12/18 上午9:43:16 log.flush.offset.checkpoint.interval.ms = 60000
2019/12/18 上午9:43:16 log.flush.scheduler.interval.ms = 9223372036854775807
2019/12/18 上午9:43:16 log.flush.start.offset.checkpoint.interval.ms = 60000
2019/12/18 上午9:43:16 log.index.interval.bytes = 4096
2019/12/18 上午9:43:16 log.index.size.max.bytes = 10485760
2019/12/18 上午9:43:16 log.message.format.version = 1.1-IV0
2019/12/18 上午9:43:16 log.message.timestamp.difference.max.ms = 9223372036854775807
2019/12/18 上午9:43:16 log.message.timestamp.type = CreateTime
2019/12/18 上午9:43:16 log.preallocate = false
2019/12/18 上午9:43:16 log.retention.bytes = -1
2019/12/18 上午9:43:16 log.retention.check.interval.ms = 300000
2019/12/18 上午9:43:16 log.retention.hours = 168
2019/12/18 上午9:43:16 log.retention.minutes = null
2019/12/18 上午9:43:16 log.retention.ms = null
2019/12/18 上午9:43:16 log.roll.hours = 168
2019/12/18 上午9:43:16 log.roll.jitter.hours = 0
2019/12/18 上午9:43:16 log.roll.jitter.ms = null
2019/12/18 上午9:43:16 log.roll.ms = null
2019/12/18 上午9:43:16 log.segment.bytes = 1073741824
2019/12/18 上午9:43:16 log.segment.delete.delay.ms = 60000
2019/12/18 上午9:43:16 max.connections.per.ip = 2147483647
2019/12/18 上午9:43:16 max.connections.per.ip.overrides =
2019/12/18 上午9:43:16 max.incremental.fetch.session.cache.slots = 1000
2019/12/18 上午9:43:16 message.max.bytes = 1000012
2019/12/18 上午9:43:16 metric.reporters = []
2019/12/18 上午9:43:16 metrics.num.samples = 2
2019/12/18 上午9:43:16 metrics.recording.level = INFO
2019/12/18 上午9:43:16 metrics.sample.window.ms = 30000
2019/12/18 上午9:43:16 min.insync.replicas = 1
2019/12/18 上午9:43:16 num.io.threads = 8
2019/12/18 上午9:43:16 num.network.threads = 3
2019/12/18 上午9:43:16 num.partitions = 2
2019/12/18 上午9:43:16 num.recovery.threads.per.data.dir = 1
2019/12/18 上午9:43:16 num.replica.alter.log.dirs.threads = null
2019/12/18 上午9:43:16 num.replica.fetchers = 1
2019/12/18 上午9:43:16 offset.metadata.max.bytes = 4096
2019/12/18 上午9:43:16 offsets.commit.required.acks = -1
2019/12/18 上午9:43:16 offsets.commit.timeout.ms = 5000
2019/12/18 上午9:43:16 offsets.load.buffer.size = 5242880
2019/12/18 上午9:43:16 offsets.retention.check.interval.ms = 600000
2019/12/18 上午9:43:16 offsets.retention.minutes = 1440
2019/12/18 上午9:43:16 offsets.topic.compression.codec = 0
2019/12/18 上午9:43:16 offsets.topic.num.partitions = 50
2019/12/18 上午9:43:16 offsets.topic.replication.factor = 3
2019/12/18 上午9:43:16 offsets.topic.segment.bytes = 104857600
2019/12/18 上午9:43:16 password.encoder.cipher.algorithm = AES/CBC/PKCS5Padding
2019/12/18 上午9:43:16 password.encoder.iterations = 4096
2019/12/18 上午9:43:16 password.encoder.key.length = 128
2019/12/18 上午9:43:16 password.encoder.keyfactory.algorithm = null
2019/12/18 上午9:43:16 password.encoder.old.secret = null
2019/12/18 上午9:43:16 password.encoder.secret = null
2019/12/18 上午9:43:16 port = 9092
2019/12/18 上午9:43:16 principal.builder.class = null
2019/12/18 上午9:43:16 producer.purgatory.purge.interval.requests = 1000
2019/12/18 上午9:43:16 queued.max.request.bytes = -1
2019/12/18 上午9:43:16 queued.max.requests = 500
2019/12/18 上午9:43:16 quota.consumer.default = 9223372036854775807
2019/12/18 上午9:43:16 quota.producer.default = 9223372036854775807
2019/12/18 上午9:43:16 quota.window.num = 11
2019/12/18 上午9:43:16 quota.window.size.seconds = 1
2019/12/18 上午9:43:16 replica.fetch.backoff.ms = 1000
2019/12/18 上午9:43:16 replica.fetch.max.bytes = 1048576
2019/12/18 上午9:43:16 replica.fetch.min.bytes = 1
2019/12/18 上午9:43:16 replica.fetch.response.max.bytes = 10485760
2019/12/18 上午9:43:16 replica.fetch.wait.max.ms = 500
2019/12/18 上午9:43:16 replica.high.watermark.checkpoint.interval.ms = 5000
2019/12/18 上午9:43:16 replica.lag.time.max.ms = 10000
2019/12/18 上午9:43:16 replica.socket.receive.buffer.bytes = 65536
2019/12/18 上午9:43:16 replica.socket.timeout.ms = 30000
2019/12/18 上午9:43:16 replication.quota.window.num = 11
2019/12/18 上午9:43:16 replication.quota.window.size.seconds = 1
2019/12/18 上午9:43:16 request.timeout.ms = 30000
2019/12/18 上午9:43:16 reserved.broker.max.id = 1000
2019/12/18 上午9:43:16 sasl.enabled.mechanisms = [GSSAPI]
2019/12/18 上午9:43:16 sasl.jaas.config = null
2019/12/18 上午9:43:16 sasl.kerberos.kinit.cmd = /usr/bin/kinit
2019/12/18 上午9:43:16 sasl.kerberos.min.time.before.relogin = 60000
2019/12/18 上午9:43:16 sasl.kerberos.principal.to.local.rules = [DEFAULT]
2019/12/18 上午9:43:16 sasl.kerberos.service.name = null
2019/12/18 上午9:43:16 sasl.kerberos.ticket.renew.jitter = 0.05
2019/12/18 上午9:43:16 sasl.kerberos.ticket.renew.window.factor = 0.8
2019/12/18 上午9:43:16 sasl.mechanism.inter.broker.protocol = GSSAPI
2019/12/18 上午9:43:16 security.inter.broker.protocol = PLAINTEXT
2019/12/18 上午9:43:16 socket.receive.buffer.bytes = 102400
2019/12/18 上午9:43:16 socket.request.max.bytes = 104857600
2019/12/18 上午9:43:16 socket.send.buffer.bytes = 102400
2019/12/18 上午9:43:16 ssl.cipher.suites = []
2019/12/18 上午9:43:16 ssl.client.auth = none
2019/12/18 上午9:43:16 ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1]
2019/12/18 上午9:43:16 ssl.endpoint.identification.algorithm = null
2019/12/18 上午9:43:16 ssl.key.password = null
2019/12/18 上午9:43:16 ssl.keymanager.algorithm = SunX509
2019/12/18 上午9:43:16 ssl.keystore.location = null
2019/12/18 上午9:43:16 ssl.keystore.password = null
2019/12/18 上午9:43:16 ssl.keystore.type = JKS
2019/12/18 上午9:43:16 ssl.protocol = TLS
2019/12/18 上午9:43:16 ssl.provider = null
2019/12/18 上午9:43:16 ssl.secure.random.implementation = null
2019/12/18 上午9:43:16 ssl.trustmanager.algorithm = PKIX
2019/12/18 上午9:43:16 ssl.truststore.location = null
2019/12/18 上午9:43:16 ssl.truststore.password = null
2019/12/18 上午9:43:16 ssl.truststore.type = JKS
2019/12/18 上午9:43:16 transaction.abort.timed.out.transaction.cleanup.interval.ms = 60000
2019/12/18 上午9:43:16 transaction.max.timeout.ms = 900000
2019/12/18 上午9:43:16 transaction.remove.expired.transaction.cleanup.interval.ms = 3600000
2019/12/18 上午9:43:16 transaction.state.log.load.buffer.size = 5242880
2019/12/18 上午9:43:16 transaction.state.log.min.isr = 2
2019/12/18 上午9:43:16 transaction.state.log.num.partitions = 50
2019/12/18 上午9:43:16 transaction.state.log.replication.factor = 3
2019/12/18 上午9:43:16 transaction.state.log.segment.bytes = 104857600
2019/12/18 上午9:43:16 transactional.id.expiration.ms = 604800000
2019/12/18 上午9:43:16 unclean.leader.election.enable = false
2019/12/18 上午9:43:16 zookeeper.connect = 10.42.102.147:2181,10.42.96.49:2181,10.42.65.176:2181
2019/12/18 上午9:43:16 zookeeper.connection.timeout.ms = 6000
2019/12/18 上午9:43:16 zookeeper.max.in.flight.requests = 10
2019/12/18 上午9:43:16 zookeeper.session.timeout.ms = 6000
2019/12/18 上午9:43:16 zookeeper.set.acl = false
2019/12/18 上午9:43:16 zookeeper.sync.time.ms = 2000
2019/12/18 上午9:43:16 (kafka.server.KafkaConfig)
2019/12/18 上午9:43:16[2019-12-18 01:43:16,391] INFO KafkaConfig values:
2019/12/18 上午9:43:16 advertised.host.name = null
2019/12/18 上午9:43:16 advertised.listeners = PLAINTEXT://10.42.43.230:9092
2019/12/18 上午9:43:16 advertised.port = null
2019/12/18 上午9:43:16 alter.config.policy.class.name = null
2019/12/18 上午9:43:16 alter.log.dirs.replication.quota.window.num = 11
2019/12/18 上午9:43:16 alter.log.dirs.replication.quota.window.size.seconds = 1
2019/12/18 上午9:43:16 authorizer.class.name =
2019/12/18 上午9:43:16 auto.create.topics.enable = true
2019/12/18 上午9:43:16 auto.leader.rebalance.enable = true
2019/12/18 上午9:43:16 background.threads = 10
2019/12/18 上午9:43:16 broker.id = 1
2019/12/18 上午9:43:16 broker.id.generation.enable = true
2019/12/18 上午9:43:16 broker.rack = null
2019/12/18 上午9:43:16 compression.type = producer
2019/12/18 上午9:43:16 connections.max.idle.ms = 600000
2019/12/18 上午9:43:16 controlled.shutdown.enable = true
2019/12/18 上午9:43:16 controlled.shutdown.max.retries = 3
2019/12/18 上午9:43:16 controlled.shutdown.retry.backoff.ms = 5000
2019/12/18 上午9:43:16 controller.socket.timeout.ms = 30000
2019/12/18 上午9:43:16 create.topic.policy.class.name = null
2019/12/18 上午9:43:16 default.replication.factor = 1
2019/12/18 上午9:43:16 delegation.token.expiry.check.interval.ms = 3600000
2019/12/18 上午9:43:16 delegation.token.expiry.time.ms = 86400000
2019/12/18 上午9:43:16 delegation.token.master.key = null
2019/12/18 上午9:43:16 delegation.token.max.lifetime.ms = 604800000
2019/12/18 上午9:43:16 delete.records.purgatory.purge.interval.requests = 1
2019/12/18 上午9:43:16 delete.topic.enable = false
2019/12/18 上午9:43:16 fetch.purgatory.purge.interval.requests = 1000
2019/12/18 上午9:43:16 group.initial.rebalance.delay.ms = 3000
2019/12/18 上午9:43:16 group.max.session.timeout.ms = 300000
2019/12/18 上午9:43:16 group.min.session.timeout.ms = 6000
2019/12/18 上午9:43:16 host.name =
2019/12/18 上午9:43:16 inter.broker.listener.name = null
2019/12/18 上午9:43:16 inter.broker.protocol.version = 1.1-IV0
2019/12/18 上午9:43:16 leader.imbalance.check.interval.seconds = 300
2019/12/18 上午9:43:16 leader.imbalance.per.broker.percentage = 10
2019/12/18 上午9:43:16 listener.security.protocol.map = PLAINTEXT:PLAINTEXT,SSL:SSL,SASL_PLAINTEXT:SASL_PLAINTEXT,SASL_SSL:SASL_SSL
2019/12/18 上午9:43:16 listeners = PLAINTEXT://0.0.0.0:9092
2019/12/18 上午9:43:16 log.cleaner.backoff.ms = 15000
2019/12/18 上午9:43:16 log.cleaner.dedupe.buffer.size = 134217728
2019/12/18 上午9:43:16 log.cleaner.delete.retention.ms = 86400000
2019/12/18 上午9:43:16 log.cleaner.enable = true
2019/12/18 上午9:43:16 log.cleaner.io.buffer.load.factor = 0.9
2019/12/18 上午9:43:16 log.cleaner.io.buffer.size = 524288
2019/12/18 上午9:43:16 log.cleaner.io.max.bytes.per.second = 1.7976931348623157E308
2019/12/18 上午9:43:16 log.cleaner.min.cleanable.ratio = 0.5
2019/12/18 上午9:43:16 log.cleaner.min.compaction.lag.ms = 0
2019/12/18 上午9:43:16 log.cleaner.threads = 1
2019/12/18 上午9:43:16 log.cleanup.policy = [delete]
2019/12/18 上午9:43:16 log.dir = /tmp/kafka-logs
2019/12/18 上午9:43:16 log.dirs = /opt/kafka/logs
2019/12/18 上午9:43:16 log.flush.interval.messages = 9223372036854775807
2019/12/18 上午9:43:16 log.flush.interval.ms = null
2019/12/18 上午9:43:16 log.flush.offset.checkpoint.interval.ms = 60000
2019/12/18 上午9:43:16 log.flush.scheduler.interval.ms = 9223372036854775807
2019/12/18 上午9:43:16 log.flush.start.offset.checkpoint.interval.ms = 60000
2019/12/18 上午9:43:16 log.index.interval.bytes = 4096
2019/12/18 上午9:43:16 log.index.size.max.bytes = 10485760
2019/12/18 上午9:43:16 log.message.format.version = 1.1-IV0
2019/12/18 上午9:43:16 log.message.timestamp.difference.max.ms = 9223372036854775807
2019/12/18 上午9:43:16 log.message.timestamp.type = CreateTime
2019/12/18 上午9:43:16 log.preallocate = false
2019/12/18 上午9:43:16 log.retention.bytes = -1
2019/12/18 上午9:43:16 log.retention.check.interval.ms = 300000
2019/12/18 上午9:43:16 log.retention.hours = 168
2019/12/18 上午9:43:16 log.retention.minutes = null
2019/12/18 上午9:43:16 log.retention.ms = null
2019/12/18 上午9:43:16 log.roll.hours = 168
2019/12/18 上午9:43:16 log.roll.jitter.hours = 0
2019/12/18 上午9:43:16 log.roll.jitter.ms = null
2019/12/18 上午9:43:16 log.roll.ms = null
2019/12/18 上午9:43:16 log.segment.bytes = 1073741824
2019/12/18 上午9:43:16 log.segment.delete.delay.ms = 60000
2019/12/18 上午9:43:16 max.connections.per.ip = 2147483647
2019/12/18 上午9:43:16 max.connections.per.ip.overrides =
2019/12/18 上午9:43:16 max.incremental.fetch.session.cache.slots = 1000
2019/12/18 上午9:43:16 message.max.bytes = 1000012
2019/12/18 上午9:43:16 metric.reporters = []
2019/12/18 上午9:43:16 metrics.num.samples = 2
2019/12/18 上午9:43:16 metrics.recording.level = INFO
2019/12/18 上午9:43:16 metrics.sample.window.ms = 30000
2019/12/18 上午9:43:16 min.insync.replicas = 1
2019/12/18 上午9:43:16 num.io.threads = 8
2019/12/18 上午9:43:16 num.network.threads = 3
2019/12/18 上午9:43:16 num.partitions = 2
2019/12/18 上午9:43:16 num.recovery.threads.per.data.dir = 1
2019/12/18 上午9:43:16 num.replica.alter.log.dirs.threads = null
2019/12/18 上午9:43:16 num.replica.fetchers = 1
2019/12/18 上午9:43:16 offset.metadata.max.bytes = 4096
2019/12/18 上午9:43:16 offsets.commit.required.acks = -1
2019/12/18 上午9:43:16 offsets.commit.timeout.ms = 5000
2019/12/18 上午9:43:16 offsets.load.buffer.size = 5242880
2019/12/18 上午9:43:16 offsets.retention.check.interval.ms = 600000
2019/12/18 上午9:43:16 offsets.retention.minutes = 1440
2019/12/18 上午9:43:16 offsets.topic.compression.codec = 0
2019/12/18 上午9:43:16 offsets.topic.num.partitions = 50
2019/12/18 上午9:43:16 offsets.topic.replication.factor = 3
2019/12/18 上午9:43:16 offsets.topic.segment.bytes = 104857600
2019/12/18 上午9:43:16 password.encoder.cipher.algorithm = AES/CBC/PKCS5Padding
2019/12/18 上午9:43:16 password.encoder.iterations = 4096
2019/12/18 上午9:43:16 password.encoder.key.length = 128
2019/12/18 上午9:43:16 password.encoder.keyfactory.algorithm = null
2019/12/18 上午9:43:16 password.encoder.old.secret = null
2019/12/18 上午9:43:16 password.encoder.secret = null
2019/12/18 上午9:43:16 port = 9092
2019/12/18 上午9:43:16 principal.builder.class = null
2019/12/18 上午9:43:16 producer.purgatory.purge.interval.requests = 1000
2019/12/18 上午9:43:16 queued.max.request.bytes = -1
2019/12/18 上午9:43:16 queued.max.requests = 500
2019/12/18 上午9:43:16 quota.consumer.default = 9223372036854775807
2019/12/18 上午9:43:16 quota.producer.default = 9223372036854775807
2019/12/18 上午9:43:16 quota.window.num = 11
2019/12/18 上午9:43:16 quota.window.size.seconds = 1
2019/12/18 上午9:43:16 replica.fetch.backoff.ms = 1000
2019/12/18 上午9:43:16 replica.fetch.max.bytes = 1048576
2019/12/18 上午9:43:16 replica.fetch.min.bytes = 1
2019/12/18 上午9:43:16 replica.fetch.response.max.bytes = 10485760
2019/12/18 上午9:43:16 replica.fetch.wait.max.ms = 500
2019/12/18 上午9:43:16 replica.high.watermark.checkpoint.interval.ms = 5000
2019/12/18 上午9:43:16 replica.lag.time.max.ms = 10000
2019/12/18 上午9:43:16 replica.socket.receive.buffer.bytes = 65536
2019/12/18 上午9:43:16 replica.socket.timeout.ms = 30000
2019/12/18 上午9:43:16 replication.quota.window.num = 11
2019/12/18 上午9:43:16 replication.quota.window.size.seconds = 1
2019/12/18 上午9:43:16 request.timeout.ms = 30000
2019/12/18 上午9:43:16 reserved.broker.max.id = 1000
2019/12/18 上午9:43:16 sasl.enabled.mechanisms = [GSSAPI]
2019/12/18 上午9:43:16 sasl.jaas.config = null
2019/12/18 上午9:43:16 sasl.kerberos.kinit.cmd = /usr/bin/kinit
2019/12/18 上午9:43:16 sasl.kerberos.min.time.before.relogin = 60000
2019/12/18 上午9:43:16 sasl.kerberos.principal.to.local.rules = [DEFAULT]
2019/12/18 上午9:43:16 sasl.kerberos.service.name = null
2019/12/18 上午9:43:16 sasl.kerberos.ticket.renew.jitter = 0.05
2019/12/18 上午9:43:16 sasl.kerberos.ticket.renew.window.factor = 0.8
2019/12/18 上午9:43:16 sasl.mechanism.inter.broker.protocol = GSSAPI
2019/12/18 上午9:43:16 security.inter.broker.protocol = PLAINTEXT
2019/12/18 上午9:43:16 socket.receive.buffer.bytes = 102400
2019/12/18 上午9:43:16 socket.request.max.bytes = 104857600
2019/12/18 上午9:43:16 socket.send.buffer.bytes = 102400
2019/12/18 上午9:43:16 ssl.cipher.suites = []
2019/12/18 上午9:43:16 ssl.client.auth = none
2019/12/18 上午9:43:16 ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1]
2019/12/18 上午9:43:16 ssl.endpoint.identification.algorithm = null
2019/12/18 上午9:43:16 ssl.key.password = null
2019/12/18 上午9:43:16 ssl.keymanager.algorithm = SunX509
2019/12/18 上午9:43:16 ssl.keystore.location = null
2019/12/18 上午9:43:16 ssl.keystore.password = null
2019/12/18 上午9:43:16 ssl.keystore.type = JKS
2019/12/18 上午9:43:16 ssl.protocol = TLS
2019/12/18 上午9:43:16 ssl.provider = null
2019/12/18 上午9:43:16 ssl.secure.random.implementation = null
2019/12/18 上午9:43:16 ssl.trustmanager.algorithm = PKIX
2019/12/18 上午9:43:16 ssl.truststore.location = null
2019/12/18 上午9:43:16 ssl.truststore.password = null
2019/12/18 上午9:43:16 ssl.truststore.type = JKS
2019/12/18 上午9:43:16 transaction.abort.timed.out.transaction.cleanup.interval.ms = 60000
2019/12/18 上午9:43:16 transaction.max.timeout.ms = 900000
2019/12/18 上午9:43:16 transaction.remove.expired.transaction.cleanup.interval.ms = 3600000
2019/12/18 上午9:43:16 transaction.state.log.load.buffer.size = 5242880
2019/12/18 上午9:43:16 transaction.state.log.min.isr = 2
2019/12/18 上午9:43:16 transaction.state.log.num.partitions = 50
2019/12/18 上午9:43:16 transaction.state.log.replication.factor = 3
2019/12/18 上午9:43:16 transaction.state.log.segment.bytes = 104857600
2019/12/18 上午9:43:16 transactional.id.expiration.ms = 604800000
2019/12/18 上午9:43:16 unclean.leader.election.enable = false
2019/12/18 上午9:43:16 zookeeper.connect = 10.42.102.147:2181,10.42.96.49:2181,10.42.65.176:2181
2019/12/18 上午9:43:16 zookeeper.connection.timeout.ms = 6000
2019/12/18 上午9:43:16 zookeeper.max.in.flight.requests = 10
2019/12/18 上午9:43:16 zookeeper.session.timeout.ms = 6000
2019/12/18 上午9:43:16 zookeeper.set.acl = false
2019/12/18 上午9:43:16 zookeeper.sync.time.ms = 2000
2019/12/18 上午9:43:16 (kafka.server.KafkaConfig)
2019/12/18 上午9:43:16[2019-12-18 01:43:16,467] INFO [ThrottledRequestReaper-Produce]: Starting (kafka.server.ClientQuotaManager$ThrottledRequestReaper)
2019/12/18 上午9:43:16[2019-12-18 01:43:16,468] INFO [ThrottledRequestReaper-Fetch]: Starting (kafka.server.ClientQuotaManager$ThrottledRequestReaper)
2019/12/18 上午9:43:16[2019-12-18 01:43:16,473] INFO [ThrottledRequestReaper-Request]: Starting (kafka.server.ClientQuotaManager$ThrottledRequestReaper)
2019/12/18 上午9:43:16[2019-12-18 01:43:16,554] INFO Loading logs. (kafka.log.LogManager)
2019/12/18 上午9:43:16[2019-12-18 01:43:16,711] WARN [Log partition=__consumer_offsets-0, dir=/opt/kafka/logs] Found a corrupted index file corresponding to log file /opt/kafka/logs/__consumer_offsets-0/00000000000000000000.log due to Corrupt index found, index file (/opt/kafka/logs/__consumer_offsets-0/00000000000000000000.index) has non-zero size but the last offset is 0 which is no greater than the base offset 0.}, recovering segment and rebuilding index files... (kafka.log.Log)
2019/12/18 上午9:43:16[2019-12-18 01:43:16,782] INFO [Log partition=__consumer_offsets-0, dir=/opt/kafka/logs] Recovering unflushed segment 0 (kafka.log.Log)
2019/12/18 上午9:43:16[2019-12-18 01:43:16,801] INFO [Log partition=__consumer_offsets-0, dir=/opt/kafka/logs] Loading producer state from offset 0 with message format version 2 (kafka.log.Log)
2019/12/18 上午9:43:16[2019-12-18 01:43:16,805] INFO [Log partition=__consumer_offsets-0, dir=/opt/kafka/logs] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 137 ms (kafka.log.Log)
2019/12/18 上午9:43:16[2019-12-18 01:43:16,879] WARN [Log partition=__consumer_offsets-29, dir=/opt/kafka/logs] Found a corrupted index file corresponding to log file /opt/kafka/logs/__consumer_offsets-29/00000000000000000000.log due to Corrupt index found, index file (/opt/kafka/logs/__consumer_offsets-29/00000000000000000000.index) has non-zero size but the last offset is 0 which is no greater than the base offset 0.}, recovering segment and rebuilding index files... (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,083] INFO [ProducerStateManager partition=__consumer_offsets-29] Writing producer snapshot at offset 9854 (kafka.log.ProducerStateManager)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,091] INFO [Log partition=__consumer_offsets-29, dir=/opt/kafka/logs] Recovering unflushed segment 0 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,153] INFO [ProducerStateManager partition=__consumer_offsets-29] Writing producer snapshot at offset 9854 (kafka.log.ProducerStateManager)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,161] INFO [Log partition=__consumer_offsets-29, dir=/opt/kafka/logs] Loading producer state from offset 9854 with message format version 2 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,164] INFO [ProducerStateManager partition=__consumer_offsets-29] Loading producer state from snapshot file '/opt/kafka/logs/__consumer_offsets-29/00000000000000009854.snapshot' (kafka.log.ProducerStateManager)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,177] INFO [Log partition=__consumer_offsets-29, dir=/opt/kafka/logs] Completed load of log with 1 segments, log start offset 0 and log end offset 9854 in 303 ms (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,184] WARN [Log partition=__consumer_offsets-48, dir=/opt/kafka/logs] Found a corrupted index file corresponding to log file /opt/kafka/logs/__consumer_offsets-48/00000000000000000000.log due to Corrupt index found, index file (/opt/kafka/logs/__consumer_offsets-48/00000000000000000000.index) has non-zero size but the last offset is 0 which is no greater than the base offset 0.}, recovering segment and rebuilding index files... (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,186] INFO [Log partition=__consumer_offsets-48, dir=/opt/kafka/logs] Recovering unflushed segment 0 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,187] INFO [Log partition=__consumer_offsets-48, dir=/opt/kafka/logs] Loading producer state from offset 0 with message format version 2 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,188] INFO [Log partition=__consumer_offsets-48, dir=/opt/kafka/logs] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 7 ms (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,194] WARN [Log partition=__consumer_offsets-10, dir=/opt/kafka/logs] Found a corrupted index file corresponding to log file /opt/kafka/logs/__consumer_offsets-10/00000000000000000000.log due to Corrupt index found, index file (/opt/kafka/logs/__consumer_offsets-10/00000000000000000000.index) has non-zero size but the last offset is 0 which is no greater than the base offset 0.}, recovering segment and rebuilding index files... (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,195] INFO [Log partition=__consumer_offsets-10, dir=/opt/kafka/logs] Recovering unflushed segment 0 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,196] INFO [Log partition=__consumer_offsets-10, dir=/opt/kafka/logs] Loading producer state from offset 0 with message format version 2 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,197] INFO [Log partition=__consumer_offsets-10, dir=/opt/kafka/logs] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 6 ms (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,202] WARN [Log partition=__consumer_offsets-45, dir=/opt/kafka/logs] Found a corrupted index file corresponding to log file /opt/kafka/logs/__consumer_offsets-45/00000000000000000000.log due to Corrupt index found, index file (/opt/kafka/logs/__consumer_offsets-45/00000000000000000000.index) has non-zero size but the last offset is 0 which is no greater than the base offset 0.}, recovering segment and rebuilding index files... (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,204] INFO [Log partition=__consumer_offsets-45, dir=/opt/kafka/logs] Recovering unflushed segment 0 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,205] INFO [Log partition=__consumer_offsets-45, dir=/opt/kafka/logs] Loading producer state from offset 0 with message format version 2 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,206] INFO [Log partition=__consumer_offsets-45, dir=/opt/kafka/logs] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 6 ms (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,211] WARN [Log partition=__consumer_offsets-26, dir=/opt/kafka/logs] Found a corrupted index file corresponding to log file /opt/kafka/logs/__consumer_offsets-26/00000000000000000000.log due to Corrupt index found, index file (/opt/kafka/logs/__consumer_offsets-26/00000000000000000000.index) has non-zero size but the last offset is 0 which is no greater than the base offset 0.}, recovering segment and rebuilding index files... (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,212] INFO [Log partition=__consumer_offsets-26, dir=/opt/kafka/logs] Recovering unflushed segment 0 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,214] INFO [Log partition=__consumer_offsets-26, dir=/opt/kafka/logs] Loading producer state from offset 0 with message format version 2 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,215] INFO [Log partition=__consumer_offsets-26, dir=/opt/kafka/logs] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 6 ms (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,220] WARN [Log partition=__consumer_offsets-7, dir=/opt/kafka/logs] Found a corrupted index file corresponding to log file /opt/kafka/logs/__consumer_offsets-7/00000000000000000000.log due to Corrupt index found, index file (/opt/kafka/logs/__consumer_offsets-7/00000000000000000000.index) has non-zero size but the last offset is 0 which is no greater than the base offset 0.}, recovering segment and rebuilding index files... (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,222] INFO [Log partition=__consumer_offsets-7, dir=/opt/kafka/logs] Recovering unflushed segment 0 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,223] INFO [Log partition=__consumer_offsets-7, dir=/opt/kafka/logs] Loading producer state from offset 0 with message format version 2 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,223] INFO [Log partition=__consumer_offsets-7, dir=/opt/kafka/logs] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 5 ms (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,235] WARN [Log partition=__consumer_offsets-42, dir=/opt/kafka/logs] Found a corrupted index file corresponding to log file /opt/kafka/logs/__consumer_offsets-42/00000000000000000000.log due to Corrupt index found, index file (/opt/kafka/logs/__consumer_offsets-42/00000000000000000000.index) has non-zero size but the last offset is 0 which is no greater than the base offset 0.}, recovering segment and rebuilding index files... (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,238] INFO [Log partition=__consumer_offsets-42, dir=/opt/kafka/logs] Recovering unflushed segment 0 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,241] INFO [Log partition=__consumer_offsets-42, dir=/opt/kafka/logs] Loading producer state from offset 0 with message format version 2 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,242] INFO [Log partition=__consumer_offsets-42, dir=/opt/kafka/logs] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 11 ms (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,254] WARN [Log partition=__consumer_offsets-4, dir=/opt/kafka/logs] Found a corrupted index file corresponding to log file /opt/kafka/logs/__consumer_offsets-4/00000000000000000000.log due to Corrupt index found, index file (/opt/kafka/logs/__consumer_offsets-4/00000000000000000000.index) has non-zero size but the last offset is 0 which is no greater than the base offset 0.}, recovering segment and rebuilding index files... (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,256] INFO [Log partition=__consumer_offsets-4, dir=/opt/kafka/logs] Recovering unflushed segment 0 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,258] INFO [Log partition=__consumer_offsets-4, dir=/opt/kafka/logs] Loading producer state from offset 0 with message format version 2 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,261] INFO [Log partition=__consumer_offsets-4, dir=/opt/kafka/logs] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 11 ms (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,271] WARN [Log partition=__consumer_offsets-23, dir=/opt/kafka/logs] Found a corrupted index file corresponding to log file /opt/kafka/logs/__consumer_offsets-23/00000000000000000000.log due to Corrupt index found, index file (/opt/kafka/logs/__consumer_offsets-23/00000000000000000000.index) has non-zero size but the last offset is 0 which is no greater than the base offset 0.}, recovering segment and rebuilding index files... (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,274] INFO [Log partition=__consumer_offsets-23, dir=/opt/kafka/logs] Recovering unflushed segment 0 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,276] INFO [Log partition=__consumer_offsets-23, dir=/opt/kafka/logs] Loading producer state from offset 0 with message format version 2 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,277] INFO [Log partition=__consumer_offsets-23, dir=/opt/kafka/logs] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 9 ms (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,287] WARN [Log partition=__consumer_offsets-1, dir=/opt/kafka/logs] Found a corrupted index file corresponding to log file /opt/kafka/logs/__consumer_offsets-1/00000000000000000000.log due to Corrupt index found, index file (/opt/kafka/logs/__consumer_offsets-1/00000000000000000000.index) has non-zero size but the last offset is 0 which is no greater than the base offset 0.}, recovering segment and rebuilding index files... (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,289] INFO [Log partition=__consumer_offsets-1, dir=/opt/kafka/logs] Recovering unflushed segment 0 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,292] INFO [Log partition=__consumer_offsets-1, dir=/opt/kafka/logs] Loading producer state from offset 0 with message format version 2 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,293] INFO [Log partition=__consumer_offsets-1, dir=/opt/kafka/logs] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 10 ms (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,302] WARN [Log partition=__consumer_offsets-20, dir=/opt/kafka/logs] Found a corrupted index file corresponding to log file /opt/kafka/logs/__consumer_offsets-20/00000000000000000000.log due to Corrupt index found, index file (/opt/kafka/logs/__consumer_offsets-20/00000000000000000000.index) has non-zero size but the last offset is 0 which is no greater than the base offset 0.}, recovering segment and rebuilding index files... (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,304] INFO [Log partition=__consumer_offsets-20, dir=/opt/kafka/logs] Recovering unflushed segment 0 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,306] INFO [Log partition=__consumer_offsets-20, dir=/opt/kafka/logs] Loading producer state from offset 0 with message format version 2 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,307] INFO [Log partition=__consumer_offsets-20, dir=/opt/kafka/logs] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 9 ms (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,318] WARN [Log partition=__consumer_offsets-39, dir=/opt/kafka/logs] Found a corrupted index file corresponding to log file /opt/kafka/logs/__consumer_offsets-39/00000000000000000000.log due to Corrupt index found, index file (/opt/kafka/logs/__consumer_offsets-39/00000000000000000000.index) has non-zero size but the last offset is 0 which is no greater than the base offset 0.}, recovering segment and rebuilding index files... (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,321] INFO [Log partition=__consumer_offsets-39, dir=/opt/kafka/logs] Recovering unflushed segment 0 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,323] INFO [Log partition=__consumer_offsets-39, dir=/opt/kafka/logs] Loading producer state from offset 0 with message format version 2 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,324] INFO [Log partition=__consumer_offsets-39, dir=/opt/kafka/logs] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 10 ms (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,332] WARN [Log partition=__consumer_offsets-17, dir=/opt/kafka/logs] Found a corrupted index file corresponding to log file /opt/kafka/logs/__consumer_offsets-17/00000000000000000000.log due to Corrupt index found, index file (/opt/kafka/logs/__consumer_offsets-17/00000000000000000000.index) has non-zero size but the last offset is 0 which is no greater than the base offset 0.}, recovering segment and rebuilding index files... (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,335] INFO [Log partition=__consumer_offsets-17, dir=/opt/kafka/logs] Recovering unflushed segment 0 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,337] INFO [Log partition=__consumer_offsets-17, dir=/opt/kafka/logs] Loading producer state from offset 0 with message format version 2 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,338] INFO [Log partition=__consumer_offsets-17, dir=/opt/kafka/logs] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 9 ms (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,350] WARN [Log partition=__consumer_offsets-36, dir=/opt/kafka/logs] Found a corrupted index file corresponding to log file /opt/kafka/logs/__consumer_offsets-36/00000000000000000000.log due to Corrupt index found, index file (/opt/kafka/logs/__consumer_offsets-36/00000000000000000000.index) has non-zero size but the last offset is 0 which is no greater than the base offset 0.}, recovering segment and rebuilding index files... (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,352] INFO [Log partition=__consumer_offsets-36, dir=/opt/kafka/logs] Recovering unflushed segment 0 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,354] INFO [Log partition=__consumer_offsets-36, dir=/opt/kafka/logs] Loading producer state from offset 0 with message format version 2 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,355] INFO [Log partition=__consumer_offsets-36, dir=/opt/kafka/logs] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 9 ms (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,366] WARN [Log partition=__consumer_offsets-14, dir=/opt/kafka/logs] Found a corrupted index file corresponding to log file /opt/kafka/logs/__consumer_offsets-14/00000000000000000000.log due to Corrupt index found, index file (/opt/kafka/logs/__consumer_offsets-14/00000000000000000000.index) has non-zero size but the last offset is 0 which is no greater than the base offset 0.}, recovering segment and rebuilding index files... (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,368] INFO [Log partition=__consumer_offsets-14, dir=/opt/kafka/logs] Recovering unflushed segment 0 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,370] INFO [Log partition=__consumer_offsets-14, dir=/opt/kafka/logs] Loading producer state from offset 0 with message format version 2 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,371] INFO [Log partition=__consumer_offsets-14, dir=/opt/kafka/logs] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 11 ms (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,379] WARN [Log partition=__consumer_offsets-33, dir=/opt/kafka/logs] Found a corrupted index file corresponding to log file /opt/kafka/logs/__consumer_offsets-33/00000000000000000000.log due to Corrupt index found, index file (/opt/kafka/logs/__consumer_offsets-33/00000000000000000000.index) has non-zero size but the last offset is 0 which is no greater than the base offset 0.}, recovering segment and rebuilding index files... (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,381] INFO [Log partition=__consumer_offsets-33, dir=/opt/kafka/logs] Recovering unflushed segment 0 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,383] INFO [Log partition=__consumer_offsets-33, dir=/opt/kafka/logs] Loading producer state from offset 0 with message format version 2 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,384] INFO [Log partition=__consumer_offsets-33, dir=/opt/kafka/logs] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 8 ms (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,392] WARN [Log partition=__consumer_offsets-49, dir=/opt/kafka/logs] Found a corrupted index file corresponding to log file /opt/kafka/logs/__consumer_offsets-49/00000000000000000000.log due to Corrupt index found, index file (/opt/kafka/logs/__consumer_offsets-49/00000000000000000000.index) has non-zero size but the last offset is 0 which is no greater than the base offset 0.}, recovering segment and rebuilding index files... (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,395] INFO [Log partition=__consumer_offsets-49, dir=/opt/kafka/logs] Recovering unflushed segment 0 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,397] INFO [Log partition=__consumer_offsets-49, dir=/opt/kafka/logs] Loading producer state from offset 0 with message format version 2 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,398] INFO [Log partition=__consumer_offsets-49, dir=/opt/kafka/logs] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 9 ms (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,406] WARN [Log partition=__consumer_offsets-11, dir=/opt/kafka/logs] Found a corrupted index file corresponding to log file /opt/kafka/logs/__consumer_offsets-11/00000000000000000000.log due to Corrupt index found, index file (/opt/kafka/logs/__consumer_offsets-11/00000000000000000000.index) has non-zero size but the last offset is 0 which is no greater than the base offset 0.}, recovering segment and rebuilding index files... (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,409] INFO [Log partition=__consumer_offsets-11, dir=/opt/kafka/logs] Recovering unflushed segment 0 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,411] INFO [Log partition=__consumer_offsets-11, dir=/opt/kafka/logs] Loading producer state from offset 0 with message format version 2 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,412] INFO [Log partition=__consumer_offsets-11, dir=/opt/kafka/logs] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 9 ms (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,420] WARN [Log partition=__consumer_offsets-30, dir=/opt/kafka/logs] Found a corrupted index file corresponding to log file /opt/kafka/logs/__consumer_offsets-30/00000000000000000000.log due to Corrupt index found, index file (/opt/kafka/logs/__consumer_offsets-30/00000000000000000000.index) has non-zero size but the last offset is 0 which is no greater than the base offset 0.}, recovering segment and rebuilding index files... (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,423] INFO [Log partition=__consumer_offsets-30, dir=/opt/kafka/logs] Recovering unflushed segment 0 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,426] INFO [Log partition=__consumer_offsets-30, dir=/opt/kafka/logs] Loading producer state from offset 0 with message format version 2 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,427] INFO [Log partition=__consumer_offsets-30, dir=/opt/kafka/logs] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 10 ms (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,435] WARN [Log partition=__consumer_offsets-46, dir=/opt/kafka/logs] Found a corrupted index file corresponding to log file /opt/kafka/logs/__consumer_offsets-46/00000000000000000000.log due to Corrupt index found, index file (/opt/kafka/logs/__consumer_offsets-46/00000000000000000000.index) has non-zero size but the last offset is 0 which is no greater than the base offset 0.}, recovering segment and rebuilding index files... (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,438] INFO [Log partition=__consumer_offsets-46, dir=/opt/kafka/logs] Recovering unflushed segment 0 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,440] INFO [Log partition=__consumer_offsets-46, dir=/opt/kafka/logs] Loading producer state from offset 0 with message format version 2 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,441] INFO [Log partition=__consumer_offsets-46, dir=/opt/kafka/logs] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 10 ms (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,450] WARN [Log partition=__consumer_offsets-27, dir=/opt/kafka/logs] Found a corrupted index file corresponding to log file /opt/kafka/logs/__consumer_offsets-27/00000000000000000000.log due to Corrupt index found, index file (/opt/kafka/logs/__consumer_offsets-27/00000000000000000000.index) has non-zero size but the last offset is 0 which is no greater than the base offset 0.}, recovering segment and rebuilding index files... (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,453] INFO [Log partition=__consumer_offsets-27, dir=/opt/kafka/logs] Recovering unflushed segment 0 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,455] INFO [Log partition=__consumer_offsets-27, dir=/opt/kafka/logs] Loading producer state from offset 0 with message format version 2 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,456] INFO [Log partition=__consumer_offsets-27, dir=/opt/kafka/logs] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 10 ms (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,464] WARN [Log partition=__consumer_offsets-8, dir=/opt/kafka/logs] Found a corrupted index file corresponding to log file /opt/kafka/logs/__consumer_offsets-8/00000000000000000000.log due to Corrupt index found, index file (/opt/kafka/logs/__consumer_offsets-8/00000000000000000000.index) has non-zero size but the last offset is 0 which is no greater than the base offset 0.}, recovering segment and rebuilding index files... (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,466] INFO [Log partition=__consumer_offsets-8, dir=/opt/kafka/logs] Recovering unflushed segment 0 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,468] INFO [Log partition=__consumer_offsets-8, dir=/opt/kafka/logs] Loading producer state from offset 0 with message format version 2 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,469] INFO [Log partition=__consumer_offsets-8, dir=/opt/kafka/logs] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 9 ms (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,478] WARN [Log partition=__consumer_offsets-24, dir=/opt/kafka/logs] Found a corrupted index file corresponding to log file /opt/kafka/logs/__consumer_offsets-24/00000000000000000000.log due to Corrupt index found, index file (/opt/kafka/logs/__consumer_offsets-24/00000000000000000000.index) has non-zero size but the last offset is 0 which is no greater than the base offset 0.}, recovering segment and rebuilding index files... (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,481] INFO [Log partition=__consumer_offsets-24, dir=/opt/kafka/logs] Recovering unflushed segment 0 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,483] INFO [Log partition=__consumer_offsets-24, dir=/opt/kafka/logs] Loading producer state from offset 0 with message format version 2 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,484] INFO [Log partition=__consumer_offsets-24, dir=/opt/kafka/logs] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 10 ms (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,490] WARN [Log partition=__consumer_offsets-43, dir=/opt/kafka/logs] Found a corrupted index file corresponding to log file /opt/kafka/logs/__consumer_offsets-43/00000000000000000000.log due to Corrupt index found, index file (/opt/kafka/logs/__consumer_offsets-43/00000000000000000000.index) has non-zero size but the last offset is 0 which is no greater than the base offset 0.}, recovering segment and rebuilding index files... (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,491] INFO [Log partition=__consumer_offsets-43, dir=/opt/kafka/logs] Recovering unflushed segment 0 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,492] INFO [Log partition=__consumer_offsets-43, dir=/opt/kafka/logs] Loading producer state from offset 0 with message format version 2 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,493] INFO [Log partition=__consumer_offsets-43, dir=/opt/kafka/logs] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 6 ms (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,499] WARN [Log partition=__consumer_offsets-5, dir=/opt/kafka/logs] Found a corrupted index file corresponding to log file /opt/kafka/logs/__consumer_offsets-5/00000000000000000000.log due to Corrupt index found, index file (/opt/kafka/logs/__consumer_offsets-5/00000000000000000000.index) has non-zero size but the last offset is 0 which is no greater than the base offset 0.}, recovering segment and rebuilding index files... (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,501] INFO [Log partition=__consumer_offsets-5, dir=/opt/kafka/logs] Recovering unflushed segment 0 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,502] INFO [Log partition=__consumer_offsets-5, dir=/opt/kafka/logs] Loading producer state from offset 0 with message format version 2 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,503] INFO [Log partition=__consumer_offsets-5, dir=/opt/kafka/logs] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 7 ms (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,509] WARN [Log partition=__consumer_offsets-21, dir=/opt/kafka/logs] Found a corrupted index file corresponding to log file /opt/kafka/logs/__consumer_offsets-21/00000000000000000000.log due to Corrupt index found, index file (/opt/kafka/logs/__consumer_offsets-21/00000000000000000000.index) has non-zero size but the last offset is 0 which is no greater than the base offset 0.}, recovering segment and rebuilding index files... (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,511] INFO [Log partition=__consumer_offsets-21, dir=/opt/kafka/logs] Recovering unflushed segment 0 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,513] INFO [Log partition=__consumer_offsets-21, dir=/opt/kafka/logs] Loading producer state from offset 0 with message format version 2 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,514] INFO [Log partition=__consumer_offsets-21, dir=/opt/kafka/logs] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 8 ms (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,520] WARN [Log partition=__consumer_offsets-2, dir=/opt/kafka/logs] Found a corrupted index file corresponding to log file /opt/kafka/logs/__consumer_offsets-2/00000000000000000000.log due to Corrupt index found, index file (/opt/kafka/logs/__consumer_offsets-2/00000000000000000000.index) has non-zero size but the last offset is 0 which is no greater than the base offset 0.}, recovering segment and rebuilding index files... (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,522] INFO [Log partition=__consumer_offsets-2, dir=/opt/kafka/logs] Recovering unflushed segment 0 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,523] INFO [Log partition=__consumer_offsets-2, dir=/opt/kafka/logs] Loading producer state from offset 0 with message format version 2 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,524] INFO [Log partition=__consumer_offsets-2, dir=/opt/kafka/logs] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 7 ms (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,529] WARN [Log partition=__consumer_offsets-40, dir=/opt/kafka/logs] Found a corrupted index file corresponding to log file /opt/kafka/logs/__consumer_offsets-40/00000000000000000000.log due to Corrupt index found, index file (/opt/kafka/logs/__consumer_offsets-40/00000000000000000000.index) has non-zero size but the last offset is 0 which is no greater than the base offset 0.}, recovering segment and rebuilding index files... (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,530] INFO [Log partition=__consumer_offsets-40, dir=/opt/kafka/logs] Recovering unflushed segment 0 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,531] INFO [Log partition=__consumer_offsets-40, dir=/opt/kafka/logs] Loading producer state from offset 0 with message format version 2 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,531] INFO [Log partition=__consumer_offsets-40, dir=/opt/kafka/logs] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 4 ms (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,536] WARN [Log partition=__consumer_offsets-37, dir=/opt/kafka/logs] Found a corrupted index file corresponding to log file /opt/kafka/logs/__consumer_offsets-37/00000000000000000000.log due to Corrupt index found, index file (/opt/kafka/logs/__consumer_offsets-37/00000000000000000000.index) has non-zero size but the last offset is 0 which is no greater than the base offset 0.}, recovering segment and rebuilding index files... (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,538] INFO [Log partition=__consumer_offsets-37, dir=/opt/kafka/logs] Recovering unflushed segment 0 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,539] INFO [Log partition=__consumer_offsets-37, dir=/opt/kafka/logs] Loading producer state from offset 0 with message format version 2 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,539] INFO [Log partition=__consumer_offsets-37, dir=/opt/kafka/logs] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 5 ms (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,543] WARN [Log partition=__consumer_offsets-18, dir=/opt/kafka/logs] Found a corrupted index file corresponding to log file /opt/kafka/logs/__consumer_offsets-18/00000000000000000000.log due to Corrupt index found, index file (/opt/kafka/logs/__consumer_offsets-18/00000000000000000000.index) has non-zero size but the last offset is 0 which is no greater than the base offset 0.}, recovering segment and rebuilding index files... (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,544] INFO [Log partition=__consumer_offsets-18, dir=/opt/kafka/logs] Recovering unflushed segment 0 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,545] INFO [Log partition=__consumer_offsets-18, dir=/opt/kafka/logs] Loading producer state from offset 0 with message format version 2 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,546] INFO [Log partition=__consumer_offsets-18, dir=/opt/kafka/logs] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 5 ms (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,550] WARN [Log partition=__consumer_offsets-34, dir=/opt/kafka/logs] Found a corrupted index file corresponding to log file /opt/kafka/logs/__consumer_offsets-34/00000000000000000000.log due to Corrupt index found, index file (/opt/kafka/logs/__consumer_offsets-34/00000000000000000000.index) has non-zero size but the last offset is 0 which is no greater than the base offset 0.}, recovering segment and rebuilding index files... (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,551] INFO [Log partition=__consumer_offsets-34, dir=/opt/kafka/logs] Recovering unflushed segment 0 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,552] INFO [Log partition=__consumer_offsets-34, dir=/opt/kafka/logs] Loading producer state from offset 0 with message format version 2 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,553] INFO [Log partition=__consumer_offsets-34, dir=/opt/kafka/logs] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 5 ms (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,557] WARN [Log partition=__consumer_offsets-15, dir=/opt/kafka/logs] Found a corrupted index file corresponding to log file /opt/kafka/logs/__consumer_offsets-15/00000000000000000000.log due to Corrupt index found, index file (/opt/kafka/logs/__consumer_offsets-15/00000000000000000000.index) has non-zero size but the last offset is 0 which is no greater than the base offset 0.}, recovering segment and rebuilding index files... (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,558] INFO [Log partition=__consumer_offsets-15, dir=/opt/kafka/logs] Recovering unflushed segment 0 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,559] INFO [Log partition=__consumer_offsets-15, dir=/opt/kafka/logs] Loading producer state from offset 0 with message format version 2 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,560] INFO [Log partition=__consumer_offsets-15, dir=/opt/kafka/logs] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 5 ms (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,564] WARN [Log partition=__consumer_offsets-12, dir=/opt/kafka/logs] Found a corrupted index file corresponding to log file /opt/kafka/logs/__consumer_offsets-12/00000000000000000000.log due to Corrupt index found, index file (/opt/kafka/logs/__consumer_offsets-12/00000000000000000000.index) has non-zero size but the last offset is 0 which is no greater than the base offset 0.}, recovering segment and rebuilding index files... (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,565] INFO [Log partition=__consumer_offsets-12, dir=/opt/kafka/logs] Recovering unflushed segment 0 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,566] INFO [Log partition=__consumer_offsets-12, dir=/opt/kafka/logs] Loading producer state from offset 0 with message format version 2 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,566] INFO [Log partition=__consumer_offsets-12, dir=/opt/kafka/logs] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 4 ms (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,570] WARN [Log partition=__consumer_offsets-31, dir=/opt/kafka/logs] Found a corrupted index file corresponding to log file /opt/kafka/logs/__consumer_offsets-31/00000000000000000000.log due to Corrupt index found, index file (/opt/kafka/logs/__consumer_offsets-31/00000000000000000000.index) has non-zero size but the last offset is 0 which is no greater than the base offset 0.}, recovering segment and rebuilding index files... (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,572] INFO [Log partition=__consumer_offsets-31, dir=/opt/kafka/logs] Recovering unflushed segment 0 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,572] INFO [Log partition=__consumer_offsets-31, dir=/opt/kafka/logs] Loading producer state from offset 0 with message format version 2 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,573] INFO [Log partition=__consumer_offsets-31, dir=/opt/kafka/logs] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 5 ms (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,577] WARN [Log partition=__consumer_offsets-9, dir=/opt/kafka/logs] Found a corrupted index file corresponding to log file /opt/kafka/logs/__consumer_offsets-9/00000000000000000000.log due to Corrupt index found, index file (/opt/kafka/logs/__consumer_offsets-9/00000000000000000000.index) has non-zero size but the last offset is 0 which is no greater than the base offset 0.}, recovering segment and rebuilding index files... (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,578] INFO [Log partition=__consumer_offsets-9, dir=/opt/kafka/logs] Recovering unflushed segment 0 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,579] INFO [Log partition=__consumer_offsets-9, dir=/opt/kafka/logs] Loading producer state from offset 0 with message format version 2 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,579] INFO [Log partition=__consumer_offsets-9, dir=/opt/kafka/logs] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 4 ms (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,584] WARN [Log partition=__consumer_offsets-47, dir=/opt/kafka/logs] Found a corrupted index file corresponding to log file /opt/kafka/logs/__consumer_offsets-47/00000000000000000000.log due to Corrupt index found, index file (/opt/kafka/logs/__consumer_offsets-47/00000000000000000000.index) has non-zero size but the last offset is 0 which is no greater than the base offset 0.}, recovering segment and rebuilding index files... (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,585] INFO [Log partition=__consumer_offsets-47, dir=/opt/kafka/logs] Recovering unflushed segment 0 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,586] INFO [Log partition=__consumer_offsets-47, dir=/opt/kafka/logs] Loading producer state from offset 0 with message format version 2 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,587] INFO [Log partition=__consumer_offsets-47, dir=/opt/kafka/logs] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 4 ms (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,591] WARN [Log partition=__consumer_offsets-19, dir=/opt/kafka/logs] Found a corrupted index file corresponding to log file /opt/kafka/logs/__consumer_offsets-19/00000000000000000000.log due to Corrupt index found, index file (/opt/kafka/logs/__consumer_offsets-19/00000000000000000000.index) has non-zero size but the last offset is 0 which is no greater than the base offset 0.}, recovering segment and rebuilding index files... (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,592] INFO [Log partition=__consumer_offsets-19, dir=/opt/kafka/logs] Recovering unflushed segment 0 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,593] INFO [Log partition=__consumer_offsets-19, dir=/opt/kafka/logs] Loading producer state from offset 0 with message format version 2 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,593] INFO [Log partition=__consumer_offsets-19, dir=/opt/kafka/logs] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 4 ms (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,597] WARN [Log partition=__consumer_offsets-28, dir=/opt/kafka/logs] Found a corrupted index file corresponding to log file /opt/kafka/logs/__consumer_offsets-28/00000000000000000000.log due to Corrupt index found, index file (/opt/kafka/logs/__consumer_offsets-28/00000000000000000000.index) has non-zero size but the last offset is 0 which is no greater than the base offset 0.}, recovering segment and rebuilding index files... (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,598] INFO [Log partition=__consumer_offsets-28, dir=/opt/kafka/logs] Recovering unflushed segment 0 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,599] INFO [Log partition=__consumer_offsets-28, dir=/opt/kafka/logs] Loading producer state from offset 0 with message format version 2 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,600] INFO [Log partition=__consumer_offsets-28, dir=/opt/kafka/logs] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 5 ms (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,604] WARN [Log partition=__consumer_offsets-38, dir=/opt/kafka/logs] Found a corrupted index file corresponding to log file /opt/kafka/logs/__consumer_offsets-38/00000000000000000000.log due to Corrupt index found, index file (/opt/kafka/logs/__consumer_offsets-38/00000000000000000000.index) has non-zero size but the last offset is 0 which is no greater than the base offset 0.}, recovering segment and rebuilding index files... (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,605] INFO [Log partition=__consumer_offsets-38, dir=/opt/kafka/logs] Recovering unflushed segment 0 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,606] INFO [Log partition=__consumer_offsets-38, dir=/opt/kafka/logs] Loading producer state from offset 0 with message format version 2 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,606] INFO [Log partition=__consumer_offsets-38, dir=/opt/kafka/logs] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 4 ms (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,610] WARN [Log partition=__consumer_offsets-35, dir=/opt/kafka/logs] Found a corrupted index file corresponding to log file /opt/kafka/logs/__consumer_offsets-35/00000000000000000000.log due to Corrupt index found, index file (/opt/kafka/logs/__consumer_offsets-35/00000000000000000000.index) has non-zero size but the last offset is 0 which is no greater than the base offset 0.}, recovering segment and rebuilding index files... (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,612] INFO [Log partition=__consumer_offsets-35, dir=/opt/kafka/logs] Recovering unflushed segment 0 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,612] INFO [Log partition=__consumer_offsets-35, dir=/opt/kafka/logs] Loading producer state from offset 0 with message format version 2 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,613] INFO [Log partition=__consumer_offsets-35, dir=/opt/kafka/logs] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 5 ms (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,617] WARN [Log partition=__consumer_offsets-44, dir=/opt/kafka/logs] Found a corrupted index file corresponding to log file /opt/kafka/logs/__consumer_offsets-44/00000000000000000000.log due to Corrupt index found, index file (/opt/kafka/logs/__consumer_offsets-44/00000000000000000000.index) has non-zero size but the last offset is 0 which is no greater than the base offset 0.}, recovering segment and rebuilding index files... (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,618] INFO [Log partition=__consumer_offsets-44, dir=/opt/kafka/logs] Recovering unflushed segment 0 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,619] INFO [Log partition=__consumer_offsets-44, dir=/opt/kafka/logs] Loading producer state from offset 0 with message format version 2 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,619] INFO [Log partition=__consumer_offsets-44, dir=/opt/kafka/logs] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 4 ms (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,623] WARN [Log partition=__consumer_offsets-6, dir=/opt/kafka/logs] Found a corrupted index file corresponding to log file /opt/kafka/logs/__consumer_offsets-6/00000000000000000000.log due to Corrupt index found, index file (/opt/kafka/logs/__consumer_offsets-6/00000000000000000000.index) has non-zero size but the last offset is 0 which is no greater than the base offset 0.}, recovering segment and rebuilding index files... (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,624] INFO [Log partition=__consumer_offsets-6, dir=/opt/kafka/logs] Recovering unflushed segment 0 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,625] INFO [Log partition=__consumer_offsets-6, dir=/opt/kafka/logs] Loading producer state from offset 0 with message format version 2 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,626] INFO [Log partition=__consumer_offsets-6, dir=/opt/kafka/logs] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 5 ms (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,629] WARN [Log partition=__consumer_offsets-25, dir=/opt/kafka/logs] Found a corrupted index file corresponding to log file /opt/kafka/logs/__consumer_offsets-25/00000000000000000000.log due to Corrupt index found, index file (/opt/kafka/logs/__consumer_offsets-25/00000000000000000000.index) has non-zero size but the last offset is 0 which is no greater than the base offset 0.}, recovering segment and rebuilding index files... (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,630] INFO [Log partition=__consumer_offsets-25, dir=/opt/kafka/logs] Recovering unflushed segment 0 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,631] INFO [Log partition=__consumer_offsets-25, dir=/opt/kafka/logs] Loading producer state from offset 0 with message format version 2 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,631] INFO [Log partition=__consumer_offsets-25, dir=/opt/kafka/logs] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 4 ms (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,635] WARN [Log partition=__consumer_offsets-16, dir=/opt/kafka/logs] Found a corrupted index file corresponding to log file /opt/kafka/logs/__consumer_offsets-16/00000000000000000000.log due to Corrupt index found, index file (/opt/kafka/logs/__consumer_offsets-16/00000000000000000000.index) has non-zero size but the last offset is 0 which is no greater than the base offset 0.}, recovering segment and rebuilding index files... (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,636] INFO [Log partition=__consumer_offsets-16, dir=/opt/kafka/logs] Recovering unflushed segment 0 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,637] INFO [Log partition=__consumer_offsets-16, dir=/opt/kafka/logs] Loading producer state from offset 0 with message format version 2 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,637] INFO [Log partition=__consumer_offsets-16, dir=/opt/kafka/logs] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 4 ms (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,641] WARN [Log partition=__consumer_offsets-22, dir=/opt/kafka/logs] Found a corrupted index file corresponding to log file /opt/kafka/logs/__consumer_offsets-22/00000000000000000000.log due to Corrupt index found, index file (/opt/kafka/logs/__consumer_offsets-22/00000000000000000000.index) has non-zero size but the last offset is 0 which is no greater than the base offset 0.}, recovering segment and rebuilding index files... (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,642] INFO [Log partition=__consumer_offsets-22, dir=/opt/kafka/logs] Recovering unflushed segment 0 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,643] INFO [Log partition=__consumer_offsets-22, dir=/opt/kafka/logs] Loading producer state from offset 0 with message format version 2 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,643] INFO [Log partition=__consumer_offsets-22, dir=/opt/kafka/logs] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 4 ms (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,647] WARN [Log partition=__consumer_offsets-41, dir=/opt/kafka/logs] Found a corrupted index file corresponding to log file /opt/kafka/logs/__consumer_offsets-41/00000000000000000000.log due to Corrupt index found, index file (/opt/kafka/logs/__consumer_offsets-41/00000000000000000000.index) has non-zero size but the last offset is 0 which is no greater than the base offset 0.}, recovering segment and rebuilding index files... (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,648] INFO [Log partition=__consumer_offsets-41, dir=/opt/kafka/logs] Recovering unflushed segment 0 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,649] INFO [Log partition=__consumer_offsets-41, dir=/opt/kafka/logs] Loading producer state from offset 0 with message format version 2 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,649] INFO [Log partition=__consumer_offsets-41, dir=/opt/kafka/logs] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 4 ms (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,653] WARN [Log partition=__consumer_offsets-32, dir=/opt/kafka/logs] Found a corrupted index file corresponding to log file /opt/kafka/logs/__consumer_offsets-32/00000000000000000000.log due to Corrupt index found, index file (/opt/kafka/logs/__consumer_offsets-32/00000000000000000000.index) has non-zero size but the last offset is 0 which is no greater than the base offset 0.}, recovering segment and rebuilding index files... (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,654] INFO [Log partition=__consumer_offsets-32, dir=/opt/kafka/logs] Recovering unflushed segment 0 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,656] INFO [Log partition=__consumer_offsets-32, dir=/opt/kafka/logs] Loading producer state from offset 0 with message format version 2 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,657] INFO [Log partition=__consumer_offsets-32, dir=/opt/kafka/logs] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 6 ms (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,660] WARN [Log partition=__consumer_offsets-3, dir=/opt/kafka/logs] Found a corrupted index file corresponding to log file /opt/kafka/logs/__consumer_offsets-3/00000000000000000000.log due to Corrupt index found, index file (/opt/kafka/logs/__consumer_offsets-3/00000000000000000000.index) has non-zero size but the last offset is 0 which is no greater than the base offset 0.}, recovering segment and rebuilding index files... (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,661] INFO [Log partition=__consumer_offsets-3, dir=/opt/kafka/logs] Recovering unflushed segment 0 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,662] INFO [Log partition=__consumer_offsets-3, dir=/opt/kafka/logs] Loading producer state from offset 0 with message format version 2 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,662] INFO [Log partition=__consumer_offsets-3, dir=/opt/kafka/logs] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 4 ms (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,666] WARN [Log partition=__consumer_offsets-13, dir=/opt/kafka/logs] Found a corrupted index file corresponding to log file /opt/kafka/logs/__consumer_offsets-13/00000000000000000000.log due to Corrupt index found, index file (/opt/kafka/logs/__consumer_offsets-13/00000000000000000000.index) has non-zero size but the last offset is 0 which is no greater than the base offset 0.}, recovering segment and rebuilding index files... (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,667] INFO [Log partition=__consumer_offsets-13, dir=/opt/kafka/logs] Recovering unflushed segment 0 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,668] INFO [Log partition=__consumer_offsets-13, dir=/opt/kafka/logs] Loading producer state from offset 0 with message format version 2 (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,668] INFO [Log partition=__consumer_offsets-13, dir=/opt/kafka/logs] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 4 ms (kafka.log.Log)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,673] INFO Logs loading complete in 1118 ms. (kafka.log.LogManager)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,692] INFO Starting log cleanup with a period of 300000 ms. (kafka.log.LogManager)
2019/12/18 上午9:43:17[2019-12-18 01:43:17,693] INFO Starting log flusher with a default period of 9223372036854775807 ms. (kafka.log.LogManager)
2019/12/18 上午9:43:19[2019-12-18 01:43:19,593] INFO Awaiting socket connections on 0.0.0.0:9092. (kafka.network.Acceptor)
2019/12/18 上午9:43:19[2019-12-18 01:43:19,816] INFO [SocketServer brokerId=1] Started 1 acceptor threads (kafka.network.SocketServer)
2019/12/18 上午9:43:20[2019-12-18 01:43:20,241] INFO [ExpirationReaper-1-Produce]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
2019/12/18 上午9:43:20[2019-12-18 01:43:20,243] INFO [ExpirationReaper-1-Fetch]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
2019/12/18 上午9:43:20[2019-12-18 01:43:20,247] INFO [ExpirationReaper-1-DeleteRecords]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
2019/12/18 上午9:43:20[2019-12-18 01:43:20,971] INFO [LogDirFailureHandler]: Starting (kafka.server.ReplicaManager$LogDirFailureHandler)
2019/12/18 上午9:43:22[2019-12-18 01:43:22,180] INFO Creating /brokers/ids/1 (is it secure? false) (kafka.zk.KafkaZkClient)
2019/12/18 上午9:43:22[2019-12-18 01:43:22,193] INFO Result of znode creation at /brokers/ids/1 is: OK (kafka.zk.KafkaZkClient)
2019/12/18 上午9:43:22[2019-12-18 01:43:22,199] INFO Registered broker 1 at path /brokers/ids/1 with addresses: ArrayBuffer(EndPoint(10.42.43.230,9092,ListenerName(PLAINTEXT),PLAINTEXT)) (kafka.zk.KafkaZkClient)
2019/12/18 上午9:43:22[2019-12-18 01:43:22,674] INFO [ExpirationReaper-1-topic]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
2019/12/18 上午9:43:22[2019-12-18 01:43:22,684] INFO [ExpirationReaper-1-Heartbeat]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
2019/12/18 上午9:43:22[2019-12-18 01:43:22,689] INFO [ExpirationReaper-1-Rebalance]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
2019/12/18 上午9:43:22[2019-12-18 01:43:22,889] INFO [GroupCoordinator 1]: Starting up. (kafka.coordinator.group.GroupCoordinator)
2019/12/18 上午9:43:22[2019-12-18 01:43:22,910] INFO [GroupCoordinator 1]: Startup complete. (kafka.coordinator.group.GroupCoordinator)
2019/12/18 上午9:43:22[2019-12-18 01:43:22,946] INFO [GroupMetadataManager brokerId=1] Removed 0 expired offsets in 36 milliseconds. (kafka.coordinator.group.GroupMetadataManager)
2019/12/18 上午9:43:22[2019-12-18 01:43:22,980] INFO [ProducerId Manager 1]: Acquired new producerId block (brokerId:1,blockStartProducerId:24650000,blockEndProducerId:24650999) by writing to Zk with path version 24651 (kafka.coordinator.transaction.ProducerIdManager)
2019/12/18 上午9:43:23[2019-12-18 01:43:23,150] INFO [TransactionCoordinator id=1] Starting up. (kafka.coordinator.transaction.TransactionCoordinator)
2019/12/18 上午9:43:23[2019-12-18 01:43:23,185] INFO [TransactionCoordinator id=1] Startup complete. (kafka.coordinator.transaction.TransactionCoordinator)
2019/12/18 上午9:43:23[2019-12-18 01:43:23,245] INFO [Transaction Marker Channel Manager 1]: Starting (kafka.coordinator.transaction.TransactionMarkerChannelManager)
2019/12/18 上午9:43:23[2019-12-18 01:43:23,786] INFO [/config/changes-event-process-thread]: Starting (kafka.common.ZkNodeChangeNotificationListener$ChangeEventProcessThread)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,101] INFO Replica loaded for partition __consumer_offsets-0 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,105] INFO Replica loaded for partition __consumer_offsets-0 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,115] INFO Kafka version : 1.1.0 (org.apache.kafka.common.utils.AppInfoParser)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,116] INFO Kafka commitId : fdcf75ea326b8e07 (org.apache.kafka.common.utils.AppInfoParser)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,122] INFO [KafkaServer id=1] started (kafka.server.KafkaServer)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,144] INFO Replica loaded for partition __consumer_offsets-0 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,190] INFO Replica loaded for partition __consumer_offsets-29 with initial high watermark 9853 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,200] INFO Replica loaded for partition __consumer_offsets-29 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,201] INFO Replica loaded for partition __consumer_offsets-29 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,202] INFO Replica loaded for partition __consumer_offsets-48 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,202] INFO Replica loaded for partition __consumer_offsets-48 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,221] INFO Replica loaded for partition __consumer_offsets-48 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,221] INFO Replica loaded for partition __consumer_offsets-10 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,222] INFO Replica loaded for partition __consumer_offsets-10 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,228] INFO Replica loaded for partition __consumer_offsets-10 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,230] INFO Replica loaded for partition __consumer_offsets-45 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,242] INFO Replica loaded for partition __consumer_offsets-45 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,243] INFO Replica loaded for partition __consumer_offsets-45 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,252] INFO Replica loaded for partition __consumer_offsets-26 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,252] INFO Replica loaded for partition __consumer_offsets-26 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,253] INFO Replica loaded for partition __consumer_offsets-26 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,253] INFO Replica loaded for partition __consumer_offsets-7 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,258] INFO Replica loaded for partition __consumer_offsets-7 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,284] INFO Replica loaded for partition __consumer_offsets-7 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,285] INFO Replica loaded for partition __consumer_offsets-42 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,285] INFO Replica loaded for partition __consumer_offsets-42 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,303] INFO Replica loaded for partition __consumer_offsets-42 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,304] INFO Replica loaded for partition __consumer_offsets-4 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,304] INFO Replica loaded for partition __consumer_offsets-4 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,311] INFO Replica loaded for partition __consumer_offsets-4 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,334] INFO Replica loaded for partition __consumer_offsets-23 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,334] INFO Replica loaded for partition __consumer_offsets-23 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,334] INFO Replica loaded for partition __consumer_offsets-23 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,335] INFO Replica loaded for partition __consumer_offsets-1 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,353] INFO Replica loaded for partition __consumer_offsets-1 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,354] INFO Replica loaded for partition __consumer_offsets-1 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,360] INFO Replica loaded for partition __consumer_offsets-20 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,369] INFO Replica loaded for partition __consumer_offsets-20 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,369] INFO Replica loaded for partition __consumer_offsets-20 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,370] INFO Replica loaded for partition __consumer_offsets-39 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,385] INFO Replica loaded for partition __consumer_offsets-39 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,385] INFO Replica loaded for partition __consumer_offsets-39 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,391] INFO Replica loaded for partition __consumer_offsets-17 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,391] INFO Replica loaded for partition __consumer_offsets-17 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,391] INFO Replica loaded for partition __consumer_offsets-17 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,392] INFO Replica loaded for partition __consumer_offsets-36 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,392] INFO Replica loaded for partition __consumer_offsets-36 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,397] INFO Replica loaded for partition __consumer_offsets-36 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,404] INFO Replica loaded for partition __consumer_offsets-14 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,406] INFO Replica loaded for partition __consumer_offsets-14 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,406] INFO Replica loaded for partition __consumer_offsets-14 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,407] INFO Replica loaded for partition __consumer_offsets-33 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,412] INFO Replica loaded for partition __consumer_offsets-33 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,412] INFO Replica loaded for partition __consumer_offsets-33 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,412] INFO Replica loaded for partition __consumer_offsets-49 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,417] INFO Replica loaded for partition __consumer_offsets-49 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,417] INFO Replica loaded for partition __consumer_offsets-49 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,423] INFO Replica loaded for partition __consumer_offsets-11 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,423] INFO Replica loaded for partition __consumer_offsets-11 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,424] INFO Replica loaded for partition __consumer_offsets-11 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,424] INFO Replica loaded for partition __consumer_offsets-30 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,424] INFO Replica loaded for partition __consumer_offsets-30 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,431] INFO Replica loaded for partition __consumer_offsets-30 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,433] INFO Replica loaded for partition __consumer_offsets-46 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,433] INFO Replica loaded for partition __consumer_offsets-46 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,473] INFO Replica loaded for partition __consumer_offsets-46 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,474] INFO Replica loaded for partition __consumer_offsets-27 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,478] INFO Replica loaded for partition __consumer_offsets-27 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,488] INFO Replica loaded for partition __consumer_offsets-27 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,496] INFO Replica loaded for partition __consumer_offsets-8 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,496] INFO Replica loaded for partition __consumer_offsets-8 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,496] INFO Replica loaded for partition __consumer_offsets-8 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,496] INFO Replica loaded for partition __consumer_offsets-24 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,496] INFO Replica loaded for partition __consumer_offsets-24 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,503] INFO Replica loaded for partition __consumer_offsets-24 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,504] INFO Replica loaded for partition __consumer_offsets-43 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,522] INFO Replica loaded for partition __consumer_offsets-43 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,522] INFO Replica loaded for partition __consumer_offsets-43 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,529] INFO Replica loaded for partition __consumer_offsets-5 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,529] INFO Replica loaded for partition __consumer_offsets-5 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,530] INFO Replica loaded for partition __consumer_offsets-5 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,530] INFO Replica loaded for partition __consumer_offsets-21 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,538] INFO Replica loaded for partition __consumer_offsets-21 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,539] INFO Replica loaded for partition __consumer_offsets-21 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,553] INFO Replica loaded for partition __consumer_offsets-2 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,553] INFO Replica loaded for partition __consumer_offsets-2 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,553] INFO Replica loaded for partition __consumer_offsets-2 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,554] INFO Replica loaded for partition __consumer_offsets-40 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,554] INFO Replica loaded for partition __consumer_offsets-40 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,559] INFO Replica loaded for partition __consumer_offsets-40 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,560] INFO Replica loaded for partition __consumer_offsets-37 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,571] INFO Replica loaded for partition __consumer_offsets-37 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,572] INFO Replica loaded for partition __consumer_offsets-37 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,572] INFO Replica loaded for partition __consumer_offsets-18 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,572] INFO Replica loaded for partition __consumer_offsets-18 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,590] INFO Replica loaded for partition __consumer_offsets-18 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,592] INFO Replica loaded for partition __consumer_offsets-34 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,592] INFO Replica loaded for partition __consumer_offsets-34 with initial high watermark 0 (kafka.cluster.Replica)
2019/12/18 上午9:43:24[2019-12-18 01:43:24,608] INFO Replica loaded for partition __consumer_offsets-34 with initial high watermark 0 (kafka.cluster.Replica)

Monit always checks port 9092 regardless of the KAFKA_ADVERTISE_PORT setting. This results in the following logs:

'kafka-service' failed protocol test [DEFAULT] at [localhost]:9092 [TCP/IP] -- Connection refused
'kafka-service' failed protocol test [DEFAULT] at [localhost]:9092 [TCP/IP] -- Connection refused
'kafka-service' failed protocol test [DEFAULT] at [localhost]:9092 [TCP/IP] -- Connection refused
'kafka-service' failed protocol test [DEFAULT] at [localhost]:9092 [TCP/IP] -- Connection refused
'kafka-service' failed protocol test [DEFAULT] at [localhost]:9092 [TCP/IP] -- Connection refused
'kafka-service' exec: '/opt/monit/bin/monit quit'
Monit daemon with pid [15] killed
Monit daemon with pid [15] stopped
'kafka-broker-1' Monit 5.24.0 stopped

and blocks container initialization.

I am using KAFKA_ADVERTISE_PORT=9192 and port mapping 9192 to 9192.

I am trying to run your zookeeper and kafka catalog items. Think that the zookeeper is running properly, but kafka not so much.
I am getting this error on loop.
11/17/2017 5:21:45 PM[2017-11-18 01:21:45,718] WARN [Controller id=2, targetBrokerId=3] Connection to node 3 could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient)
11/17/2017 5:21:45 PM[2017-11-18 01:21:45,742] WARN [Controller id=2, targetBrokerId=2] Connection to node 2 could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient)
11/17/2017 5:21:45 PM[2017-11-18 01:21:45,800] WARN [Controller id=2, targetBrokerId=1] Connection to node 1 could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient)

on rancher server 1.6
zookeeper Template Version 3.4.10-rancher1
kafka Template Version 1.0.0-rancher1

With the latest release there seems to be no reliable way to change offsets.topic.replication.factor in server.properties of the broker. Also setting the environment variable KAFKA_OFFSETS_TOPIC_REPLICATION_FACTOR as part of the container config has no effect. We would like to set the replication factor (default: 3) to 1 in our development environments to avoid having to deploy 3 brokers for each environment.

Strangely neither changing /opt/kafka/bin/server.properties.sh nor adding the setting directly to /opt/kafka/config/server.properties seems to have any effect, since after restating the broker this setting gets dropped somehow from the properties-file again.

The only workaround I found so far is modifying the invocation of kafka-server-sart.sh in /opt/kafka/bin/kafka-service.sh by adding --override offsets.topic.replication.factor=1 to it. This feels like a temporary solution only, though.

Please check if support for this environment variable can be added to the broker-container.

We are currently using Kafka 1.1.0-1.

Please upgrade version kafka and zookeper

Is there a plan/eta to update the image to use Kafka 1.1.0?

Are there any known issues with v1.1.0 and updating the following files to reflect using kafka 1.1.0 :

• version
• Dockerfile

Keeps looping

8/5/2017 3:44:37 PM'kafka-service' process is not running
8/5/2017 3:44:37 PM'kafka-service' trying to restart
8/5/2017 3:44:37 PM'kafka-service' start: '/opt/kafka/bin/kafka-service.sh start'
8/5/2017 3:45:07 PM'kafka-service' failed to start (exit status 0) -- '/opt/kafka/bin/kafka-service.sh start': Sat Aug 5 19:44:37 UTC 2017 - [ Starting kafka... ]
8/5/2017 3:45:07 PMSat Aug 5 19:44:37 UTC 2017 - [ Checking kafka configuration... ]
8/5/2017 3:45:07 PMSat Aug 5 19:44:37 UTC 2017 - [ Applying dinamic kafka configuration... ]
8/5/2017 3:45:07 PMSat Aug 5 19:44:37 UTC
8/5/2017 3:46:07 PM'kafka-service' process is not running
8/5/2017 3:46:07 PM'kafka-service' trying to restart
8/5/2017 3:46:07 PM'kafka-service' start: '/opt/kafka/bin/kafka-service.sh start'
8/5/2017 3:46:37 PM'kafka-service' failed to start (exit status 0) -- '/opt/kafka/bin/kafka-service.sh start': Sat Aug 5 19:46:07 UTC 2017 - [ Starting kafka... ]
8/5/2017 3:46:37 PMSat Aug 5 19:46:07 UTC 2017 - [ Checking kafka configuration... ]
8/5/2017 3:46:37 PMSat Aug 5 19:46:07 UTC 2017 - [ Applying dinamic kafka configuration... ]
8/5/2017 3:46:37 PMSat Aug 5 19:46:07 UTC
8/5/2017 3:47:37 PM'kafka-service' process is not running
8/5/2017 3:47:37 PM'kafka-service' trying to restart
8/5/2017 3:47:37 PM'kafka-service' start: '/opt/kafka/bin/kafka-service.sh start'
8/5/2017 3:48:08 PM'kafka-service' failed to start (exit status 0) -- '/opt/kafka/bin/kafka-service.sh start': Sat Aug 5 19:47:37 UTC 2017 - [ Starting kafka... ]
8/5/2017 3:48:08 PMSat Aug 5 19:47:37 UTC 2017 - [ Checking kafka configuration... ]
8/5/2017 3:48:08 PMSat Aug 5 19:47:37 UTC 2017 - [ Applying dinamic kafka configuration... ]
8/5/2017 3:48:08 PMSat Aug 5 19:47:37 UTC
8/5/2017 3:49:08 PM'kafka-service' process is not running
8/5/2017 3:49:08 PM'kafka-service' trying to restart
8/5/2017 3:49:08 PM'kafka-service' start: '/opt/kafka/bin/kafka-service.sh start'
8/5/2017 3:49:38 PM'kafka-service' failed to start (exit status 0) -- '/opt/kafka/bin/kafka-service.sh start': Sat Aug 5 19:49:08 UTC 2017 - [ Starting kafka... ]
8/5/2017 3:49:38 PMSat Aug 5 19:49:08 UTC 2017 - [ Checking kafka configuration... ]
8/5/2017 3:49:38 PMSat Aug 5 19:49:08 UTC 2017 - [ Applying dinamic kafka configuration... ]
8/5/2017 3:49:38 PMSat Aug 5 19:49:08 UTC

What is 'ADD root /' means in the Dockerfile ？ If this was added，image was not built with command “docker build -t alpine-kafka:1.0 .”.
I am newer to docker,what should run this image ?

You cannot specify a port. It will always default to 9092.

Please change url to https://archive.apache.org/dist/kafka/
As I am playing with pyspak there is only compatibilty with versions < 0.10
Almost noone hosts these versions but archive.apache.org