Comments (12)
Guys any pointers ?
from kafka-monitor.
We don't have a build test system for Windows nor do we run this on Windows at LinkedIn (yes, I know we were acquired by MS) so there is probably something very simple that is wrong. I can look at this later today.
from kafka-monitor.
The classnames are changed from previous versions, but were never changed in the bat files. If you remove the ".core" from the class names in the bat file it should work. You may have troubles with the CLASSPATH I had to set it manually to get it work.
from kafka-monitor.
@smccauliff I think we have actually change the script to load the correct class after we change the classnames in the commit d69ff73.
@abhit011 Can you tell us the git hash of the kafka-monitor you are running? Which command did you use that causes the class not found error?
from kafka-monitor.
@lindong28
I have given git checkout from the main branch itself ... Though the hash is 5807f46
and I used .\bin\windows\kafka-monitor-start.bat .\config\kafka-monitor.properties this command to run the Kafka_monitor
from kafka-monitor.
@smccauliff
You guys should start supporting windows :P Though I am also an ex MS employee ;)
Anyways I ram the command with removing .core from the bat files, but again it gave error like Error: Could not find or load main class com.linkedin.kmf.KafkaMonitor
from kafka-monitor.
@abhit011 I see. An open source user contributed the script to run kafka-monitor in Windows. But I forgot to update this script when we changed the path of KafkaMonitor class. I just submitted the patch at https://github.com/linkedin/kafka-monitor/pull/67/files to fix this. @smccauliff will validate this on his Windows machine. Please feel free to download that patch and see if it fixes the problem.
from kafka-monitor.
Yes i could able to run it on windows ... Thanks ...
Another thing, if I have to monitor just my Kafka topics traffic and my kafka producer / consumer ... How I am going to handle that ? I have just changed the broker and zoo keeper : addresses/port .
from kafka-monitor.
@abhit011 Kafka Monitor can not monitor your producer/consumer/topics directly. It is used to approximate the experience of your producer/consumer/topics by monitoring your cluster, i.e. it is possible that Kafka Monitor reports drop in availability while your producer/consumer doesn't, and vise versa. You need to assign new/dedicated monitor topic to Kafka Monitor since it will produce fabricated traffic to the monitor topic. The only config you need to change is the broker and zookeeper urls. There are other configs that you can fine-tune for more advanced use-case.
from kafka-monitor.
Thanx @lindong28 , i need to see what best i can do to monitor the live traffic of my kafka cluster..
from kafka-monitor.
@abhit011 FYI, we use an auditing system at LinkedIn to check message loss. It is briefly described in https://engineering.linkedin.com/blog/2016/04/kafka-ecosystem-at-linkedin. The idea is for each producer to report the messages it has sent and we compare it with the actually number of messages that can be consumed. Also, since Kafka Producer and Kafka Consumer already reports many useful metrics (e.g. throughput) via JMX metrics, you have have them exported to an external system (e.g. graphite) so that you can monitor their performance.
from kafka-monitor.
Seems like this is fixed on master.
from kafka-monitor.
Related Issues (20)
- Jetty Service exception HOT 3
- GUI Monitor HOT 8
- Roadmap and project faith HOT 3
- When apps stop fully running there's no mechanism to either restart them or abort the monitor HOT 1
- StatsD reporting of availability metrics is broken
- ClassNotFoundException: com.linkedin.kmf.services.ProduceService HOT 1
- ERROR lassNotFoundException: com.linkedin.kmf.apps.SingleClusterMonitor HOT 2
- Support MM2 HOT 1
- Producer Restarting{Feature Optimisation] HOT 2
- bump avro-util to 0.2.118 do to the critical CVE-2022-42889 HOT 2
- Xinfra monitor fails with ClassCastException HOT 3
- Remove zookeeper dependency HOT 4
- Ensure proper retry and backoff for newly created monitor topics HOT 1
- Hard to detect one Bad Broker.
- Unable to list topics HOT 1
- Add validator for all required configs HOT 1
- [QUESTION] Are there plans to publish the kafka-monitor on the docker hub? HOT 1
- OffsetCommitService does not work with SSL cluster HOT 1
- CVE-2023-44981 HOT 1
- Need help to enable compression for data produced by kafka-monitor HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from kafka-monitor.