zebrium / ze-fluentd-plugin Goto Github PK
View Code? Open in Web Editor NEWZebrium's fluentd output plugin sends the logs you collect with fluentd to Zebrium for automated anomaly detection.
Zebrium's fluentd output plugin sends the logs you collect with fluentd to Zebrium for automated anomaly detection.
In some use cases, we do not want to install the additional container monitor services, as most use cases do not need a container scraper added as well. This will remove a lot of overhead concern and security concerns with this installer
update_fluentd_cfg.rb needs to be updated with the new paths for configuration files. The old paths
file_map_cfg_file = "/etc/td-agent/log-file-map.conf" old_file_map_cfg_file = "/etc/zebrium/log-file-map.cfg" user_fluentd_cfg_file = "/etc/td-agent/conf.d/user.conf"
need to be updated to reflect the updated paths /etc/fluent/ and /etc/fluent/conf.d. Any changes to the rest of the script or other components of the collector need to also be investigated and updated.
We need to inspect and verify the paths used for the container monitoring service because the paths might be outdated after updating to fluent-package.
After or during completion of #11 , documentation needs to be updated to remove the old td-agent paths and reflect the new paths /etc/fluent/ and /etc/fluent/conf.d
FluentD has release V5 of their packaging (https://docs.fluentd.org/quickstart/fluent-package-v5-vs-td-agent) and our script no longer installs correctly using td-agent-4.
https://www.fluentd.org/blog/fluent-package-scheduled-lifecycle
The Linux installation method is dangerous but I'm not talking about the use of curl | bash
. When using this installation method, the best practice it to wrap the installation in a single character function to safely handle network interruptions.
In install_collector.sh you have
function cleanup() {
rm -f $NPIPE
rm -rf $TEMP_DIR
}
trap cleanup EXIT
Consider what would happen if the script download was interrupted after line 158 character 10 was downloaded. You'd have
TEMP_DIR=/
Thus curl | bash
would execute rm -rf /
Getting complaints about GLIBC and related libraries when running test actions on OL7 and AL2:
/__e/node20/bin/node: /lib64/libm.so.6: version `GLIBC_2.27' not found (required by /__e/node20/bin/node)
/__e/node20/bin/node: /lib6[4](https://github.com/zebrium/ze-fluentd-plugin/actions/runs/7358148932/job/20030947317#step:17:4)/libstdc++.so.6: version `GLIBCXX_3.4.20' not found (required by /__e/node20/bin/node)
/__e/node20/bin/node: /lib64/libstdc++.so.6: version `CXXABI_1.3.9' not found (required by /__e/node20/bin/node)
/__e/node20/bin/node: /lib64/libstdc++.so.6: version `GLIBCXX_3.4.21' not found (required by /__e/node20/bin/node)
/__e/node20/bin/node: /lib64/libc.so.6: version `GLIBC_2.28' not found (required by /__e/node20/bin/node)
/__e/node20/bin/node: /lib64/libc.so.6: version `GLIBC_2.2[5](https://github.com/zebrium/ze-fluentd-plugin/actions/runs/7358148932/job/20030947317#step:17:5)' not found (required by /__e/node20/bin/node)
We need to autoincrement the package version inside the script to match that tag of the release. We should be able to automate this with an action
When trying to install the collector on a linux machine, we get the following error message:
Installer versoin 1.49.3
OS information:
uname -a
Linux zebriumsyslog 5.15.0-25-generic #25-Ubuntu SMP Wed Mar 30 15:54:22 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
cat /etc/os-release
PRETTY_NAME=“Ubuntu 22.04 LTS”
NAME=“Ubuntu”
VERSION_ID=“22.04”
VERSION=“22.04 (Jammy Jellyfish)”
VERSION_CODENAME=jammy
ID=ubuntu
ID_LIKE=debian
HOME_URL=“https://www.ubuntu.com/”
SUPPORT_URL=“https://help.ubuntu.com/”
BUG_REPORT_URL=“https://bugs.launchpad.net/ubuntu/”
PRIVACY_POLICY_URL=“https://www.ubuntu.com/legal/terms-and-policies/privacy-policy”
UBUNTU_CODENAME=jammy
cat /etc/issue
Ubuntu 22.04 LTS \n \l
Installing package dependies
Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease
Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB]
Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB]
Get:4 http://archive.ubuntu.com/ubuntu jammy-security InRelease [110 kB]
Fetched 338 kB in 0s (703 kB/s)
Reading package lists...
Reading package lists...
Building dependency tree...
Reading state information...
build-essential is already the newest version (12.9ubuntu3).
ruby-dev is already the newest version (1:3.0~exp1).
0 upgraded, 0 newly installed, 0 to remove and 104 not upgraded.
Installing log collector dependencies
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 41 100 41 0 0 313 0 --:--:-- --:--:-- --:--:-- 315
sh: 1: GET: not found
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.