GithubHelp home page GithubHelp logo

zebrium / ze-fluentd-plugin Goto Github PK

View Code? Open in Web Editor NEW
3.0 2.0 3.0 250 KB

Zebrium's fluentd output plugin sends the logs you collect with fluentd to Zebrium for automated anomaly detection.

Shell 90.44% Ruby 9.56%
anomaly-detection structured-data log-management log-analytics log-collector

ze-fluentd-plugin's People

Contributors

b3arp avatar b3arpsl avatar bradyzebrium avatar dependabot[bot] avatar jwl17330536 avatar ravenklaugh avatar robf17 avatar rodbagg avatar seamusclark avatar

Stargazers

avatar avatar avatar

Watchers

avatar avatar

Forkers

bradyzebrium zixuansnow jwl17330536

ze-fluentd-plugin's Issues

Make container monitor service optional

In some use cases, we do not want to install the additional container monitor services, as most use cases do not need a container scraper added as well. This will remove a lot of overhead concern and security concerns with this installer

Update file paths to reflect update to fluent-package

update_fluentd_cfg.rb needs to be updated with the new paths for configuration files. The old paths

file_map_cfg_file = "/etc/td-agent/log-file-map.conf" old_file_map_cfg_file = "/etc/zebrium/log-file-map.cfg" user_fluentd_cfg_file = "/etc/td-agent/conf.d/user.conf"

need to be updated to reflect the updated paths /etc/fluent/ and /etc/fluent/conf.d. Any changes to the rest of the script or other components of the collector need to also be investigated and updated.

Linux installation method is dangerous

The Linux installation method is dangerous but I'm not talking about the use of curl | bash. When using this installation method, the best practice it to wrap the installation in a single character function to safely handle network interruptions.

In install_collector.sh you have

function cleanup() {
    rm -f $NPIPE
    rm -rf $TEMP_DIR
}

trap cleanup EXIT

Consider what would happen if the script download was interrupted after line 158 character 10 was downloaded. You'd have

TEMP_DIR=/

Thus curl | bash would execute rm -rf /

Actions Failing for AL2 and OL7

Getting complaints about GLIBC and related libraries when running test actions on OL7 and AL2:

/__e/node20/bin/node: /lib64/libm.so.6: version `GLIBC_2.27' not found (required by /__e/node20/bin/node)
/__e/node20/bin/node: /lib6[4](https://github.com/zebrium/ze-fluentd-plugin/actions/runs/7358148932/job/20030947317#step:17:4)/libstdc++.so.6: version `GLIBCXX_3.4.20' not found (required by /__e/node20/bin/node)
/__e/node20/bin/node: /lib64/libstdc++.so.6: version `CXXABI_1.3.9' not found (required by /__e/node20/bin/node)
/__e/node20/bin/node: /lib64/libstdc++.so.6: version `GLIBCXX_3.4.21' not found (required by /__e/node20/bin/node)
/__e/node20/bin/node: /lib64/libc.so.6: version `GLIBC_2.28' not found (required by /__e/node20/bin/node)
/__e/node20/bin/node: /lib64/libc.so.6: version `GLIBC_2.2[5](https://github.com/zebrium/ze-fluentd-plugin/actions/runs/7358148932/job/20030947317#step:17:5)' not found (required by /__e/node20/bin/node)

Installer no longer installing on linux

When trying to install the collector on a linux machine, we get the following error message:

Installer versoin 1.49.3
OS information:
uname -a
Linux zebriumsyslog 5.15.0-25-generic #25-Ubuntu SMP Wed Mar 30 15:54:22 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
cat /etc/os-release
PRETTY_NAME=“Ubuntu 22.04 LTS”
NAME=“Ubuntu”
VERSION_ID=“22.04”
VERSION=“22.04 (Jammy Jellyfish)”
VERSION_CODENAME=jammy
ID=ubuntu
ID_LIKE=debian
HOME_URL=“https://www.ubuntu.com/”
SUPPORT_URL=“https://help.ubuntu.com/”
BUG_REPORT_URL=“https://bugs.launchpad.net/ubuntu/”
PRIVACY_POLICY_URL=“https://www.ubuntu.com/legal/terms-and-policies/privacy-policy”
UBUNTU_CODENAME=jammy
cat /etc/issue
Ubuntu 22.04 LTS \n \l
Installing package dependies
Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease
Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB]
Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB]
Get:4 http://archive.ubuntu.com/ubuntu jammy-security InRelease [110 kB]
Fetched 338 kB in 0s (703 kB/s)
Reading package lists...
Reading package lists...
Building dependency tree...
Reading state information...
build-essential is already the newest version (12.9ubuntu3).
ruby-dev is already the newest version (1:3.0~exp1).
0 upgraded, 0 newly installed, 0 to remove and 104 not upgraded.
Installing log collector dependencies
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100    41  100    41    0     0    313      0 --:--:-- --:--:-- --:--:--   315
sh: 1: GET: not found

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.