Comments (4)
完整的采集配置发下
from ilogtail.
{ "metrics": { "##1.0##kafka_output_test3": { "category": "file", "log_type": "apsara_log", "separator": "", "keys": [""], "regex": [""], "log_begin_regex": [""], "log_begin_regexs": [""], "logBeginRegex": [""], "logBeginRegexs": [""], "log_path": "/home/admin/liujh/sysm-data/sysm-data-invilid-2.0.0/logs/", "file_pattern": "*.log", "create_time": 1631018645, "defaultEndpoint": "", "delay_alarm_bytes": 0, "delay_skip_bytes": 0, "discard_none_utf8": false, "discard_unmatch": false, "docker_exclude_env": {}, "docker_exclude_label": {}, "docker_file": false, "docker_include_env": {}, "docker_include_label": {}, "enable": true, "enable_tag": false, "file_encoding": "utf8", "filter_keys": [ ], "filter_regs":[ ], "group_topic": "", "plugin": { "processors": [ { "detail": { "SplitRegex": "\\s*[0-9]{4}-[0-1][0-9]-[0-3][0-9] [0-2][0-9]:[0-5][0-9]:[0-5][0-9].*", "SplitKey": "content" }, "type": "processor_split_log_regex" }, { "type":"processor_add_fields", "detail": { "Fields": { "serviceLine": "csp", "appName": "csp-hermes", "hostName": "tc-dev-mid-monitor03" } } } ], "flushers": [ { "type": "flusher_kafka", "detail": { "Brokers": [ "10.7.0.37:9092" ], "Topic": "logtail-flusher-kafka2" } } ] }, "local_storage": true, "log_tz": "", "max_depth": 10, "max_send_rate": -1, "merge_type": "topic", "preserve": true, "preserve_depth": 1, "priority": 0, "raw_log": false, "aliuid": "", "region": "", "project_name": "", "send_rate_expire": 0, "sensitive_keys": [], "shard_hash_key": [], "tail_existed": false, "time_key": "", "timeformat": "", "topic_format": "none", "tz_adjust": false, "version": 1, "advanced": { "force_multiconfig": false, "tail_size_kb": 1024 } } } }
from ilogtail.
processor_split_log_regex增加下PreserveOthers: true配置项。相见processor_split_log_regex代码
from ilogtail.
感谢
from ilogtail.
Related Issues (20)
- [DOC]: 使用vscode进行图形化界面调试以及代码跳转功能实现
- k8s内daemonset部署的ilogtail ilogtail自身的metrics在哪里看? HOT 1
- AWS部署不能采集到日志 HOT 2
- [BUG]:最新开发镜像无法编译glibc HOT 3
- [QUESTION]:用户手册提供的dockers使用教程执行过程中发现输出的日志文件找不到
- [QUESTION]:ilogtail2.0.0使用damonset的方式启动时报错,ilogtail exited unexpectedly HOT 2
- [QUESTION]:daemonsets配置config_update_interval不生效 HOT 1
- [QUESTION]:如何将日志输出到victorialogs HOT 1
- [BUG]:Container startup failed HOT 8
- 如何使用ilogtail开源版本配置采集promethues的数据呢? HOT 4
- [ENHANCEMENT]: 提升iLogtail 2.x 的 flusher 性能
- [ENHANCEMENT]: Go ProcessorV2 全链路适配PipelineGroupEvents结构,弃用LogWithContext
- [DOC]: 插件-输入-文本日志 2.0.0文档陈旧,操作无法产生预期的输出 HOT 4
- [QUESTION]:在 microk8s上没有按照期待的收集到日志 HOT 3
- [FEATURE]: 支持收集wsl2的 docker desktop 中的容器日志
- ilogtail开源版采集skywalking配置疑问 HOT 4
- [BUG]:启动报错 Illegal instruction HOT 10
- [BUG]:ilogtail 每次重启 app_info.json 里面的 instance_id 都会变动 HOT 2
- bug: log_read_offset and log_read_length use same key
- [FEATURE]: 希望支持agent_id或者machine_uuid带在日志meta总进行上报
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ilogtail.