Comments (5)
On the first run of logster against a log file it hasn't seen before, it'll write out a state file for logtail2 then exit. It won't attempt to process any lines from the existing file.
This is by design. It avoids the situation where a very large file has logster run against it for the first time which attempts to ingest all lines from the file, potentially causing performance and resource issues on the host machine.
You can see the relevant code here
from logster.
Thanks for the response.
In my tests logster does actually process all the lines in the file on the second run (the file is unchanged between runs, but I can try adding a couple of lines). Is that what you would expect?
from logster.
That's certainly not the behaviour I'd expect. Are you able to provide a test case (with example log data and parser code) to reproduce the issue?
from logster.
Sorry, it looks like I made a mistake with the last tests I ran. Started over and it only processes the added lines on the new example. Thanks for your time
from logster.
Hello,
I am trying to make a parser and I was wondering if there's an argument I could pass to go into "testing" mode? The parse_line has stopped from being called and I think it might be because of a state file somewhere. I tried deleing /var/run/logtail-myparser.CustomParsertest.log.state
but it still doesn't call parse_line. I think I may have missed something.
from logster.
Related Issues (20)
- Log parsers not working HOT 1
- DNS queries for the statsd host repeated for each socket.sendto call HOT 4
- Analyzing of IPTABLES logs
- Logster does not accept statsd-host option HOT 3
- Issue with parser error on latest version HOT 2
- Python3 compatibility
- Tailing Logstash? HOT 2
- Support influxdb planned ? HOT 1
- Maintenance HOT 1
- MetricLogster parser does not sum counts HOT 2
- No module named 'fcntl'
- parse_line does not get called HOT 2
- Typo - SyntaxError: invalid syntax
- file locking on Windows HOT 2
- Please tag a version number HOT 3
- python2 compatibility in graphite and statsd output
- Make logger object available in the LogsterParser class HOT 1
- The default error log format has changed; the parser isn't getting it HOT 1
- Metric is different than supposed to be. HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from logster.