qlog's People
qlog's Issues
Requests hang when querying empty files
Hi @whargrove this is Franco from Cribl, again :).
Please see the behavior when querying empty files.
- Request issued is:
http://localhost:8080/queryLog?relativePath=empty
- Process goes up to +250% in CPU utilization.
- Request doesn't complete:
`franco@franco:~$ curl -v "http://localhost:8080/queryLog?relativePath=empty"
- Trying 127.0.0.1:8080...
- Connected to localhost (127.0.0.1) port 8080 (#0)
GET /queryLog?relativePath=empty HTTP/1.1
Host: localhost:8080
User-Agent: curl/7.81.0
Accept: /
Excessive CPU utilization when looking for a term in the file.
Hi @whargrove this is Franco from Cribl. Please see the scenario below. I'm seeing the application consuming +250% of CPU on my laptop when:
- specifying a term that can't be found easily (i.e. at the end of the file) AND/OR
curl -v "http://localhost:8080/queryLog?relativePath=large.csv&count=1&filter=cribl
- when asking the service for too many lines:
curl -v "http://localhost:8080/queryLog?relativePath=large.csv&count=999999999
*Where large.csv
is a 4.3GB
file with 28,741,648 lines that doesn't contain the searched term cribl
.
Can you please take a look at each case and see whether this is expected behavior or there's something you can do to improve perf?
Thanks!
Service hangs when filter string not found in log file
The service consumes a lot of CPU, and will hang if the filter query is not found.
To reproduce:
- echo "line one" > /var/log/smallfile
- curl -Ss "http://localhost:8080/queryLog?relativePath=smallfile&filter=WILLNOTFIND"
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. ๐๐๐
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google โค๏ธ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.