Comments (7)
From what I could gather here, this might be due to the fact that this subprocess that yacron is trying to run is generating a line that is over 65k long.
I'll have to think the best way to handle it. In the mean time, you might want to avoid having this process generate such long lines. Definitely a bug, though, thanks for the report!
from yacron.
Hi,
I saw the fix, thanks a lot. I had a question, is it possible to not ignore the line but get more than the chunk by specifying a bigger limit. In our case we have some very big JSON coming as response.
from yacron.
But what are you doing with that output?.. If you send to Sentry, it will ignore it, for the same reason, too big. If you send as email, I'm not sure, but if it's big it might get into similar problems.
If you just want to log it to the container's stdout, you can specify captureStdout: false
and yacron will just let it pass through to stdout unchanged.
While it's technically possible to change the line limit, I'm not quite convinced it is really that important...
from yacron.
from yacron.
Parse that output from where? You ask yacron to send as email and you parse the output from an email?
OK, fine, if you insist, I'll reopen to add a config option for this limit. Seems a convoluted use case, but fine, it's not that hard to make the limit configurable.
from yacron.
yacron runs a job ( this is a python job too ), this job queries a service, fetches the json and parses it and puts in a DB.
If I run the job from outside yacron it works fine, but when invoked within yacron, I get this error.
from yacron.
Sure, but then it sounds like printing the json to stdout is just for debugging. In which case ignoring the very long line should have no effect in the ability of the script to do its job of parsing the json and storing in the DB.
My claim is that it is possibly ignoring this line is fine. I'll add the config option when I have more time, but it is possible that you are assuming that the job fails when in fact it succeeds?
from yacron.
Related Issues (20)
- Yacron HTTP server failing with: KeyError: "Key not found: 'Accept'" HOT 3
- Broken after 0.12.0 update HOT 3
- Error when starting yacron HOT 8
- Reload config without restart HOT 1
- Sentry: fingerprint option doesn't appear to be working
- Feature Request: Sentry environment config HOT 1
- Sentry: change sentry_sdk.utils.MAX_STRING_LENGTH
- spec "pyinstaller/yacron.spec" not found HOT 1
- Optional stream line prefix
- Cannot run the binary in alpine linux HOT 2
- Job is always executed immediately on yacron start HOT 2
- LD_LIBRARY_PATH env var is breaking curl commands to HTTPS url HOT 2
- correct way for curl command HOT 2
- executionTimeout and killTimeout not working HOT 1
- /etc/yacron.d is missing HOT 4
- Feature Request: activate / deactivate Jobs HOT 3
- Handling of schedule-entries not clear enough documented HOT 4
- Building yacron pyinstaller on newer python version fail HOT 3
- Propose: permanent tasks HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from yacron.