varnishcache-friends / varnishstatbeat Goto Github PK
View Code? Open in Web Editor NEWElastic Beat for Varnish Stats
License: Other
Elastic Beat for Varnish Stats
License: Other
Hi, I am getting the following problem:
single.go:140: ERR Connecting error publishing events (retrying): Connection marked as failed because the onConnect callback failed: Could not load template: couldn't load template: couldn't load json. Error: 500 Internal Server Error. Response body: {"error":{"root_cause":[{"type":"string_index_out_of_bounds_exception","reason":"String index out of range: 0"}],"type":"string_index_out_of_bounds_exception","reason":"String index out of range: 0"},"status":500}
Sometimes is send it but it also shows that Index out of range.
I have the following config.
Thank you guys,
Just testing locally with ES 6.6.1, and I got a variety of errors all caused by the JSON template.
string
type has been changed to text
.false
(rather than "not_analyzed"
).ignore_above
is evidently not compatible with most text
properties (although ES does not seem to object to ignore_above
in the strings_as_keyword
mapping declaration).PR for a fix that works in my setup coming up.
varnishstatbeat will output these "happy" values for some of our caches, which are out of range numbers. ElasticSearch throws an exception when it tries to index these.
"VBE_boot_somesite_on_somehost_happy": 18446744073709551615
Causes:
[2017-11-08T14:23:21,793][WARN ][logstash.outputs.elasticsearch] Could not index event to Elasticsearch. {:status=>400, :action=>["index", {:_id=>"3372065347ac40bf187e4cc22ed6043c218e8bce", :_index=>"varnishstatbeat-2017.11.08", :_type=>"stats", :_routing=>nil}, 2017-11-08T19:23:20.728Z myvarnishhost %{message}], :response=>{"index"=>{"_index"=>"varnishstatbeat-2017.11.08", "_type"=>"stats", "_id"=>"3372065347ac40bf187e4cc22ed6043c218e8bce", "status"=>400, "error"=>{"type"=>"mapper_parsing_exception", "reason"=>"failed to parse", "caused_by"=>{"type"=>"illegal_state_exception", "reason"=>"No matching token for number_type [BIG_INTEGER]"}}}}}
Hi,
Any chance we could get support for ES7 ?
It currently fails with ES6 template:
2021/03/05 10:32:32.951844 client.go:673: DBG PUT http://172.16.0.166:9200/_template/varnishstatbeat.template-es6x.json map[mappings:map[_default_:map[properties:map[@timestamp:map[type:date] beat:map[properties:map[name:map[index:false type:text] version:map[index:false type:text] hostname:map[index:false type:text]]] counter:map[type:long] fields:map[properties:map[]] meta:map[properties:map[cloud:map[properties:map[project_id:map[index:false type:text] provider:map[index:false type:text] region:map[index:false type:text] availability_zone:map[index:false type:text] instance_id:map[type:text index:false] machine_type:map[index:false type:text]]]]] tags:map[index:false type:text]] _all:map[norms:map[enabled:false]] _meta:map[version:6.0.0-alpha1] date_detection:false dynamic_templates:[map[strings_as_keyword:map[mapping:map[ignore_above:1024 index:false type:text] match_mapping_type:string]]]]] order:0 settings:map[index.refresh_interval:5s] template:varnishstatbeat-*]
2021/03/05 10:32:32.959299 sync_worker.go:87: ERR Connect failed with: Connection marked as failed because the onConnect callback failed: Could not load template: couldn't load template: couldn't load json. Error: 400 Bad Request. Response body: {"error":{"root_cause":[{"type":"mapper_parsing_exception","reason":"Root mapping definition has unsupported parameters: [_default_ : {_meta={version=6.0.0-alpha1}, dynamic_templates=[{strings_as_keyword={mapping={ignore_above=1024, index=false, type=text}, match_mapping_type=string}}], _all={norms={enabled=false}}, date_detection=false, properties={@timestamp={type=date}, meta={properties={cloud={properties={machine_type={index=false, type=text}, availability_zone={index=false, type=text}, instance_id={index=false, type=text}, project_id={index=false, type=text}, provider={index=false, type=text}, region={index=false, type=text}}}}}, beat={properties={hostname={index=false, type=text}, name={index=false, type=text}, version={index=false, type=text}}}, counter={type=long}, fields={properties={}}, tags={index=false, type=text}}}]"}],"type":"mapper_parsing_exception","reason":"Failed to parse mapping [_doc]: Root mapping definition has unsupported parameters: [_default_ : {_meta={version=6.0.0-alpha1}, dynamic_templates=[{strings_as_keyword={mapping={ignore_above=1024, index=false, type=text}, match_mapping_type=string}}], _all={norms={enabled=false}}, date_detection=false, properties={@timestamp={type=date}, meta={properties={cloud={properties={machine_type={index=false, type=text}, availability_zone={index=false, type=text}, instance_id={index=false, type=text}, project_id={index=false, type=text}, provider={index=false, type=text}, region={index=false, type=text}}}}}, beat={properties={hostname={index=false, type=text}, name={index=false, type=text}, version={index=false, type=text}}}, counter={type=long}, fields={properties={}}, tags={index=false, type=text}}}]","caused_by":{"type":"mapper_parsing_exception","reason":"Root mapping definition has unsupported parameters: [_default_ : {_meta={version=6.0.0-alpha1}, dynamic_templates=[{strings_as_keyword={mapping={ignore_above=1024, index=false, type=text}, match_mapping_type=string}}], _all={norms={enabled=false}}, date_detection=false, properties={@timestamp={type=date}, meta={properties={cloud={properties={machine_type={index=false, type=text}, availability_zone={index=false, type=text}, instance_id={index=false, type=text}, project_id={index=false, type=text}, provider={index=false, type=text}, region={index=false, type=text}}}}}, beat={properties={hostname={index=false, type=text}, name={index=false, type=text}, version={index=false, type=text}}}, counter={type=long}, fields={properties={}}, tags={index=false, type=text}}}]"}},"status":400}
^C2021/03/05 10:32:34.091579 service.go:33: DBG Received sigterm/sigint, stopping
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.