Unable to configure xpack.infra ENV vars about kibana-docker

[jbudz]

@cdenneen we've added these to the whitelist here for releases going forward

Long term, we've moved kibana-docker to the kibana repo and are tracking a generic approach at elastic/kibana#30598.

[gentunian]

+1 for this, after viewing /usr/local/bin/kibana-docker file I think this approach of adding env var hardcoded into an array should be improved:

# Run Kibana, using environment variables to set longopts defining Kibana's
# configuration.
#
# eg. Setting the environment variable:
#
#       ELASTICSEARCH_STARTUPTIMEOUT=60
#
# will cause Kibana to be invoked with:
#
#       --elasticsearch.startupTimeout=60

kibana_vars=(
    console.enabled
    console.proxyConfig
    console.proxyFilter
    elasticsearch.customHeaders
    elasticsearch.logQueries
    elasticsearch.password
    elasticsearch.pingTimeout
    elasticsearch.preserveHost
    elasticsearch.requestHeadersWhitelist
    elasticsearch.requestTimeout
    elasticsearch.shardTimeout
    elasticsearch.ssl.ca
    elasticsearch.ssl.cert
    elasticsearch.ssl.certificate
    elasticsearch.ssl.certificateAuthorities
    elasticsearch.ssl.key
    elasticsearch.ssl.keyPassphrase
    elasticsearch.ssl.verificationMode
    elasticsearch.ssl.verify
    elasticsearch.startupTimeout
    elasticsearch.tribe.customHeaders
    elasticsearch.tribe.password
    elasticsearch.tribe.pingTimeout
    elasticsearch.tribe.requestHeadersWhitelist
    elasticsearch.tribe.requestTimeout
    elasticsearch.tribe.ssl.ca
    elasticsearch.tribe.ssl.cert
    elasticsearch.tribe.ssl.certificate
    elasticsearch.tribe.ssl.certificateAuthorities
    elasticsearch.tribe.ssl.key
    elasticsearch.tribe.ssl.keyPassphrase
    elasticsearch.tribe.ssl.verificationMode
    elasticsearch.tribe.ssl.verify
    elasticsearch.tribe.url
    elasticsearch.tribe.username
    elasticsearch.url
    elasticsearch.username
    kibana.defaultAppId
    kibana.index
    logging.dest
    logging.quiet
    logging.silent
    logging.useUTC
    logging.verbose
    map.includeElasticMapsService
    ops.interval
    path.data
    pid.file
    regionmap
    regionmap.includeElasticMapsService
    server.basePath
    server.customResponseHeaders
    server.defaultRoute
    server.host
    server.maxPayloadBytes
    server.name
    server.port
    server.rewriteBasePath
    server.ssl.cert
    server.ssl.certificate
    server.ssl.certificateAuthorities
    server.ssl.cipherSuites
    server.ssl.clientAuthentication
    server.customResponseHeaders
    server.ssl.enabled
    server.ssl.key
    server.ssl.keyPassphrase
    server.ssl.redirectHttpFromPort
    server.ssl.supportedProtocols
    server.xsrf.whitelist
    status.allowAnonymous
    status.v6ApiFormat
    tilemap.options.attribution
    tilemap.options.maxZoom
    tilemap.options.minZoom
    tilemap.options.subdomains
    tilemap.url
    timelion.enabled
    vega.enableExternalUrls
    xpack.apm.enabled
    xpack.apm.ui.enabled
    xpack.canvas.enabled
    xpack.graph.enabled
    xpack.grokdebugger.enabled
    xpack.infra.enabled
    xpack.ml.enabled
    xpack.monitoring.elasticsearch.password
    xpack.monitoring.elasticsearch.pingTimeout
    xpack.monitoring.elasticsearch.url
    xpack.monitoring.elasticsearch.username
    xpack.monitoring.elasticsearch.ssl.certificateAuthorities
    xpack.monitoring.enabled
    xpack.monitoring.kibana.collection.enabled
    xpack.monitoring.kibana.collection.interval
    xpack.monitoring.max_bucket_size
    xpack.monitoring.min_interval_seconds
    xpack.monitoring.node_resolver
    xpack.monitoring.report_stats
    xpack.monitoring.ui.container.elasticsearch.enabled
    xpack.monitoring.ui.container.logstash.enabled
    xpack.monitoring.ui.enabled
    xpack.reporting.capture.browser.chromium.disableSandbox
    xpack.reporting.capture.browser.chromium.proxy.enabled
    xpack.reporting.capture.browser.chromium.proxy.server
    xpack.reporting.capture.browser.chromium.proxy.bypass
    xpack.reporting.capture.browser.type
    xpack.reporting.capture.concurrency
    xpack.reporting.capture.loadDelay
    xpack.reporting.capture.settleTime
    xpack.reporting.capture.timeout
    xpack.reporting.csv.maxSizeBytes
    xpack.reporting.enabled
    xpack.reporting.encryptionKey
    xpack.reporting.index
    xpack.reporting.kibanaApp
    xpack.reporting.kibanaServer.hostname
    xpack.reporting.kibanaServer.port
    xpack.reporting.kibanaServer.protocol
    xpack.reporting.queue.indexInterval
    xpack.reporting.queue.pollInterval
    xpack.reporting.queue.timeout
    xpack.reporting.roles.allow
    xpack.searchprofiler.enabled
    xpack.security.authProviders
    xpack.security.cookieName
    xpack.security.enabled
    xpack.security.encryptionKey
    xpack.security.secureCookies
    xpack.security.sessionTimeout
    xpack.xpack_main.telemetry.enabled
)

[jarpy]

Yes. I'd love to see this generalized and standardized across all the Elastic images for the 7.0.0 release.

[tylersmalley]

We're working on generating this as part of building Docker in the Kibana build process. elastic/kibana#22934

[gentunian]

@tylersmalley maybe adding longopts to usage will help to create a more generic approach. Kind of:

$ kibana --help
...
    --xpack.security.authProviders    some help text.
    --xpack.security.cookieName    some help text.
    --xpack.security.enabled    some help text.
    --xpack.security.encryptionKey    some help text.
    --xpack.security.secureCookies    some help text.
    --xpack.security.sessionTimeout    some help text.
    --xpack.xpack_main.telemetry.enabled    some help text.
...

Then every argument prefixed with -- (longopts) could be parameterized via environment variables, so instead of:

kibana_vars=(
    console.enabled
    console.proxyConfig
...
)

You could do:

# Create kibana_vars array based on longopts provided by kibana --help command
kibana_vars=($(kibana --help | sed -e "s/^.*--\([^ ]\+\).*$/\1/g"))

# use the same loop

[cdenneen]

Has their been anymore traction on this?
According to the documentation this should be doable:
https://www.elastic.co/guide/en/kibana/6.5/docker.html#environment-variable-config

Logs is configurable:
https://www.elastic.co/guide/en/kibana/6.5/settings-xpack-kb.html

So settings the OP variables should work based on the setting -> ENV naming convention of "." to "_".
https://www.elastic.co/guide/en/kibana/6.5/logs-ui-settings-kb.html

And I've tested running the container and while the ENV variable is there, it still is using filebeat-* for the Logs UI. I'm sure I could mount the kibana.yml but trying to use ENV variables instead.

bash-4.2$ env
HOSTNAME=cad190f5be77
TERM=xterm
ELASTIC_CONTAINER=true
...
XPACK_INFRA_SOURCES_DEFAULT_LOGALIAS=logstash-*
...