Windows binaries are available in release pages.
This plugin works with fluent-bit's go plugin interface. You can use fluent-bit-go-s3 to ship logs into AWS S3.
The configuration typically looks like:
fluent-bit --> AWS S3
$ fluent-bit -e /path/to/built/out_s3.so -c fluent-bit.conf
- Go 1.11+
- gcc (for cgo)
$ make
Key | Description | Default value | Note |
---|---|---|---|
Credential | URI of AWS shared credential | "" |
(See Credentials) |
AccessKeyID | Access key ID of AWS | "" |
(See Credentials) |
SecretAccessKey | Secret access key ID of AWS | "" |
(See Credentials) |
Bucket | Bucket name of S3 storage | - |
Mandatory parameter |
S3Prefix | S3Prefix of S3 key | - |
Mandatory parameter |
Region | Region of S3 | - |
Mandatory parameter |
Example:
add this section to fluent-bit.conf
[Output]
Name s3
Match *
# Credential /path/to/sharedcredentialfile
AccessKeyID yourawsaccesskeyid
SecretAccessKey yourawssecretaccesskey
Bucket yourbucketname
S3Prefix yours3prefixname
Region us-east-1
fluent-bit-go-s3 supports the following credentials. Users must specify one of them:
Specifying credentials is required.
This plugin supports the following credentials:
Create the following file which includes credentials:
[default]
aws_access_key_id = YOUR_AWS_ACCESS_KEY_ID
aws_secret_access_key = YOUR_AWS_SECRET_ACCESS_KEY
And specify the following parameter in fluent-bit configuration:
Credential /path/to/sharedcredentialfile
Specify the following parameters in fluent-bit configuration:
AccessKeyID yourawsaccesskeyid
SecretAccessKey yourawssecretaccesskey
Specify AWS_ACCESS_KEY
and AWS_SECRET_KEY
as environment variables.