Attributes are not forwarded to NewRelic for logs about go-agent

[clarkmcc]

Thank you! I fought with this for hours before I realized it was expected behavior. Looking forward to a fix.

[iamemilio]

Hi all, thank you for your advocacy and your patience. I hear your concerns and have gotten the go ahead to prioritize this ASAP. Supporting attribute collection for all v2 logs in context packages is my top priority. I will communicate expectations and upcoming changes as they come. I will communicate about this primarily in #768 since that is where most people seem to be tracking this issue.

[iamemilio]

https://github.com/newrelic/go-agent/releases/tag/v3.33.0 - Adds this feature to Zap.
Upcoming releases will add this to zerolog and slog too

[r--w]

@mariusgrigaitis I managed to add a simple middleware to add all the attributes to the message and this way you can at least see meaningful logs in NewRelic's console, here's the part of the code using https://github.com/samber/slog-multi/

....
logger := slog.New(
		slogmulti.
			Pipe(slogmulti.NewHandleInlineMiddleware(concatAttrsMiddleware)).
			Handler(nrslog.JSONHandler(app, os.Stdout, opts)),
	)

....
func concatAttrsMiddleware(ctx context.Context, record slog.Record, next func(context.Context, slog.Record) error) error {
	flat := strings.Builder{}

	record.Attrs(func(attr slog.Attr) bool {
		flat.WriteString("key: " + attr.Key + " value: " + fmt.Sprintf("%v", attr.Value))
		return true
	})

	message := record.Message
	if flat.Len() > 0 {
		message += ", " + flat.String()
	}

	return next(ctx, slog.NewRecord(record.Time, record.Level, message, record.PC))
}

[dselans]

Same as @clarkmcc , spent hours troubleshooting this until I found this issue.

Using logrus with .WithField() and .WithFields().

[r--w]

This functionality is quite critical. Good slog practice requires adding attributes with additional metadatada, right now all is lost, only message is displayed in NewRelic's console.

[miyamo2]

I am also developing on a library as a hobby to include attributes in the Logs in Context while also logging to stdout in JSON format.

I hope you can use this as a temporary solution.

https://github.com/miyamo2/altnrslog

[iamemilio]

Capturing attributes should already work for decorated logs captured by log forwarders, but the agent is not yet able to handle and emit log attributes. We will have that code settled and shipped soon, and then we can start plugging it into our logging tools: #900

[iamemilio]

#768 (comment)

[mirackara]

#911 PR for slog attribute support.

[conamu]

#911 PR for slog attribute support.

I saw it was approved a month ago. Any updates on when this is going to get released?

[dselans]

@conamu They added support for attributes for uber/zap in 3.33.0 - it works well but it doesn't include initial fields or fields added via WithField() :(

As a tmp bandaid, I added my own log wrapper that keeps track of the fields and just re-adds them every time a log.Debug/Info/Warn/etc is called (with or without extra attributes). Could do the same for logrus/whatever other logger you're using.

Gist: https://gist.github.com/dselans/b318d89158ad83b930221650db15c6ec

[conamu]

we are already using logrus in most of the codebase. Im more interested in a solution to work with slog, a native package, instead of having to fix another library.

[iamemilio]

The Slog package is out :)
https://github.com/newrelic/go-agent/tree/master/v3/integrations/logcontext-v2/nrslog

[iamemilio]

Working on a fix for #915

[iamemilio]

See: #919