Mandrill encoding errors about incoming

[joshuap]

We use the raw_msg key to parse each inbound message from their WebHook using ruby's standard Mail library. As long as they are converting their whole JSON payload to UTF-8, I'm not sure why you would get encoding errors. The Mail lib does some of its own encoding/decoding as I recall, though. Do you have an error message/backtrace for the conversion errors you mentioned?

[rymohr]

I do have a backtrace but it's not much help here since it doesn't blow up until I run the content through EmailReplyFilter. Just your typical incompatible character encodings: ASCII-8BIT and UTF-8 error.

Still waiting to hear back from Mandrill but I looked into one of the webhooks and it looks like only the event.msg.text field is converted to UTF-8. The content of raw_msg is in the original encoding (though encoded to be UTF-8 friendly I guess?).

We've been running into this error long enough that I finally just dropped incoming yesterday in favor of handling the webhooks directly and grabbing the body from event.msg.text. Seems to be working fine so far.

[joshuap]

That sounds about right (event.msg.text). We probably should do something to handle bad encodings in the raw_msg field or switch to use the UTF-8 keys. I used raw_msg because it's a lot simpler to construct a Mail::Message from. It sounds like you have this resolved on your end for now, but I'll leave this open until I can work up a fix. :)

[rymohr]

I wish I had saved some of my notes for you. It's a hard one to track down!

[rymohr]

This thread was a big help: mikel/mail#431