Implements #1577, but the issue should remain open until we clean up the debugging loglines.
Instead of building a new serialized message for each recipient, try to cache them.