“An error occurred while sending mail (hostname “localhost” does not match the server certificate)” this was received while sending redmine test mail
The following setup in configuration.yml worked for me with the extra enable_starttls_auto: false