If this is possible, does the configuration allow one to define the overlay at
the “backend” level, so that it applies to all databases of the same type?
e.g.
backend ldap
overlay rwm
rwm-rewriteEngine on

No. No modules in OpenLDAP have ever implemented anything for the "backend"
keyword, it is purely a no-op.