When packaging on Fedora, Kalev Lember brought up the issue that there's not really a way to limit p11-kit to only load modules for a given architecture.
When both 64-bit and 32-bit versions of a PKCS#11 library are installed then 64-bit processes should only load 64-bit modules, and vice versa.