How to load an assembly under a different appdomain

I have a plugin like system for my C# application. I am running into the issue where plugins won't load from the /plugins directory but they will if the plugins are in the same area as the executable. I am also trying to sandbox these plugins as my app (shouldn't be, but may be) ran as an admin and I don't want people to be able to write malicious plugins.