XF 1.4Blocking bots by user agent

Member

I used to have an add on that allowed me to input bots and it would block them directly from the software from accessing the site. This made the stress on the server much much less and I was wondering how I could accomplish this on Xenforo? I would like to do this manually, could I do this with robots.txt for example? This is an example of my spider list that I used to block, it's 50+ spiders in the blocklist overall that I had