Yes…but it’s much better to get yourself a $15 ISP programmer to use with these bare chips. Something like this: https://www.sparkfun.com/products/9825

In the Arduino IDE the only difference you’ll notice is you select an option from the “Tools->Programmer” menu instead of a COM port. You get more features than COM though, eg. You can set ‘fuse’ settings on the chips (to select clock sources, etc. (which you’ll need to do with this chip unless you want it locked at 1mHz)

You also don’t lose a couple of K of flash memory to the bootloader - very important when you only have 2K of program space!

SparkFun is an online retail store that sells the bits and pieces to
make your electronics projects possible. Whether it's a robot that can
cook your breakfast or a GPS cat tracking device, our products and
resources are designed to make the world of electronics more accessible.

In addition to products, SparkFun also offers
classes and online tutorials to help educate
individuals in the wonderful world of embedded electronics.