You can also use duct tape. Just stick it onto the caps and pull it out. Alternatively, you could actually practice thumb grinding with the caps on. This can help to improve your control of the yoyo when thumb grinding.