Using a Select Features by ... tool and pressing delete will work most of the time.

However, you can run into a problem where you try to delete a feature using the Delete Selected tool and it doesn't let you. This will happen if, for example, you are attempting to delete the last two nodes in a line feature part.

If you want to delete a feature part by selecting and deleting nodes, you need to use the Advanced Digitizing toolbar: