This article on feature visualization explores the intricacies, challenges and common approaches to visualizing features in neural networks. Remarkably, at the end, we find ourselves with relatively simple methods that are able to produce high-quality visualizations.