In 'Time and Being' Heidegger claims that the task is to 'cease all overcoming and to leave metaphysics to itself'. This paper asks what it actually means to leave metaphysics to itself, and how we are meant to understand the difference between "leaving metaphysics to itself" and "overcoming metaphysics". To understand this distinction, the paper compares Heidegger's later position with those of Husserl and Wittgenstein and with his own earlier position expressed in Being and Time. While we find different interpretations of what it means to leave metaphysics to itself, this paper shows that none of them, apart from Wittgenstein's, draw a clear distinction between leaving metaphysics to itself and overcoming metaphysics. Indeed, rather than leaving metaphysics to itself, Heidegger in 'Time and Being' comes to articulate a negative metaphysics. To avoid such a move, this paper draws on Wittgenstein to show how we can truly leave metaphysics to itself and cease all overcoming