Exim4 keeps forwarding emails instead of delivering them

We've set up an exim4 email server on a Debian6 system. It'll accept emails, and the forwards them upstream to our ISP, even when the emails are for the local system. How do I get it to stop doing this, and deliver the messages to its own mailboxes?