No, you must collect all the items in addition to unlocking them in order to get Golden God.

I unlocked this achievement after completing Challenge 1 in Wrath of the Lamb after picking up the (very dreadfully bad) Dead Cat item after a boss fight (?!). Sure, completing the challenge unlocked the Candle — but that's a DLC item, so it doesn't count.