Given base 10, Charlie's N=13485 is the smallest. Yet, by definition a number is pandigital if its significant digits have each of the digits represented for its base. And in base 2, where N = 1, 2N = 10 and N||2N = 110 or, in base 10, 6 -- which is likely the smallest such number with bases unrestricted.

(Yes, I know, by default, if not stated, an inference is base 10 numbers -- yet, I wanted to be able to give an answer that was not computed by programmed code.)