So if dt is infinite small, dV/dt and thus I will become infinite high.

As for the inductor:

V = L * dI/dt

So if dt is infinite small, dI/dt and thus V will become infinite high.
Practically, if you feed an inductor by a DC-current and switch it off, the inductor will immediately produce a (long) spark, thereby keeping up the current.