The reason you cant downgrade is because your on an ipod touch 3g.
I bought my new ipod touch about 2 months ago and it came with 3.1.3 and it was a 2g.
And i was able to downgrade to 3.1.2 with no problem sence it was a 2g.
But someone people with 3g are not having this problem and some are.