Rising Sun, Sept. 25. - By a dispatch this morning from Florence, Ind., we learn that a party of about fifty mounted rebels rode into Warsaw, Ky., and broke into a building in which there were some stored arms belonging to the State, and carried them off. Six or seven Union men came up just as they were leaving, and were fired upon. The Union men returned the fire, killing one of the rebels and wounding several others. One of the Union men was wounded in the arm.

The Union men had taken the locks off the guns that were stolen, intending to keep them off until; they had organized their company.