Vision based intelligent traffic management system is a robust framework that manages the on road traffic flow in real time by estimating traffic density near traffic signals. We have proposed a simple yet efficient algorithm to calculate the number of vehicles at various signals on a road to efficiently manage the traffic by controlling traffic signals to avoid congestion and traffic jam. The proposed system works by detection of vehicles in video frames acquired by cameras installed on roads and then perform accurate counting of vehicles at the same time. Dynamic background subtraction technique and morphological operations for vehicle detection have been used to achieve better detection efficiency. In order to attain accurate vehicle count in least possible time, we have used Region of Interest based method for vehicle calculation. The proposed framework is designed and implemented in several simulation test cases. It is expected that this work will provide an insight into the design and development of traffic signaling based system and also serves as a basis for practical implementation of a computer vision technology in real-time environment. Furthermore, this work also contributes to new design schemes to increase traffic signaling system's intelligence.