Child having fever and bleeding nose. Bleeding stopped after taking fever reducer. Should I go for medical treatment?

My four year old woke up with fever and his nose started bleeding! We took his temp and it was 101. We placed a cold towel on his head, gave him a fever reducer, and stopped the bleeding. Should we take him to urgent care?