TO_NUMBER can only convert valid numeric values. So you might want to rethink your order by. Do you want to sort on ALL values, or do you want to strip non-numeric characters from your column? It's your call...

1) left append zero to the field to some maximum size, then sort on the resulting character string
2) write your own f_to_number function to ignore errors in conversion and then retrieve/sort using the function