Using a slotted spoon, transfer orange slices to a large plate. Increase heat to high and bring liquid to a boil; cook until thickened, about 8 minutes more. Remove from heat and whisk in 2/3 cup of the reserved orange juice.

Serve rice pudding warm or at room temperature, with orange slices and a drizzle of syrup.