Bring water and sugar to a boil in a saucepan; remove from heat. Stir oranges, cherries, and cinnamon stick into sugar mixture. Cover saucepan and steep for 1 hour.
Remove fruit and cinnamon stick using a slotted spoon; stir in bitters. The mixture can be refrigerated or left at room temperature.