Preheat the oven to 350 degrees F (175 degrees C). Spray a 9x13-inch baking pan with cooking spray.
Place frozen chicken wings, skin side-down, in the prepared pan.
Combine soy sauce, water, and sugar in a bowl; pour sauce over chicken.
Bake in the preheated oven for 30 minutes. Remove from the oven, turn wings, and sprinkle with sesame seeds. Return to the oven and bake until no longer pink at the bone and the juices run clear, about 30 minutes more. An instant-read thermometer inserted near the bone should read 165 degrees F (74 degrees C).