Henry Bundy enrolled to serve three years and was mustered into the 2nd Battery as a Private on March 1, 1862 at Hunter's Chapel, Virginia.

Bundy joined the Thirteenth as a Second Lieutenant on May 15, 1862 and was commissioned in that grade on May 30 with rank retroactive, following the resignation of Carl Von Linden. When Frank Singer resigned from the unit, Bundy was promoted to First Lieutenant on February 13, 1863 with rank retroactive to January 16. Following the death of William Wheeler, he was appointed commander and promoted to Captain on July 9, 1864, retroactive to June 22. At the end of the war, he mustered out with the unit in New York City on July 28, 1865.