Horace was mustered into Company C of the 44th New York Infantry as a private on October 9, 1861.
Horace was moved from Company C of the 44th to Company H while he was in the hospital. The reasons for his transfer are unknown.
Horace is transferred to the 140th New York Regiment on October 6 and then mustered out of the army three days later because he completed his three-year term of service. He fought in nine battles.
After spending six months out of the service, Horace was drafted and mustered into the service once more. He joined Company F of the 121st New York Infantry as a replacement for fallen soldier Thomas Barnes.
Horace spent about three months with the 121st before he was transferred to the 65th New York Infantry by special order on June 24, 1885.
Horace was with the 65th infantry for the end of his time as a soldier. He was a member of the regiment for a little less than a month before he was mustered out of the service for good on July 17, 1885.