Photos of Confederate soldiers in the field and surviving originals show that captured, refurbished, and reissued U.S. Army canteens were among the most common canteens in the latter half of the war.  These canteens were usually issued uncovered, and often with a leather strap with slits cut to cradle the canteen.

CS Refurbished Canteen