Orr was born in Anderson County, South Carolina. He was the younger brother of James L. Orr. He later moved to Mississippi, where he was a member of the state legislature in 1852. He later represented the state in the Provisional Confederate Congress and the Second Confederate Congress. After the war he served as a state court judge from 1870 to 1876.
de:Jehu Amaziah Orr