Fisher was born on October 6, 1877 in Milton, Florida in Santa Rosa County son of Frederick and Mary Anna (McCarter) Fisher. He attended the common schools and graduated from the University of Mississippi at Oxford in 1898. Fisher also attended Princeton University, and was a star player on the 1901 football team. He served as the third head football coach at the University of Tennessee from 1902 to 1903, following J. A. Pierce, the initial occupant of the newly created position, and Pierce’s successor, George Kelley, compiling a career record of 10–7. Like Kelley, he also played at Princeton University before coaching the Tennessee Volunteers.
Fisher studied law, was admitted to the bar in 1904, and commenced practice in Memphis, Tennessee. He married Louise Sanford on November 6, 1909. He was a delegate to the Democratic National Convention in 1912. He was a member of the Tennessee Senate in 1913 and 1914. From 1914 to 1917, he was the United States district attorney for the western district of Tennessee.
Elected as a Democrat to the Sixty-fifth and to the six succeeding Congresses, Fisher served from March 4, 1917 to March 3, 1931, but he was not a candidate for renomination in 1930. Due to deafness, he retired from legal and political activities and moved to Germantown, Tennessee, where he engaged in nursery pursuits.
Head coaching record