Born in Orange, California, Fred Kelly attended Orange High School and was a freshman at University of Southern California, when he was selected to the US 1912 Olympic team.