Jim Downer was a four-year starter for the Illinois College baseball team, serving as a co-captain in 1966 when he was selected to the all-conference team. While his athletic accomplishments for the Blueboys were impressive, he did just as much for IC in his roles as an administrator, serving as the Director of Admissions from 1973-81 and as the Vice President of Institutional Advancement from 1981-86. It was in his VP role that he co-founded the IC Athletics Hall of Fame.