A native of Petal, Mississippi, Alford has played in all four games this year as a backup safety and punt returner. He registered six tackles and two punt returns for 8 yards.
Alford was selected in the third round of the 2012 Major League Baseball Draft by the Toronto Blue Jays, who signed him to a contract that allowed him to play college football while still participating in Blue Jays' extended spring training during the summers.
"Anthony is leaving school to pursue major league baseball," Ole Miss head coach Hugh Freeze said. "We wish him the best. He's a great kid."
Alford played quarterback at Southern Miss as a true freshman in 2012 before transferring to Ole Miss and sitting out last year.