Zimmer's family made the announcement on Twitter.
Elmira holds a special place in Zimmer's heart and history, as he married his wife, Jean at Dunn Field, before a Pioneer's night game in 1951.
Zimmer went on to play for several MLB teams, including the Brooklyn Dodgers, the Chicago Cubs, and the Washington Senators. When his playing days ended, he stayed active in the game with a long career in coaching, making stops with the Red Sox, Yankees, and Rays, among others.
Zimmer was 83 years old.