Irvin was born in Plankinton, S.D. to Louman N. and Mary E. Brown, the youngest of five children. The family moved to Oregon in 1936 and lived on a farm south of Hillsboro. He graduated from Hillsboro High School. He married Virginia B.Brown on May 29, 1942. Irvin was in the Army Air Force from 1943-45. Irvin and Virginia had three children: Wes, Donna and Nic. When Nic was a senior in high school, Candace was born and two years later they had Shannon. He worked as a sheet metal worker. Irvin attended Sunset Presbyterian Church for many years. His beloved wife, Virginia, preceded him in death in 2002. He died at home surrounded by his five children. He has fourteen grandchildren and eighteen great-grandchildren.