Brown grew up in Malakoff, Texas, and served four years with the U. S. Air Force, then later married Winnie Harris in 1957. He graduated from the University of Corpus Christi (Texas A & M at Corpus Christi) in 1960 with a degree in Business Administration and a minor in Religious Education. That same year, he began what came to be 28 years of employment with Jefferson Chemical Company (Texaco Chemical Co.). Brown has been in ministry to Baptist congregations in Texas at Southside, First Baptist Port Neches, Woodcrest in Port Arthur, and Calder.