The legislation that created Virginia Agricultural and Mechanical College (now Virginia Polytechnic Institute and State University) provided for the establishment of a board of visitors as a governing body. Consisting of both appointed and ex-officio members, the board was empowered to select the president and faculty, determine salaries, handle all matters of discipline and student life, and be responsible for all property of the College.

Governor Gilbert C. Walker appointed the first board on March 19, 1872, the day he signed the bill creating the college, and the first meeting was held March 25 and 26 in Richmond. Board appointments are still made by the governor and subject to confirmation by the Virginia Senate. Since its inception, the board has been chaired by a Rector.

Various changes have occurred throughout the years concerning the composition of the board, primarily relating to number and qualifications of appointees and offices to be represented ex-officio. The first board was composed of nine appointed members, with the president of the State Agricultural Society and members of the State Board of Education serving ex-officio. The next year, the makeup was changed so only the State Superintendent of Public Instruction and the president of the Agricultural Society served ex-officio. Later, the president of the Agricultural Society was eliminated as an ex-officio member, but the State Superintendent of Public Instruction remained until 1966. The president of the Board of Agriculture and Immigration (now Consumer Services) became an ex-officio member after 1902, now being the only ex-officio member serving with thirteen appointed members. Four non-voting members have been added to represent the faculty, staff, graduate students, and undergraduate students.