Each graduating student from BYUH is required to complete a comprehensive survey evaluating their educational experiences. After graduation, transcripts or copies of diplomas are not released by the Registrar’s Office until the survey is completed. Taking the Graduating Student Survey (GSS) is included on a “to do” list distributed by the Registrar’s Office at the time students apply for graduation, and a reminder is sent to students prior to the release of the survey
(see sample email notification to students).
The GSS is released to all graduating students about 2-weeks prior to their departure from campus. This is to allow each student sufficient time to update the University on their plans after graduation and to provide the latest contact information (which is used by the Alumni Office, Career Services, Registrar, and academic and several other departments to keep in touch with graduates once they leave campus). The survey is completed online from any location and includes both closed and open-ended questions (see sample survey). This survey was developed in-house and has been used in a variety of formats since 2000 (*see Brief History of the Graduating Student Survey).
Once the survey is released, the office of Planning, Institutional Research, Assessment & Testing (PIRAT) shares survey results (unedited) through a report link they provide to both academic and administrative departments on campus
(see sample email notification to departments). Departments are encouraged to review student comments and feedback. The survey program allows departments to filter responses to fit their individual information needs, and to download data from the survey to do further statistical analysis if desired. Departments also use survey results in department meetings and retreats, and some as secondary evidence to measure outcomes in annual assessment plans
(see sample annual assessment plans from Academic Advising, Career Services, EIL, International Business Management, Library and Information Services, Religious Education and Special Education).
At times some departments will request a more in-depth study of survey results for program reviews and other special needs. A member of the PIRAT team will then put together detailed summaries for these departments (see sample reports for International Business Management and Social Work). In addition, a faculty-mentored student research team helps evaluate and share information with the larger campus community.
Information from the survey is also shared with the GE committee and university councils, including the BYUHSA Student Advisory Council (SAC) which looks for ways to improve the campus experience for students. Strategically, the President’s Advisory Council also reviews student comments and feedback from the survey. In 2008 results from the survey were shared with the University’s newly appointed “Design Team” to help in looking at areas on campus that needed strengthening (through restructuring services and/or alignment with key campus functions and the overall University mission).
Essay (1999 and prior years)
- Graded by English Faculty
- Students self-select one of seven essays
- In 1999, the Reading/Writing Center was asked by the IR office to summarize essay comments and to provide student feedback on programs and the University as a whole (This was a very difficult task to do with open-ended essays questions not initially designed for this purpose)
First GSS Version (1999-2000)
- Created first survey with assistance of the IR office
- Printed on a scan-able form using Testing Center scanners to create the data file for analysis
- Questions focused on retention
- Flexible 7-pt. Scale (“Very Low” to “Very High”)
Revised Version (Jan. to Aug., 2001)
- Scan-able
- Used to Benchmark satisfaction with University services
- Aligned to University mission
- BYU IR office (Provo) provided reports and statistical analysis of the data (see July 2001 report)
First On-line Version (Sept. 2001 to June 2003)
- Generally used the same questions as the paper version but in an online format
- Students typed their own responses
- Required hard code programming on the University’s website (took a great deal of time and energy to develop and implement)
- Difficulty changing questions or distributing information to departments
- PacPair presentation of survey in May 2002 (compared on-line vs. paper survey results)
SurveyMonkey Version 1 (December 2003 to December 2006)
- Easier way to create/modify surveys and share immediate feedback
- A few questions were revised or updated
- Response scale was revised to a six-point scale (“Very Poor” to “Excellent”)
- A paper version was added in 2004 to reach students living in remote areas without access to computers (see sample survey)
- GE assessment questions were added in 2006
- Results were shared with all departments using online survey report links for each graduation cohort
SurveyMonkey Version 2 (December 2006 to August 2007)
- Student research team (mentored by Dr. Ronald M. Miller, Psychology Department) reviewed survey and results from 2003 to 2006
- Questions were randomly assigned in the survey (scrambled)
- Instrument was tested for statistical reliability and validity
- A factor analysis was completed
- Additional questions were added to assess intercultural understanding and leadership
- A survey for campus departments was conducted to see how useful the Graduating Student Survey was to departments and how it could be improved (see survey results)
- Report summaries were completed for several departments undergoing program review
SurveyMonkey Version 3 (December 2007 to present)
- Ineffective questions were revised or deleted (see sample survey)
- The GSS was reorganized made user-friendly for graduating students
- Results were shared with all departments using online survey report links for each graduation cohort
- Online links to survey results were added to BYUH accreditation website
- Questions and survey results usage continue to be evaluated and monitored
