University Procedure 255
Section 1. Purpose
- The purpose of an Academic Program Review is to engage program faculty members in reflective evaluation of an academic program to support planning, improvements, and alignment with Metro State University’s mission and strategic goals for relevant, student-centered education in an inclusive, anti-racist, and supportive learning environment.
- The Academic Program Review process (herein referred to as "Academic Program Review") aligns with the University's commitment to continuous improvement, Higher Learning Commission expectations for maintaining institutional accreditation, and expectations from other accrediting bodies. Academic Programs shall view this procedure as informing the development of goals and objectives for continuous improvement of student learning and student outcomes; the procedure also informs a programs’ evaluation of its program health and sustainability in eight categories: Mission Alignment and Reputation; Strength of the Program Structure/Foundation; Program Outcomes and Achievements; Student Outcomes; Size; Revenue and Expenses; Opportunities; and Assessment of Student Learning Outcomes.
Section 2. Definitions
- Academic Award: A certificate, diploma, or degree (Minnesota State System Policy 3.36)
- Academic Program: a cohesive arrangement of college-level curricular requirements leading to an academic award (Minnesota State System Policy 3.36)
- Academic Program Review Plan: This document delineates the program elements and activities that shall be included in an upcoming Academic Program Review. The plan lists all award(s) (if applicable), courses, and any other activities covered by that review.
- Academic Program Review: a process focused on evaluating program effectiveness and alignment with institutional priorities, goals, and outcomes
- Academic Program Review Rubric: The Academic Program Review Rubric identifies eight criteria by which academic programs evaluate program sustainability and health: Mission Alignment and Reputation; Strength of the Program Structure/Foundation; Program Outcomes and Achievements; Student Outcomes; Size; Revenue and Expenses; Opportunities; and Assessment of Student Learning Outcomes.
- Annual Assessment Report: The Annual Assessment Report identifies the Program Learning Outcomes assessed in the prior academic year, the methods by which those outcomes were assessed, the results of the assessment, and a narrative interpretation of the results. The Annual Assessment Report also specifies a program’s plans to modify its curriculum, pedagogical approaches, or assessment measures based on the results. This report is prepared simultaneously with the Program Annual Reflection each semester.
- Assessment: a systematic and iterative process of collecting and analyzing data related to a particular learning outcome and using the results for continuous improvement of student learning
- Curriculum Map: a diagram used to show alignment and connection between distinct levels/groupings of outcomes
- Program Action Plan: a document created during the final stage of Academic Program Review that guides the program’s continuous improvement and program-level assessment of student learning outcomes over the next five-year cycle
- Program Annual Reflection (PAR): a document which reflects on a program’s prior academic year institutional trends; program health and sustainability; and assessment of program-level learning outcomes
- Program Annual Reflection Rubric: The Program Annual Reflection Rubric identifies eight criteria by which academic programs reflectively evaluate program sustainability and health: Mission Alignment and Reputation; Strength of the Program Structure/Foundation; Program Outcomes and Achievements; Student Outcomes; Size; Revenue and Expenses; Opportunities; and Assessment of Student Learning Outcomes.
- Program Learning Outcomes (PLO): The skills and/or competencies students should be able to articulate or utilize after the completion of a credential (academic award).
Section 3. Procedure
- Review Schedule. The Provost’s Office shall determine and maintain the Academic Program Review schedule and communicate deadlines through Operating Guidelines. In addition, forms and rubrics that are part of Academic Program Review will be regularly updated and maintained by The Provost’s Office. Deans and department chairs (or equivalent); program directors (or equivalent); or individuals whom program faculty designate responsibility are responsible for ensuring completion of scheduled Academic Program Reviews.
- Schedule for Academic Programs with external accreditation or review requirements. An Academic Program with external accreditation or review requirements shall be scheduled for its Academic Program Review on a cycle that matches the external accreditation or review process (preferably the Academic Program Review begins immediately after the accreditation review, but not less than every 5 years). Additionally, if approved by the Provost/Provost’s Designee, an Academic Program with external accreditation or review requirements may substitute reports to their external bodies for their Program Annual Reflections and Annual Assessment Reports, although some augmentation may be required to cover topics specified in this procedure or in the approved Academic Program Review Plan, but not contained in their external report.
- Two Phases of Academic Program Review. The Academic Program Review process includes Program Annual Reflections, Annual Assessment Reports, and Academic Program Review. The process has two phases within the 5-year cycle. Phase 1 occurs in years 1—4 of the cycle with ongoing review through Program Annual Reflections and Annual Assessment Reports. Phase 2 occurs in year 4—5 with Academic Program Review preparation, completion, and submission.
- Phase 1: Program Annual Reflections and Annual Assessment Reports
- Program Annual Reflections and Annual Assessment Reports. These brief reports are completed between Academic Program Reviews and reflect improvements based on assessment data and progress against the goals specified in the program’s most recent Academic Program Review and Program Action Plan.
- Program Annual Reflection details. The Program Annual Reflection (PAR) is designed as a building block for the 5-year Academic Program Review cycle. The PAR is also designed as a means for program faculty to appraise the program’s health and sustainability relative to mission alignment and reputation; strength of program structure and foundation; outcomes and achievements; size; revenues and expenses; and opportunities. Individual programs review prior academic year data (enrollment, retention, completion); activities; challenges; and immediate resource needs as well as progress against the agreed-upon goals for the Academic Program Review. Program faculty complete the PAR form and submit it to the Provost on dates set by the Provost on an annual basis. Each PAR submission is reviewed by Academic Innovation, Planning, and Quality Improvement Council (AIPQIC) members; the Dean; the Provost and a Provost’s Designee. Written feedback on each PAR is provided by AIPQIC Council members using the PAR rubric as a guide. The Dean and the Provost collaboratively write a response using the PAR rubric as a guide. The first seven criteria on the PAR Rubric guide the AIPQIC, Dean, and Provost’s feedback (Mission Alignment and Reputation; Strength of Program Structure and Foundation; Program Outcomes and Achievements; Size; Student Outcomes; Revenue and Expenses; and Opportunities).
- Annual Assessment Report details. Annual Assessment Report (AAR) is also designed as a building block for the 5-year Academic Program Review cycle. The Annual Assessment Report identifies the Program Learning Outcomes assessed in the prior academic year, the methods by which those outcomes were assessed, the results of the assessment, and a brief narrative interpretation of the results. The Annual Assessment Report also specifies a program’s plans to modify its curriculum, program learning outcomes, pedagogical approaches, or assessment measures based on the results. Assessment Committee members review and provide written feedback on each AAR; criterion 8 (Assessment of Student Learning) of the Program Annual Reflection Rubric guides the Committee members’ written feedback. Program faculty complete AAR form and submit to the Provost/Provost’s Designee by October 1. Assessment Committee members will provide written feedback on the Annual Assessment Report using the eighth criterion of the PAR Rubric, which is focused on Assessment of Student Learning Outcomes, as a guide.
- Phase 2: Academic Program Review Preparation, Completion, and Submission
- Stage 1: Academic Program Review Plan
- Purpose: Stage 1’s purpose is to develop and document the academic program’s planned activities for conducting the Academic Program Review. The plan delineates the data and topics that shall be covered in the final Academic Program Review (see Stages 2 and 3).
- Timing: Stage 1 occurs in the spring semester of the academic year preceding the actual Academic Program Review.
- Responsible party: Department Chair (or equivalent), Program Director (or equivalent), or individual whom program faculty designate responsibility. The responsible party shall be specified during Stage 1.
- Audience(s): Dean and Provost/Provost’s Designee
- Deliverable: the completed Academic Program Review Plan form shall include assignment of Academic Program Review work and an agreement to complete the work by established deadlines. The Academic Program Review Plan template (and examples) is available from the Provost’s Office.
Developmental Process: The preparation of an Academic Program Review Plan shall follow an iterative draft/respond/revise cycle prior to submission of the final Plan to the Provost/Provost’s Designee.
- The author(s) shall prepare and submit a first-round draft to the Dean. Then Dean shall review the draft and provide written, formative feedback based on the Academic Program Review Rubric for revision purposes and to ensure that the document includes requisite content and is formatted for accessibility. (Metro State University Procedure 101.5).
- The Program Review Plan author(s) shall amend the commented-upon draft for content and accessibility and resubmit for Dean’s review and approval.
- The Dean shall review, approve and submit the Academic Program Review Plan to the Provost/Provost’s Designee, who in turn shall review and approve the final plan. The Provost/Provost’s Designee shall also notify the Department Chair (or equivalent), Program Director (or equivalent), the individual whom program faculty have designated responsibility, and Dean of the approval.
Academic Programs have flexibility to determine the specific dates in which to complete the draft/review/revise/resubmit/review and approve/submit to Provost/Provost’s Designee cycle during spring semester. Refer to Procedure 255 Operating Guidelines for suggested timelines for Stage 1 (Program Action Plan).
Spring semester final faculty duty day (date varies): Deadline by which all faculty members teaching in the program(s) under review shall submit syllabi for all courses they teach in the program to the person coordinating the review.
- The author(s) shall prepare and submit a first-round draft to the Dean. Then Dean shall review the draft and provide written, formative feedback based on the Academic Program Review Rubric for revision purposes and to ensure that the document includes requisite content and is formatted for accessibility. (Metro State University Procedure 101.5).
- Approval: The Dean and Provost/Provost’s Designee shall approve the Academic Program Review Plan before Stage 2 begins.
- Additional Sections: The Academic Program Review Plan shall document the additional sections needed (if any) to complete the Academic Program Review requirements.
- Data and topics: The following are to be included in the Academic Review Plan:
- Scope of Academic Program Review: all academic award(s), courses, and any other activities covered by the review
- Categories and topics that shall be addressed, with at least one programmatic data point or relevant narrative, in the Academic Program Review document
- Names of individuals who shall be involved in conducting the review, with each person’s roles/responsibilities specified explicitly
- Budget required to conduct and write the review, including faculty reassigned time or other necessary resources, such as focus groups
- Schedule (with intermediate milestones) for completing the review
- Data to be evaluated:
- Student Success data
- Program Annual Reflection data
- Annual Assessment Report data
- Equity data
- Course syllabi for all course offerings in the program(s)
- Other data collected from students/alumni
- Market data/job projections
- Curriculum Map
- Program Learning Outcomes
- Stage 1: Academic Program Review Plan
- Stage 2: Data Collection
- Purpose: Stage 2 of the process focuses on compiling and organizing the data to be analyzed for Academic Program Review purposes.
- Timing: Stage 2 occurs during Summer Semester.
- Responsible Party: The individual(s) designated responsibility during Stage 1.
- Audience(s): Program faculty
- Deliverable: The approved Academic Program Review Plan shall specify the data to be collected and analyzed during Stage 2. Data sources include: Institutional Effectiveness and Research; Program Annual Reflections (PARs) submitted since the last Academic Program Review; written feedback from prior applicable PARs; Annual Assessment Reports (AARs) submitted since the last Academic Program Review; written feedback from prior applicable AARs; program-level student learning outcomes (PLO) assessment data; and other data based on the methods described in the Academic Program Review Plan (e.g., through focus groups, advisory boards or surveys, external databases or other methods relevant for the specific Academic Program Review).
- Data Milestones:
- August 1: Data provided by Institutional Effectiveness and Research shall be available on August 1.
- First day of Fall Semester (date varies): Milestone by which an academic program shall have its internal data organized (annual reflections; annual assessment reports; program learning outcome assessment data; written feedback on program annual reflections and annual assessment reports).
- Stage 3: Academic Program Review
- Purpose: Program faculty shall analyze Stage 2 data to evaluate academic program’s relevance, effectiveness, and alignment with Metro State University’s mission and strategic goals.
- Timing: Stage 3 occurs during Fall Semester. Program faculty shall collectively analyze, interpret, and discuss data to evaluate program effectiveness and alignment with institutional priorities, goals, and outcomes.
- Responsible Parties: The individual(s) designated responsibility during Stage 1 and the Dean
- Audience(s): Program faculty and the Dean
- Deliverables: Initial draft of Academic Program Review; Dean’s written feedback on initial draft; amended (final) draft of Academic Program Review
- Developmental Process and Suggested Milestones. Milestone are established annually in Operating Guidelines provided by the Provost’s Office.
- Stage 4: Program Action Plan
- Purpose: The individual(s) designated responsibility during Stage 1 shall consult with the with the Dean and Provost about the completed review. The goal: create a Program Action Plan to guide the program’s continuous improvement and assessment of program-level learning outcomes over the next five-year cycle. The Program Action Plan serves as input into the budgeting process for the fiscal year that starts one year later. Some additional resources may be able to be deployed sooner.
- Timing: Spring Semester
- Responsible Parties: the individual(s) designated responsibility during Stage 1; the Dean; and Program Faculty
- Audience: the Dean and Provost/Designee
- Deliverables: Program Action Plan. Content requirements shall include: Program-level learning outcomes (PLOs); internal targets; additional program goals, such as collaborations, enrollment, retention, etc.; Actions and expected completion dates associated with the above goals; 5-year Assessment Plan for PLOs; and resourced needed for the stated actions.
- Developmental Process and Suggested Milestones. Milestones are established annually in Operating Guidelines provided by the Provost’s Office.
Section 4. Authority
This policy is issued pursuant to authority granted under Minnesota State System Policy 3.36 and Higher Learning Commission Assumed Practices, Policy Number CRRT.C.10.010 A
Section 5. Effective Date
This university procedure shall become effective upon signature by the president and shall remain in effect until modified or expressly revoked.
Section 6. Responsibility
The Provost or Provost’s designee is responsible for the implementation of this procedure.
Section 7. Review
This procedure shall be reviewed every five (5) years or as needed.
Section 8. Signature
Issued on: 01/01/2025.
__________________________
Virginia “Ginny” Arthur, JD
President
Amended: 01/13/2017; 01/01/2025
Date and Subject of Amendments:
January 2017 procedure created a regular five-year cycle for reviews and action plans, as well as a specified table of contents for program reviews.
January 2025 revision formalized annual program reflections, including specific data milestones, as part of a five-year review cycle.
Additional History and/or Revision Dates: n/a