The Council for the Accreditation of Educator Preparation (CAEP) has eight annual reporting measures which are used to provide information to the public on both program outcome and program impact. Below is a list of the CAEP measures with links to data tables that provide supporting evidence for each measure:
MEASURES OF PROGRAM IMPACT
MEASURE 1: Impact on P-12 learning and development
Two primary measures are employed to assess completer impact on PK-12 learning and development: value-added state student growth data and RESA pass rates. The former data, though limited, shows that the majority of our alumni teachers’ students are performing in the average to most effective range. The Resident Educator data, which speaks to our alumni teachers’ ability to engage in reflective pedagogy that is responsive to their students’ needs, demonstrates three years of passage rates that are 85% or higher for participating alumni.
MEASURE 2: Indicators of teaching effectiveness
The RESA pass rates above speak to our alumni teachers’ effectiveness. Another indicator of their effectiveness is the data acquired through our principal satisfaction survey. The principal survey is aligned to CAEP, INTASC and OSTP standards and in an attempt to triangulate data, it asks the same questions that are asked on our alumni satisfaction survey. In comparing the 2019 Principal and Completer Satisfaction data, there were just two areas where less than 75% of both principals and alumni themselves felt prepared. These areas include:
- Providing multiple opportunities for students to engage in self-assessment of learning; &
- Co-teaching lessons with the special educator or other professionals in a manner that enhances student learning.
This data was shared with the education faculty during the department’s 2020 strategic planning and initiatives were set in place to give candidates more practice in these areas. When the Principals were surveyed again in 2020, 100% of them expressed that our alumni teachers were prepared in every capacity. This new principal satisfaction data is available under measure 3.
MEASURE 3: Results of employer surveys, including retention and employment milestones
Satisfaction of employers is gauged at the initial level through the administration of a principal satisfaction survey. The 2020 Principal Satisfaction Survey data indicated that 100% of participating principals believed Franciscan Alumni Teachers to be prepared in every instructional competency aligned to the CAEP, InTASC, OSTP standards. Superintendents were likewise surveyed to gauge their satisfaction with our principal program completers. The results of the 2020 Superintendent Satisfaction Survey indicate that 100% of participating superintendents believe our advanced program graduates are prepared in every leadership competency aligned to CAEP, NELP, and OSP standards.
Alumni achievement of employment milestones is gauged on our alumni satisfaction surveys at both the initial and advanced level. To gauge employment milestones for initial licensure alumni specifically, a new alumni satisfaction survey was constructed and sent to completers 2-5 years after graduation (graduates from 2015-2018). On this survey, the initial licensure alumni were asked the following:
- How many years have you worked at your current place of employment?
- Have you received any promotions throughout your teaching career?
- Have you already achieved or made progress toward attaining the next level of teacher certification/licensure in your state (i.e. professional-level or permanent certificate/license)
The data from the Initial Licensure Survey – 2+ years past graduation revealed that
- 62% have been at their current teaching position for 2 or more years
- 31.25% have received promotions
- 62% have you already achieved or made progress toward attaining the next level of teacher certification/licensure in their state
On the graduate or advanced alumni survey, the recipients were asked the following:
- How many years have you worked at your current place of employment?
- Have you received any promotions throughout your career in education?
The data from the graduate or advanced alumni survey indicates that 50% of advanced licensure completers have received promotions. They also report being at their current school for 1-6 years. This data is accessible here: Advanced Completers’ Employment Milestones.
MEASURE 4: Completer Satisfaction
Satisfaction of undergraduate, initial licensure completers was gauged through our annually distributed Initial Licensure Alumni Survey, which the 2020 graduates were invited to complete. The response rate for this survey was 49% and the results demonstrated that the education program has many strengths, as 90% or more of the survey completers indicated that they are on target or accomplished when it comes to the following:
- Use clear and correct written and verbal language that communicates content in a manner appropriate for students.
- Clearly communicate (via verbal and body language) expectations and confidence in students’ abilities to meet these expectations.
- Create a classroom environment that is both emotionally and physically safe by treating all students with respect and concern.
- Reflect on and evaluate teaching and student learning.
- Display professionalism and appropriate dispositions for teaching children.
- Takes responsibility for engaging in continuous, purposeful professional development.
A few areas of improvement were also noted, with about 30% of the respondents indicating that they were not on target in the following areas:
- Identify misconceptions related to content and effectively address them during instruction.
- Implement instructional strategies that promote the development of higher-order thinking.
- Provide opportunities and guidance for students to consider lesson content from multiple and relevant perspectives.
- Provide multiple opportunities for students to engage in self-assessment of learning.
The above areas of improvement were compared to those highlighted by alumni from 2015-2018 to see if any sustained trends emerged. There was only one instructional competency in which 30% of both 2020 alumni and those further removed believed they were not on target. This competency reflects the following ability and is captured in the data from the Initial Licensure Survey – 2+ years past graduation:
- Provide opportunities and guidance for students to consider lesson content from multiple and relevant perspectives.
This data will be shared with faculty at the 2021 Strategic Planning Session so appropriate changes can be made to better support candidates in this area.
A similar survey was sent to the 2020 completers of advanced programs (see Graduate Education Satisfaction Survey). The response rate for this survey was approximately 29%. The results revealed that the completers were 100% on target or accomplished in every competency evaluated, based on the preparation they received in the graduate education program.
MEASURES OF PROGRAM OUTCOMES
MEASURE 5: Graduation Rates
The graduation rate for education majors was analyzed by the office of institutional research for both undergraduates and graduates. The following points were observed at the undergraduate level:
- For students who start at Franciscan as an Education major, over the past six years on average, 45% graduate in four years with an Education degree. The five year rate is 48% and the six year rate is 47%. (The drop from year 5 to year 6 is due to using fewer cohort years in the calculation).
- For students who start at Franciscan as an Education major, over the past six years on average, 69% graduate in four years with and Franciscan University with a four-year degree (this includes those who complete an Education degree too). The five year rate is 75% and the six year rate is 77%.
- For students who start at Franciscan regardless of their starting major, over the past six years on average, 50% graduate in four years with and Education degree. The five year rate is 56% and the six year rate is 56%.
- While only 47% of students who enroll at Franciscan as an Education major actually graduate with an Education degree in six years, and additional 30% change their major and still graduate from Franciscan in six years. (This is the same as the average of all new FUS first-year students).
At the graduate level, the following trends were observed:
- Most candidates graduate within 2.5-4.5 years
(see Undergraduate and Graduate Education Student Graduation Rates)
MEASURE 6: Ability of completers to be hired in education positions
The initial level candidates’ OAE scores demonstrate their ability to meet licensing requirements. Collectively, the candidates at the initial licensure level demonstrated a 93% pass rate. For each licensure exam where the best attempt pass rate was less than 100%, only one candidate failed the exam. Since some content areas only have one to two test takers, one failure can drastically impact the pass rate percentage. As such, we look at the data for these smaller licensure areas over several years to identify trends. Given the outcomes from 2019-2020, there are no trends in OAE data that raise concern.
The advanced level candidates demonstrated a best attempt pass rate of 50% due to only two candidates taking the exam and one failing. The superintendent and principal licensure programs have been placed into dormancy due to low enrollment, so fewer and fewer candidates are taking the licensure exams. One failure can immensely impact pass rate percentages. Last year’s pass rate for advanced completers was 100%, so no trends have emerged that are a cause for concern.
(see Best Attempt Pass Rates for Ohio Licensure Exams 2019-2020).
MEASURE 7: Ability of completers to be hired in education positions
In the annual alumni satisfaction survey sent to initial licensure program completers, 76% of the respondents indicated that they are currently employed as a teacher. 100% of advanced program completers also state that they are employed in education either in Ohio or another state (see respective alumni satisfaction survey data links under Measure 4).
MEASURE 8: Student loan default rate
The student loan default rate for education completers (undergrad and grad) for the past three years is as follows:
2017-2018 – 4.08%
2018-2019 – 5.56%
2019-2020 – 0%*
*The main reason for the 0% default rate in 2019-2020 is because student loans have been in forbearance since March of 2020 due to the coronavirus.
