Documenti di Didattica
Documenti di Professioni
Documenti di Cultura
Success
Lessons from EABs Latest Research
David Attis
dattis@eab.com
ROAD MAP
Thousands of pages of
task force
recommendations
Hundreds of new
student success
administrators
Hours spent in
campus meetings and
town halls
Countless
presentations on
improving completion
The Ideal:
Dedicated
High-Touch Care
Coordinated
Support Network
Case Management
and Tracking System
+ Early Identification
+ Academic support
+ Appointment nudges
+ Careful monitoring
+ Financial support
+ Referrer notifications
+ Proactive care
+ Social services
+ Shared records
Reality:
We Make Tradeoffs
Reality:
We Arent Coordinated
Reality:
We Dont Close the Loop
a second year
48% graduate
80 K
Number of Students
70 K
60 K
50 K
40 K
30 K
20 K
10 K
0K
0.0 - 0.2 - 0.4 - 0.6 - 0.8 - 1.0 - 1.2 - 1.4 - 1.6 - 1.8 - 2.0 - 2.2 - 2.4 - 2.6 - 2.8 - 3.0 - 3.2 - 3.4 - 3.6 - 3.8 0.2 0.4 0.6 0.8 1.0 1.2 1.4 1.6 1.8 2.0 2.2 2.4 2.6 2.8 3.0 3.2 3.4 3.6 3.8 4.0
First-Year GPA
2015 The Advisory Board Company eab.com
3.0
1
Problems appear
well in advance
of attrition
2
2.5
2.0
1.5
Academic
Probation
Term 8
dropouts
Term 10
Term 9 dropouts
Term 12
dropouts
Term 4
dropouts
dropouts
Term 11
Term 6
dropouts
dropouts
Term 7
Term 3
dropouts
dropouts
Term 5
dropouts
3
What other key
indicators should
we monitor?
Four-year graduation
Persistence
Data We Need
Real-time student
performance
Attendance
Grades
Support service
interaction
# advising interactions
Tutoring appointments
Process
completion
Registration
FAFSA completion
Interim
outcomes
Term-to-term persistence
Term GPA change
Registration
2.2
Term GPA
Exam grades
Class attendance
ROAD MAP
1
Collective
DecisionMaking
4
Individual
Contribution
Remove Curricular
Barriers to Completion
Enhance the
Learning Experience
Sustaining Momentum
Through Structured
Accountability and Incentives
Redesign
Academic Policies
Flag Signs of
Student Risk
Support Evolving
Advising Models
Mentor Rising-Risk
Student Groups
Targeting faculty
engagement efforts toward
students lacking a strong
connection to campus
10
1
Collective
DecisionMaking
Individual
Contribution
1.
Remove Curricular
Barriers to Completion
DIY Enrollment Analysis
Platform
2.
3.
4.
Enhance the
Learning Experience
2
5.
Redesign
Academic Policies
Academic Policy Audit
Flag Signs of
Student Risk
Support Evolving
Advising Models
6.
7.
8.
9.
Mentor Rising-Risk
Student Groups
12. Effectiveness-Focused
Feedback
Sustaining Momentum
Through Structured
Accountability and Incentives
15. Leadership
Scorecards
17. Departmental
Performance
Dashboard
11
Departmental decisions
ignore impact on progression
Desire to ensure
quality of students
admitted to major
Desire to be
inclusive and build
broad consensus
Emphasis on open
experimentation and
small-scale pilots
12
1
3
13
1
Collective
DecisionMaking
Individual
Contribution
1.
Remove Curricular
Barriers to Completion
DIY Enrollment Analysis
Platform
2.
3.
4.
Enhance the
Learning Experience
2
5.
Redesign
Academic Policies
Academic Policy Audit
Flag Signs of
Student Risk
Support Evolving
Advising Models
6.
7.
8.
9.
Mentor Rising-Risk
Student Groups
12. Effectiveness-Focused
Feedback
Sustaining Momentum
Through Structured
Accountability and Incentives
15. Leadership
Scorecards
17. Departmental
Performance
Dashboard
14
Course Planning
Withdrawal Process
Registration Holds
Enrollment Status
Departments plan
sections one term at
a time, limiting longterm planning
Multi-term scheduling
Withdrawal surveys
Emergency Grants
Automated advising
prompts walk students
through consequences
and campus resources
3% retention gain at
Cleveland State
University
40% of students
starting survey
retained at Penn State
15
1
1.
Policies Every
Institution Should
Change
Add course withdrawal
advising prompt
2.
3.
Calibrating Rules
to Student Need
1.
2.
3.
Graduation requirements
4.
Registration holds
Critical Analyses to
Identify Barriers
1.
2.
Coordinating pre-requisites
and course sequencing
3.
Example Guide:
Example Guide:
Example Guide:
Re-enrollment campaigns
16
1
Collective
DecisionMaking
Individual
Contribution
1.
Remove Curricular
Barriers to Completion
DIY Enrollment Analysis
Platform
2.
3.
4.
Enhance the
Learning Experience
2
5.
Redesign
Academic Policies
Academic Policy Audit
Flag Signs of
Student Risk
Support Evolving
Advising Models
6.
7.
8.
9.
Mentor Rising-Risk
Student Groups
12. Effectiveness-Focused
Feedback
Sustaining Momentum
Through Structured
Accountability and Incentives
15. Leadership
Scorecards
17. Departmental
Performance
Dashboard
17
Complex
Success Coaches
I dont fit in and Im
stressed at work
I cant afford to
finish my degree
Transactional
Faculty
I need a new
ID card
Which subfield
should I study?
I want to
switch majors
I need to
pick a major
I need to register
for classes
Academic
Advisors
Self-Service
Non-Academic
Academic
18
1
Collective
DecisionMaking
Individual
Contribution
1.
Remove Curricular
Barriers to Completion
DIY Enrollment Analysis
Platform
2.
3.
4.
Enhance the
Learning Experience
2
5.
Redesign
Academic Policies
Academic Policy Audit
Flag Signs of
Student Risk
Support Evolving
Advising Models
6.
7.
8.
9.
Mentor Rising-Risk
Student Groups
12. Effectiveness-Focused
Feedback
Sustaining Momentum
Through Structured
Accountability and Incentives
15. Leadership
Scorecards
17. Departmental
Performance
Dashboard
19
Most Faculty Familiar with Innovations, But Avoid Trying Them Out
A Growing Comfort with
Tech-Enhanced Teaching
60%
78%
Of faculty say
the LMS
is a critical tool
to their
teaching
Of faculty have
a growing
interest in
using tech in
teaching
A Form of Empowerment
Faculty are starting to see
their own embrace of
technology as a form of
empowerment.
Matthew Rascoff,
University of North Carolina
Familiar but
havent tried
Tried
Adopted
Clickers and
other real-time
feedback
11%
64%
10%
12%
Interdisciplinary
team-teaching
13%
63%
12%
10%
Hybrid courses
8%
58%
11%
20%
Fully online
course
9%
57%
7%
24%
Online
collaboration
tools
9%
56%
12%
20%
Experiential or
service learning
14%
49%
13%
23%
Flipped
classroom
6%
47%
17%
29%
Technique
20
Investment Risk
21
Harnessing
Grassroots Activity
Channeling Efforts
to Priorities
Sustaining What
Works
Pedagogical Risk
What if it doesnt work?
Professor integrates active learning into her class. Students fail to
engage productively and learning suffers.
Technological Risk
What if it breaks?
Professor purchases student-response clickers and builds lessons
around them. The clickers malfunction en masse mid-lecture.
Social Risk
What if my peers disapprove?
Professor moves lectures online and uses class time for peer
instruction. Colleagues doubt effectiveness and reputation suffers.
22
23
Pedagogical Risk
Technological Risk
Social Risk
Empower faculty
members to reward their
peers innovations
Broker semester-long
mentoring relationships
between faculty
24
1
Collective
DecisionMaking
Individual
Contribution
1.
Remove Curricular
Barriers to Completion
DIY Enrollment Analysis
Platform
2.
3.
4.
Enhance the
Learning Experience
2
5.
Redesign
Academic Policies
Academic Policy Audit
Flag Signs of
Student Risk
Support Evolving
Advising Models
6.
7.
8.
9.
Mentor Rising-Risk
Student Groups
12. Effectiveness-Focused
Feedback
Sustaining Momentum
Through Structured
Accountability and Incentives
15. Leadership
Scorecards
17. Departmental
Performance
Dashboard
25
1
In an advising office
1.6
Powerful predictive
metrics right under
our noses
In response,
extensive deployment
of early warning
systems in higher ed
225
In a classroom1
74%
Public
Universities
In all cases analyzed, midterm and firstexam grades strongly predicted final grades
Midterm and final grades were also
strongly correlated in a variety of other
academic disciplines at the liberal arts
college, including the humanities, the social
sciences, and the fine arts.
James Barron & Philip Jensen
Journal of College Science Teaching (2014)
78%
Private
Universities
68%
Community
Colleges
Source: Mississippi State University Pathfinders Program; James Barron and Philip Jensen, Midterm
and First-Exam Grades Predict Final Grades in Biology Courses, Journal of College Science Teaching
(Nov/Dec 2014); What Works in Student Retention, Habley et al. (2010); EAB interviews and analysis.
26
Making it Simple
Single Referral
Faculty given option
to suggest specific
response, but able
to send all alerts to
single office
Target High-Risk
Courses and Students
Focus compliance
efforts at highestimpact populations
All-Inclusive
Includes Assistants
Positive Messaging
Follow-up
Faculty, advisors,
RAs, and support
staff able to submit
alerts, but full
access limited
Students encouraged
to take clear action
steps, rather than
simply alerted of risk
Faculty informed of
alert receipt, as well
as progress and
resolution of cases
Faculty able to
decide whether and
how to get involved
with student issues
27
Week 6
Typical: Standard
early grade deadline
Faculty determine examination and
grade that constitutes on track
A
Office hours
Supplementary
instruction
Tutoring center
Departmental resource
28
1
Collective
DecisionMaking
Individual
Contribution
1.
Remove Curricular
Barriers to Completion
DIY Enrollment Analysis
Platform
2.
3.
4.
Enhance the
Learning Experience
2
5.
Redesign
Academic Policies
Academic Policy Audit
(Resource Preview)
Flag Signs of
Student Risk
Support Evolving
Advising Models
6.
7.
8.
9.
Mentor Rising-Risk
Student Groups
12. Effectiveness-Focused
Feedback
Sustaining Momentum
Through Structured
Accountability and Incentives
15. Leadership
Scorecards
17. Departmental
Performance
Dashboard
29
30
Biology
Anthropology
Expected
Actual
Score
2.0
381
518
0.74
1.0
201
173
1.16
Student Progression
1.
Internships
1.
2.
Intercultural immersion
2.
3.
3.
4.
Advisee satisfaction
4.
31
ROAD MAP
32
Tighter Resources
No longer able to fund all existing
activities to the same standard
Increased Competition
Pressure to improve
outcomes and reduce costs
Raised Ambitions
Strategic goals require
significant investments
Increased Volatility
Rapidly shifting patterns
of demand
More Accountability
Imperative to demonstrate
performance improvement
33
34
Space
Utilization
Course
Offerings
Course
Success
Curricular
Complexity
Faculty
Workload
Identify course
access
bottlenecks
Consolidate
underutilized
sections
Expand
bottleneck
courses
Simplify degree
requirements
Maximize
capacity
utilization
Better leverage
existing space
Reduce number
of small courses
Limit high-DFW
courses
50%
33%
20%
30%
60%
Classroom
Utilization
Underutilized
Sections
Attempted Credits
Not Completed
Students
Graduating with
Excess Credits
Faculty Teaching
Less than
Standard Load
Reduce niche
course offerings
Differentiate
faculty
workloads
35
95%
90%
73%
69%
97%
97%
100%
72%
58%
64%
47%
Acc201
Bio101
Psy200
36
Min Credit
Hours
Required
Curricular
Efficiency
Longest
Course
Sequence
Bottleneck
Courses
University A
180
133
4.6
University B
148
120
2.5
University C
168
128
2.6
37
Instructional Capacity
(# of courses offered x max class size)
Course
Releases
Small
Classes
Course Registrations
(actual course enrollments)
Course Completions
(credits earned)
Underfilled
Sections
DFW
Rate
38
Efficiency Guardrails
Resource
Target
Options
Classroom Scheduling
Non-Standard Class
Meeting Pattern
Class Size
Faculty Utilization
= 120
39