Documenti di Didattica
Documenti di Professioni
Documenti di Cultura
Executive Summary
Results
We're excited to work with Code for America to find the right technological tool that people
can use to avoid being re-arrested.
Case managers who use ClientComm on most of their caseload report time savings that can now
be spent directly serving clients, rather than engaged in phone tag or tedious manual data entry.
Overall, its meant an increase in average client communications which has enabled case
managers to develop better relationships with clients between formal visits, which has enabled
trust to be cultivated, leading to more impactful relationships.
Investing in better understanding the problem through user research make sure we constantly are
moving closer to addressing the problem rather than deciding on what to build in isolation without
talking to the people we are creating services for.
Start Small & Ship Early
Make something small and get feedback. Testing your ideas in the roughest form or prototype allows
you to do invest the least amount of time and resources possible to learn an idea warrants further effort.
You can try a lot of things quickly and cheaply and have confidence on what to invest time in.
Data Driven Development
Measure impact, and use this as validation for next steps based on summary statistics and insights
gathered through observed user behavior.
Human-centered Development
User needs establishes metrics and bring users into the development process. They are closest to the
problem and its nuances. Bringing in diverse opinions is the best way to see the whole picture.
Create in the open
Document your work. It shows your decision making process transparently. This builds trust with users
and enables others to observe and follow your progress and decision making.
Clients fail for a variety of reasons, and forgetting to appear in court is but a small portion
of the total number of reasons for failure.
Clients can fail long before they can even FTA, and these reasons largely stem on poor
communication practices on the part of CJS (Criminal Justice Services) - practices that
case managers themselves are well aware do not meet clients where they are.
Character Attributes
Attributes Distribution
Research Observations
1.
2.
3.
4.
5.
6.
7.
Clients use of technology varies, but SMS phone possession and text message use is high.
Case managers can spend hours in a day trying to contact with them through limited
methods.
Competing supervision requirements for multiple charges can cause failure-to-appears.
Competing supervision requirements for multiple charges can cause failure-to-appears.
Some have no problem with remembering court dates, but may have logistical barriers
such as schedule. conflicts or have no place or people to leave their children with. Some
clients are struggling to overcome addiction. Some are jaded by the system.
Different clients have a different reminder methods including smartphone apps, physical
and digital calendars, parents/friends, and reminder cards on the fridge.
If a client with mental health issues are not at Jail long enough they wont get doses of
their medication and may lead to them showing up at Criminal Justice Services off their
medication.
Research Takeaways
I just wanted to know what is going to happen next. I want to do the right thing.
- Client, Criminal Justice Services
Complexity in the system and lack of clear information can make it hard for a client to comply
with their supervision.
Every client comes a different kind of need. You treat each one is a separate
waysome that need more encouragement some that need more guidance.
- Case Manager, Criminal Justice Services
Attitudes toward supervision and barriers to compliance are differ depending
upon the individual.
For mental health clientsthey always forgetgive information to a caregiver, that
is who you give the information to. - Case Manager, Criminal Justice Services
Mental health clients can can struggle to understand supervision requirements,
remember appointments.
Process Mapping
Prototyping
Rinse and repeat, not, scope and implement.
Try many small things and invest in only those that show promise. Constantly delivering on
the ideas that have data showing value changes the conversation from convincing why
something should be done one way to debating active use, and whether results merit
continued investment.Why this works; Constant feedback loops allow low investment efforts
at each stage. This allows you to approach the problem from many angles with low
investment.
Process: Workshopping
We created environments and held workshops that
convened people who are usually rarely are in the same
room. For example, at our Alpha presentation we had
supervision case managers to non-profit staff, police
officers and people from the mayors office all in the same
room, brainstorming solutions to better support clients
engaged with the criminal justice system. We also engaged
case managers throughout the development process to be
a part of what was built. It was through their comments
and criticisms that we decided exactly what to build next.
Probation Diagram
Pretrial Diagram
Continuous
Evaluation Exercises
Experiments
As we worked to help improve clients connect with their case managers easier with
ClientComm, we were also looking at other ways to can help clients succeed through their
supervision. Our Beta presentation has a great overview of all the other projects we started
that did not succeed.
Form Redesign
Weve heard many times throughout our research how complex
the justice system is and part of this complexity is the density of
information presented to individuals under supervision. This
Supervised Release Agreement spells out what they needs to do to
get through supervision and avoid arrest.
Blog post
Blog Post
Tracking progress
Common communication between clients and case
managers revolve around where clients are in their
supervision timelines and what they need to do and when
to avoid committing a technical violation (violating an
order of probation) that could send them back to jail.
We conducted nine interviews with supervision clients to
understand how they make schedules and track their
progress towards successfully completing their
supervision. While we did not get beyond surfacing how
clients think about and understand progress tracking, this
is an area that might assist clients getting to court or other
supervision appointments.
Product Development
Determining Value
With each endeavor, the team focused first on identifying
a singular functionality that was desired by our users
and could move us closer toward identified solution
opportunities. This core function would be implemented
in its most rudimentary form and deployed. Use of that
function was then measured. For example, if a button was
desired, a button was deployed. The number of times this
button was used (e.g. clicked) would indicate it's success or
failure in addressing a need.
Messaging Volume
+ Feature Releases
Iterations
Our development cycle iterations correlated with substantially greater and greater utilization of
the tool. Today, in our final version (Version 4.0.0+), we can see a drastically increased average
daily population over nearly 1,000 clients, most engaged in active weekly conversation with their
case managers. In addition, we have brought nearly 1,500 clients as of writing into ClientComm,
representing a vast majority of all clients that were taken into Criminal Justice Services over the
months that the tool has been in action, particularly since Version 3.0.0 was rolled out at the top
of the summer in 2016.
For other relevant content, the Tumblr blog is always a terrific resource. In addition, the
utilization graph on the main page of the website is also a solid way to see a sort of before and
after from when there was no messaging to now when there is. In addition to all of this, our
main stage presentation at Code for Americas Summit does a summary synopsis of how case
managers worked before ClientComm and then after it. You can view that here. A relevant note
from that presentation was that we can demonstrate from our research that case managers who
utilize ClientComm on a majority of their caseload can save in excess of 5 hours per week in time
spent doing tedious tasks related to data entry, chasing bad numbers, and leaving voice mails.
This is time that can be now spent directly serving clients in need.
1.0
2.0
3.0
4.0
Measures of Success
Measures of Success
We have only begun to dive into measuring the total
impact of ClientComm. Some summary results are
included in the final presentation (video on Youtube), but a
deeper dive is partially under way and the efforts related to
it have been logged in this Google document. Some key
figures cited in the video that are more summary and dive
less into the impact side of ClientComm and focus instead
on its growth include these figures:
Results Metrics
1.
Over 85% of all case managers in CJS have
been onboarded onto the tool
2.
55-60% of those case managers use the tool
on a dear daily basis
3.
Nearly 1,500 clients have been
communicated with via ClientComm at the
time of this writing
Hours Saved
Weekly,
per case manager
Communication
Frequency
Increased from once
monthly to twice weekly
Increased Success
Clients
Staff
Pretrial Clients,
March - October 2016
annual client
population have used
ClientComm
Summary Statistics
Benefits of ClientComm
Improves compliance
Benefits of ClientComm
Saves time
Benefits of ClientComm
Improves Communication
User Stories
Client
Case Manager
Partnerships
Collaboration takeaways
Development Hurdles
County accessibility
Service deployment can make using off the shelf tools hard
Limited data access
Connecting to data at the county was the biggest issue we ran up against. There
was a gate keeper whos the only one with access to data we need to quantify our
success. We were also stymied by HIPAA concerns rom exploring ideas that would
have addressed the problem from a bigger perspective. APP and SLC PD were
waiting for us to show a final product before they would engage.
Conclusions
Employment, jobs, housing and health are all factors that can make it hard for people
involved in the justice department to become stuck. Addressing any of these issues can
help citizens move beyond incarceration and recidivism.
Technology cant solve social problems. It can only reduce barriers for people to engage
with each other. ClientComm works because it makes communication easier, and gives
back time in a case managers day to focus more or each client.
The success of this project showed us that its always worthwhile to return to our
customer, the constituents we serve, to gain insights and improve services. - Beth
Mitchell, on our human-centered design approach
Small multi-discipline teams that include technical design and development expertise are
an efficient way to quickly prototype and refine a product. Pairing this with a human
centered design lead research process that has at its core empathy for the citizen (end
user) whose experience they are hoping to improve is a great way to solve problems with
technology.
Collaboration, humility, openness and respect for different working styles are the key to a
good fellowship experience for the fellow and leads to a quick and productive year.
Project Documentation
Technical documentation for ClientComm is pending. A
refactor towards the end of the Fellowship period in August
through mid-October resulted in much of the prior
documentation becoming irrelevant. This documentation
is scheduled to be produced over the remainder of
November and December.
Resources
Public Sites
ClientComm Site
clientcomm.org
c4a-slc.tumblr.com
Repositories
Github Organization
github.com/slco-2016
ClientComm repository
github.com/slco-2016/clientcomm
Research Reporting
Research Synthesis
c4a.me/slco-alpha
slco-2016.github.io/q1_report_long
Development Process
c4a.me/slco-beta
Self-reporting & transparency
scribd.com/collections/16737272/Cod
e-for-America-Team-Salt-Lake-Count
y-Weeklies
Data Dive
docs.google.com/document/d/1T2hlv
em7KOj2xLGJDgWJyOgMQVHnWXnz8
vd4HF9i7qc