Trust and Policy Implications In Predictive Modeling

Problem

Approach

Interviews

Insights

Outcomes

Conclusion

Our objective was to identify key trust and policy implications for the use of a platform known as
the Knowledge Grid (KGrid). Intended for use in healthcare settings, KGrid is an online repository
of predictive models aimed at accelerating the time frame it takes medical research knowledge
to become common practice.

We utilized a human-centered design approach to explore our problem space including interviewing stakeholders, conducting secondary research, and leveraging design methods. For our design process we utilized the Double Diamond method focusing primarily on future strategy recommendations.

1

2

3

4

5

6

7

Expert
Interviews

Secondary
Research

Primary
Interviews

Public
Survey

Market
Analysis

Data
Synthesis

Final
Report

We conducted 52 interviews targeting stakeholders from diverse professional backgrounds including clinical providers, predictive model developers, healthcare administrators, IT personnel, and ethicists. Our interviews focused on gaining a deeper understanding of stakeholder workflow, experience with predictive modeling, and concerns regarding the use of clinical decision making tools to determine the desire for KGrid. 

Early in the interview process we came to realize our participants were unable to clearly identify their own trust factors for evaluating predictive models. To supplement our interviews, we developed a generative research tool we call a Model Persona. 

Used as a prompt for participants, the card assisted in gathering deeper insights into how clinical providers evaluate and trust predictive modeling tools in current practice. We entered each interview with four of these cards, all with varying information (e.g. varied patient population, levels of validation, different reviews, different institutions, and varied update date). We then displayed one card at at time and asked our participants to identify anything negative or untrustworthy.

It became evident clinical providers have a clear and consistent process to vetting and trusting predictive models. The following describes the stages with which a clinician evaluates a model:

To articulate both the trust and policy barriers to implementing predictive models with the use of KGrid, we created a model journey map. This map shows the journey a health institution must take to create, verify, and implement a predictive model. Each stage describes the action needed to be taken and the roles involved. The content for this map was collected during our primary interviews. 

Process photos of Model Journey Map. 

Throughout the model journey map we placed personas to articulate the roles, responsibilities,
and preferences of key stakeholders. Personas were also utilized as a research tool to aid in our understanding and development of the proposed governance model.

Personas developed collaboratively. Co-designed by Katherine Jones and Sam Bertin 

For the implementation of KGrid, interviewees emphasized the need for mechanisms to ensure platform security. Expectations remain for the KGrid team to provide leadership in the establishment of early forms of governance until a formal multi-disciplinary governing body can be established. We developed a proposed governance model to be rolled out in three phases over the course of KGrid growth and future development.

We presented our final recommendations to our partners, the KGrid team, and stakeholders from DHLS and Michigan Medicine. Both our partners and the KGrid team are working towards incorporating our recommendations into the future development of KGrid.