Guidance in evaluating PKB

Owned by Mohammad Al-Ubaydli
Oct 22, 2022
3 min read

Although we will be very happy to assist you, we suggest you think along with the themes of adoption and usage of the technology, some clinical and operational benefits you have created, and the financial impact of these benefits. These themes are outlined below with examples of the type of data you can easily collect to quickly and simply demonstrate the impact of the work you do. 

Adoption

Adoption of technology by both patients and professionals help improve the digital maturity of your service and organization. This can lead to transformations in the effectiveness and impact of the care you deliver.Metrics

  • PKB records created, registered for and active (patient and professional)

  • Participation rate (accounts offered to patients/ team professionals: accounts registered for)

  • Network effect (non-team users, carer users (when available))

Data source

Usage

Data on PKB usage helps deliver intelligence on how and what parts of your service your patients, and provides evidence of the support you provide through technology over a 24 hour period and a 7 day week. Feature use is messages sent, symptoms, files loaded, etc.

Metrics

  • Activity by patients and professionals

  • Visits over 7 day week

  • Visits over a 24h period

  • Session times on PKB

  • Feature use on PKB

Data source

Clinical and operational benefits

Both patients and professionals will have experience of the impact using this technology have made to health and the service provided. It is important to capture these experiences and objective evidence of clinical and operational perceived benefits.

Metrics

  • Clinical quality benefits

  • Clinical effectiveness benefits

  • Impact on burden of disease

  • Impact on self-management 

  • Improvement in the patient-provider relationship

  • Patient engagement & activation

  • Patient outcomes

Clinical quality themes:

  • Reduction in medical errors/ improvement in safety/ avoidance of harm

  • Medication adherence

  • Accessing different services/ meeting national guidelines

  • Improved control of disease

Clinical effectiveness themes:

  • Reduction in unplanned and urgent admissions

  • Reduction in unnecessary appointments (routine follow-ups, waiting times)

  • Reduction in unnecessary costs (less paper being used and mail costs)

  • Improvement in productivity (less wasted time, unnecessary appointments, test results communication, the right information at the right time)

Data source

Baseline and post-PKB deployment data collection for all metrics

  • User surveys 

  • PROMs

Financial impact & value for money

The financial impact can be described in terms of cost savings. Value for money describes the greater value that is delivered through an improvement in the productivity, safety, quality, and effectiveness of care as a result of the digital transformation when patient-controlled electronic health records are used.

Financial impact (savings)

  • Reduction in A&E attendances

  • Reduction in admissions

  • Reduction in GP contacts (telephone/ face to face)

  • Reduction in DNAs

  • Reduction in unnecessary tests & procedures

  • Reduction in costs (going paperless)

Value for money

  • Reduction in medical errors

  • Medication adherence

  • Better quality care (% cases meeting national guidelines)

  • Improved control of disease (% cases meeting national guidelines)

  • Improved patient engagement & activation

Data source

  • User surveys, for example, "How many unplanned GP contacts have you had in the last 30 days?"

  • HES data

  • SUS data

  • GP data

  • Process and cost mapping pre and post “paperless”

  • Literature on cost savings generated on themes in ‘value for money’ metrics