Coach assist
improved coach to apprentice reviews with AI supporting throughout
Deeper conversations
Increased productivity
Improved job satisfaction
An apprenticeship coach at BPP guides learners through their studies with tailored, proactive support delivered at the right time and level. For BPP and their apprentices, the coaching model is a critical component of apprenticeship success.
Coaching is about as human of a role as they come, heavily reliant on a trusted, open and empathetic connection between the coach and their apprentice. But what happens when various challenges get in the way of a human coach being their best human self?
In this article we'll address the escalating list of challenges that coaches faced in their day-to-day roles and explore how the Product & Technology team helped to utilise Human-centered Design & technology to allow the human side of coaching to shine bright.
background
Coaches across various schools at BPP conduct apprenticeship progression review calls with their apprentices (and sometimes the employers) at various cadences over the duration of the programme.
Coaches conduct their calls remotely (mainly through Teams), spending around an hour discussing the apprentices progression through the programme and coaching them on how to best evidence the appropriate workplace skills and behaviours as required by the apprenticeship standard.
During these calls, coaches would be expected to manually record notes of the conversation and any observations so that they could then later write up an official progress review report to share with the apprentice and their employer.
Sounds simple right? Well, keep reading below to find out why this daily task became one of the highest priorities within the business for the team to address.
A call for help
"The report platform is too unstable"
"We're getting too many support tickets"
"We can't support this for much longer"
"Clients are complaining, we need to act now"
"We're losing coaches and can't lose any more"
Discovery mode activate
Discovery goals :
Map & understand the AS-IS progression tracking service across all schools within BPP
Design and define the near and far service vision
Journey mapping to identify the users, platforms and pain points of an end-to-end experience/service
Introducing the Coach
“I utilise my industry knowledge and desire to help others to ensure learners have everything they need to get through the programme & progress in their careers"
6 pain points felt by coaches
-
Coaches are at full capacity all/most the time. Generally always fighting to keep on top of admin tasks.
Coaches feel like they spending lots of their time performing tasks that are unnecessary or outside of their role responsibility (e.g. inputting assessment data, managing fixed student data, file management, student admin support)
Too much time is spent in progress reviews covering compliance topics. Not enough time to provide the coaching quality that they desire.
"We can't fit everything into those progress reviews that I would like to deliver"
"You can't quite clear it all in a day unless you're willing to sit there of an evening and catch up. So some weeks you can get to the end of the week and think, I haven't done it, I just haven't done it all and it all has to roll over.”
-
Too many manual, time consuming and technically painful tasks which are prone to human error and costs them valuable time that could be spent coaching learners
Coaches are required to use too many systems which don't talk to each other, adding extra time and stress to their workloadDescription text goes here.
"none of this should be done by a human being anyway... why does a human being need to move a file from a folder in 2024?”
"there's such a large room for error when you are manually putting numbers in against a module in Global Tracker"
-
PowerBI data quality is poor, unreliable and not up-to-date.
Coaches spend extra time going through various systems to find data 'at source' and inputting that data into their own tracking systems.
Pressure is put on coaches by Performance Managers and Relationship Managers to justify missing or incorrect out-of-date data that others are seeing in PowerBI reports.Description text goes here.
"Why in this day and age is the data not updated every night?...it's crazy... There's no reason for the data to be two or three days old."
"...we get in trouble because [management] have tried to run a report on it ... then they send out these management reports and we look at it and go, that ain't right."
-
Global Tracker's stability, performance, and UX causes major issues for coaches.
During downtime, a manual workflow is essential to keep up with review quota, but this builds a large backlog of administrative tasks that falls on the coach to catch up on.
Given the poor experience using Global Tracker, often this manual workflow is the preferred, safer, more reliable and more user friendly option that allows coaches to produced higher quality output, even if Global Tracker is up and running!Item description.
"When GT goes down it's an absolute nightmare... last year it went down for a number of months.
That caused absolute carnage... everyone worked so hard to try and keep the data in as good a position as we could and then work hard to get it [into GT] right"
-
Approach to tracking of KSBs does not give a coach meaningful view of learner progress.
Scoring model & KSB criteria is too vague and subjective. "Has to be by gut feel"
Tracking KSBs was regarded as a tickbox exercise for regulation.Item description.
"How our learners are progressing against KSBs is non-existent because we don't have a definition of what progress should look like"
"KSB criteria is vague and subjective"
-
Coaches felt 'thrown in at the deep end' when they first started using Global Tracker, needing to 'move slowly' to avoid making mistake with live data. Often not really knowing if they were doing their job right or not.
Coaches reported inadequate & inconsistent support from supporting back stage functions causing delays and knock on effects on data quality and additional admin (eg. waiting inconsistent time to get student data updated in PICS)Item description.
"I'm working with live learner data... I better do this very slowly just in case I make a mistake. That's impacted my work."
"I've been here like nearly two years. I've never really been a hundred percent if I'm doing it right"
In words, here's a way to summarise the challenges that we discovered the coaches were facing:
Constant time pressure
+ repetitive manual tasks + multiple inefficient systems
+ growing backlog of data entry
=
Human error,
bad data, increased stress & lower quality of service
Storytelling the problem space
It's all well and good if the core discovery team understood the problem space like the backs of our hands, but what was really important was that our stakeholders across the business could also understand the problems from within the service.
We produced and played back a series of illustrated storyboards to the key stakeholders, scattered with QUAL and QUANT research insights and direct quotes from the various actors.
With the problem space nice and clear and our stakeholders believing our work was credible, it was time to start problem solving.
Using a set of How Might We statements, we ran internal ideation sessions to start to draw out initial ideas from core team members
solution space
With the problem space nice and clear and our stakeholders believing our work was credible, it was time to start problem solving.
Using a set of How Might We statements, we ran internal ideation sessions to start to draw out initial ideas from core team members.
Using a set of How Might We statements, we ran internal ideation sessions to start to draw out initial ideas from core team members.
iterative concept creation
And the winner is…
notes assistant
An optional assistant transcribes live progress reviews, providing a hands-free written record of the conversation.
This provides Coaches with more time to focus on the discussion at hand.
Coaches can choose to instantly generate summaries from the transcript and auto-fill sections of chosen review templates.
They can then edit, add and format as they like with standard word processing capability such as spell check, text styles and undo functions.
They can quickly identify and remove the details of any sensitive information from the progress review reports. Coaches can optionally save sensitive information into a private notes file, only visible to other coaches and certain BPP teams.
expected value
“Take my money, this is gold”
“This would free up so much typing time and give much richer conversations”
“It allows you to focus on the conversation and supporting the learner”
Problem
Opportunity
Expectation
Mission & Goals
12,500 Coach reviews with Apprentices are conducted every 12 weeks.
Coaches have 1 hour to discuss progress, tasks, action points and failures with Apprentices. Coaches must:
write-up the discussion as it’s being conducted
define action points
display empathy to the apprentice
all without exceeding the time-slot
Coaches no longer feel the satisfaction of their role if they’re unable to have deeper more constructive communication with apprentices all while trying to adhere to common standards between schools.
This is leading to poor reporting and high churn of Coaches across all four schools.
50,000 reviews conducted in BPP alone per year across 300 coaches. Increase the pass rate and course satisfaction of Apprentices while also reducing the cost of rehiring Coaches.
This can save the business £500,000-£1,500,000.
NPS score to increase by 0.5
Significantly reduce the overheads and time pressure for coaches. Find ways Coaches and Apprentices can have more meaningful conversations and automate the laborious parts of these review sessions, both coaches and apprentices are extremely time-short.
BPP’s vision is to become a global provider of professional education. Supporting a new generation of learners.
Goals assigned to this project:
Increase number of new clients
Lower support costs
Improve quality of learning
Enable valuable connections
Introduction of LearnWise
Collaborating with the Director of Gen AI, this project coincided with the partnership of LearnWise, an AI support platform for educational institutions.
Birth of the Tutor and Coach portal
Prior to this project the Tutor and Coach portal didnt exist. All details from Coach and Apprentice reviews was saved on Word and Excel documents without any clear standards for reporting between schools.
Measuring the As-is experience 🤦♂️
There were almost no viable statistics or data we could map to show a true reflection of the As-is state and mapping value into the To-be state. We had to try and estimate, with ranges, the value of increased empathy between Coach and Apprentice. Furthermore, we found a wide range of speed and ability between Coaches when it came to conducting reviews. Some were very tech-savvy and adopted plug-ins and other tools whereas other were slow at typing and found juggling multiple tasks a significant drain on cognitive load.
User testing
Conducted with Apprentices and Coaches
The first round of user testing was particularly successful with Apprentices finding the clarity of actions points of most value.
However…
We experienced extremely high levels of skepticism from Coaches. This was one of the first AI led products for BPP and the market at the time was displaying a general unease around any AI functionality.
now coaches can coach and apprentices feel heard
Time to write up review
Avg. 19mins
Saving 23mins per review
That’s an annual saving of 19,166 hours or the equivalent of:
the time it took for Carlos Alcaraz and Jannik Sinner to become pro tennis players
learning Cantonese almost 9 times
a coach earning £670,000-£1.2M
Here’s to the team involved 👏
Director of Gen AI
Senior Service Designer
Senior Product Designer
Head of Product Design
Principal Data Analyst
Senior User Researcher
Head of Engineering
Principal Engineer
Senior Engineer
Senior Engineer
Software Engineer
Dean of the School of Technology
Dean of the School of Nursing
Dean of the School of Law
Head of Staffing
Principal Product Manager
Business Analyst
Business Analyst
Engineering Architect
Senior Cyber Security Engineer
Data Engineer
Apprentice Coach
Apprentice Coach
Apprentice Coach
Apprentice Coach
Apprentice Coach
Apprentice Coach
Apprentice Coach
Apprentice Coach
Apprentice Coach
Apprentice Coach
Apprentice Coach
Apprentice Coach
Apprentice Coach
Apprentice Coach
Apprentice Coach
Apprentice Coach
Apprentice Coach
Apprentice Coach
Apprentice Coach
Apprentice Coach
Apprentice Coach
Apprentice Coach
Apprentice Coach
Apprentice Coach