All Collections
Messly Community
Training Data
How the Training Navigator Works
How the Training Navigator Works

This articles explains how to use the Training Navigator and explains the methodology behind the scores

Support avatar
Written by Support
Updated over a week ago

How the Training Navigator Works

1️⃣ Choose your Foundation School. You’ll see the total rotations and total hospitals at the top of the page. You can change Foundation School later if want to check out another School.

2️⃣ Select a filter. The Specialty filter will show all the rotations grouped by Specialty. If you select Hospital from the menu you then see the rotations grouped by Hospital. You can then expand each group to see the rotations and their Scores.

3️⃣ Review Scores. Each rotation has a Workload Score, Satisfaction Score and Learning Score, plus an Overall Score. High and low ranked rotations are marked in Green and Red respectively. We also show you the rotation’s ranking out of all rotations in the Foundation School. See below for more information on these Scores and how they are calculated.

4️⃣ Rank and review. Rank the rotations by your chosen Score to see which rates highest and lowest in each area. Add your home address to see travel distances to the hospital from your home, via car or public transport.

5️⃣ Select your favourites! By clicking the heart icon next to a rotation, it will be added to your favourites. This allows you to build a collection of rotations that you’d like to preference on Oriel. You can see your list of favourites by clicking the menu, which is at the top of the page on mobile and on the left hand side on a computer. You can also download them to a spreadsheet using the ‘Download’ button.

Data, methodology and FAQs 📈

What is the source of this data?

The data is sourced from the GMC’s National Training Survey. The NTS asks trainees detailed questions about their experience of training in each of their rotations in that year. The data is then aggregated and shared with Messly to produce the Training Navigator.

Which doctors complete the National Training Survey?

Trainees at all levels are asked to complete the survey. Any doctors outside of training, such as locums, trust grade doctors and clinical fellows, are not eligible to complete the survey.

Why are some hospitals or rotations missing?

To be included in the NTS data, each rotation needs to have feedback from at least three trainees at that level of training (Foundation, Core or Higher). For example, in a more niche rotation where they are only two Foundation Trainees rotating through at any time, no data is made available. This is to avoid false conclusions being drawn on rotations with insufficient amounts of data.

What information is collected in the NTS?

For each rotation, trainees are asked to provide feedback on the following areas, called Indicators:

Adequate Experience

Clinical Supervision

Clinical Supervision out of hours

Curriculum Coverage

Educational Supervision

Educational Governance

Feedback

Handover

Induction

Local Teaching

Overall Satisfaction

Regional Teaching

Reporting systems

Rota Design

Study Leave

Supportive Environment

Teamwork

Work Load

Facilities

Why have you created Scores?

From speaking to doctors, we found that the raw data can be overwhelming, with up to 19 individual numbers for every rotation. The raw numbers also don’t give a clear indication of where that rotation stands relative to others...

We are often asked: What do these numbers mean? Is a Workload score of 43 good or bad? Is this better or worse than others?

So, we’ve crunched the numbers and broken them down in to four easy-to-understand Scores, as outlined below.

What are the Scores and what do they mean?

Each rotation is given four Scores:

  • Workload Score: This gives an indication of how happy foundation trainees in 2021 were with their workload. This is calculated primarily from the Workload indicator, plus the Teamwork indicator. The mean Workload Score is 59 and 14% of Workload Scores are above 80.

  • Learning Score: This gives an indication of the clinical learning, experience and supervision in the rotation. This is calculated from the following indicators: Adequate Experience, Clinical Supervision, Curriculum Coverage, Educational Supervision, Educational Governance and Induction. The mean Learning Score is 60 and 17% of Learning Scores are above 80.

  • Satisfaction Score: This gives an indication of how satisfied overall the trainees reported feeling. It’s calculated primarily from the Overall Satisfaction indicator, plus the Supportive Environment indictor. The mean Satisfaction Score is 60 and 17% of Satisfaction Scores are above 80.

  • Overall Score: This is an overall rating, comprised of a combination of the above three Scores. It therefore gives a general overview of trainee feedback, comprising their workload, clinical learning and satisfaction. The mean Overall Score is 62 and 14% of Learning Scores are above 80.

How are the scores calculated?

For each Score, Messly’s algorithm takes the relevant raw indicator data as explained above and applies weightings based on their relative importance to that Score. A further weighting is applied based on the variance of that rotation's data from the national mean, so Scores of high outliers are further boosted and vice versa. This helps doctors better differentiate between good and great rotations.

This data is then mapped from 0 to 100 along a normal distribution, with a Score of 100 being the best-rated and 0 the worst.

What is the rank?

Within each Foundation School, the rotations are ranked by their Overall Scores. This shows where that rotation ranks within the Foundation School.

What do the colours mean?

Scores over 80 are marked in green in the Training Navigator, and scores under 40 are marked in Red. This helps you quickly identify the best and worst rotations at a glance.

Does the Training Navigator include data for Core and Higher programmes?

Not at the moment. Currently the Training Navigator only includes‍ data for Foundation Training.

Are the scores always an accurate representation of the department?

Scores accurately represent the feedback from doctors in the GMC NTS in 2021.

In some cases there may only be a small number of doctors who have responded to the survey, so the scores may be disproportionately skewed high or low on the basis of a small sample size. We recommend taking this into account when making your final decision on ranking your rotations.

Did this answer your question?