WBA Process Flows: MSF, MCR, and 360 Reviews
This document describes the process flows for the three multi-source assessment types in PPP, covering who initiates, who reviews/completes, data model requirements, user journey steps, and differences between the types.
Assessment Type Summary
| Aspect | Multi-Source Feedback (MSF) | Multi-Consultant Report (MCR) | 360-Degree Review |
|---|---|---|---|
| Purpose | Quarterly 360-degree feedback on professional skills | Structured competency assessment by multiple consultants | Anonymous colleague feedback for appraisal evidence |
| Who initiates | Trainee (creates and submits) | Trainee (creates and submits) | Trainee or supervisor (creates and invites reviewers) |
| Who completes | Multiple assessors (consultants/supervisors) | Multiple assessors with one educational supervisor | External reviewers (colleagues, peers, nurses, etc.) |
| Assessment structure | 5 domains, 17 questions + optional free text | 2 parts: 9 professional domains + 5 clinical domains | Structured questions per reviewer with rating scale |
| Reviewer type | Internal PPP users (consultants) | Internal PPP users (consultants) | External (anyone with email, no PPP account needed) |
| Data storage | activities table (wbaType: 'qmf') | activities table (wbaType: 'mcr') + mcr_assessor_responses | ppp_360 + ppp_360_reviewers + ppp_360_reviews |
| Supervisor sign-off | No (assessor reviews individually) | One assessor designated as educational supervisor | Yes (dedicated supervisor review and sign-off) |
| Anonymity | Assessor identity visible to trainee | Assessor identity visible to trainee | Reviewer identity hidden in aggregated report |
1. Multi-Source Feedback (MSF)
Overview
MSF (stored as wbaType: 'qmf' for backward compatibility) is a quarterly feedback mechanism where a trainee requests structured assessments from multiple consultants. Each assessor independently completes a feedback form covering clinical care, professional behaviour, learning aptitude, and relationships.
Who Initiates
- Trainee creates the MSF request from the MSF module under Appraisals.
Who Reviews/Completes
- Multiple assessors (consultants/supervisors within PPP) each complete the structured feedback form independently.
- Each assessor rates the trainee across 5 domains with 17 questions plus optional free-text comments.
Process Flow
Trainee creates MSF
├── Fills: date, hospital, job duration, post-grad year
├── Selects multiple assessors
└── Submits → status: 'pending'
│
├── Assessor 1 receives notification
│ └── Completes FormMSF (5 domains, 17 questions)
│ └── Submits review → status: 'verified'
│
├── Assessor 2 receives notification
│ └── Completes FormMSF
│ └── Submits review → status: 'verified'
│
└── Assessor N receives notification
└── Completes FormMSF
└── Submits review → status: 'verified'
Trainee views aggregated report
└── Can download as PDF or bulk ZIPAssessment Domains
- Clinical Care (5 questions) - clinical knowledge, examination skills, diagnosis, management, record keeping
- Maintaining Good Medical Practice (5 questions) - ethics, probity, patient safety, teamwork, time management
- Learning and Teaching (2 questions) - self-directed learning, teaching others
- Relationships (4 questions) - communication with patients, relatives, colleagues, accessibility
- Global Summary (1 question) - overall performance rating
Data Model
| Table | Key Fields |
|---|---|
activities | type: 'wba', wbaType: 'qmf', userId, assessorId, hospitalId, jobDuration, postGradYear, status, attributes (JSON with responses) |
Status Workflow
draft → pending (submitted to assessor) → verified (assessor reviewed) → accepted
Key Differences from Other Types
- Uses the WBA
activitiestable (shared with CBD, CEX, SSA, PBA) - Each assessor gets their own activity record (one-to-one: activity ↔ assessor)
- No dedicated junction table; responses stored in
attributesJSON - No supervisor sign-off step
- Assessor identity is visible to the trainee
2. Multi-Consultant Report (MCR)
Overview
MCR is a comprehensive competency assessment where multiple consultants evaluate a trainee across professional capabilities and clinical activities. One assessor is designated as the educational supervisor. MCR uses a collaboration window to allow multiple assessors to provide responses before the report is finalised.
Who Initiates
- Trainee creates the MCR from the WBA module (MCR is a WBA sub-type).
Who Reviews/Completes
- Multiple assessors (consultants within PPP) each complete a structured assessment.
- One assessor is designated as the educational supervisor, providing oversight and final review authority.
- All assessors respond via the same MCR activity, with responses stored in a dedicated junction table.
Process Flow
Trainee creates MCR
├── Fills: date, hospital, case details
├── Selects multiple assessors (designates one as educational supervisor)
└── Submits → status: 'pending'
│
├── Collaboration window opens (time-limited)
│
├── Assessor 1 receives notification
│ └── Completes FormMCR
│ ├── Part 1: Professional Capabilities (9 domains)
│ ├── Part 2: Clinical Activities (5 domains)
│ └── Supervision level assessment
│
├── Assessor 2 (educational supervisor) receives notification
│ └── Completes FormMCR (same form, flagged as educational)
│
└── Assessor N receives notification
└── Completes FormMCR
│
└── Collaboration window closes
└── status: 'verified' / 'accepted'
Trainee views tabular MCR report (MCRReportView)
└── Aggregated ratings across all assessors by domainAssessment Structure
Part 1 — Professional Capabilities (9 domains):
- Good Clinical Care
- Maintaining Good Medical Practice
- Teaching and Training
- Relationships with Patients
- Working with Colleagues
- Probity
- Health
- Clinical Knowledge
- Communication
Part 2 — Clinical Activities (5 domains):
- History Taking
- Examination
- Diagnosis
- Treatment Planning
- Procedural Skills
Each domain uses a structured rating scale plus optional comments. The educational supervisor additionally assesses the supervision level required.
Data Model
| Table | Key Fields |
|---|---|
activities | type: 'wba', wbaType: 'mcr', userId, hospitalId, status, collaborationWindowExpiresAt, collaborationWindowExtended |
mcr_assessor_responses | activityId (FK → activities), assessorId (FK → users), educational (boolean), attributes (JSON with structured ratings) |
Status Workflow
draft → pending (submitted, collaboration window open) → verified (all responses in) → accepted
Key Differences from Other Types
- Uses a junction table (
mcr_assessor_responses) — one activity with many assessor responses - Has a collaboration window with expiry and extension capability
- One assessor is flagged as educational supervisor (
educational: true) - Two-part assessment structure (professional + clinical)
- Tabular report view aggregates all assessor ratings side-by-side
- Assessor identity is visible to the trainee
3. 360-Degree Review
Overview
360-degree reviews collect anonymous structured feedback from a broad group of colleagues — including non-PPP users such as nurses, allied health professionals, and administrative staff. Unlike MSF and MCR, reviewers are external (invited by email) and do not need a PPP account. The process includes a dedicated supervisor review and sign-off step.
Who Initiates
- Trainee (or supervisor) creates the 360 review from the 360 Reviews module.
Who Reviews/Completes
- External reviewers — anyone invited via email (colleagues, peers, nurses, etc.). They access a tokenised form without logging in to PPP.
- Supervisor — reviews the aggregated feedback and provides sign-off with a summary comment.
Process Flow
Trainee creates 360 Review
├── Sets: name, date
├── Assigns supervisor for final review
├── Adds reviewers (name, email, group)
└── Submits → status: 'pending'
│
├── Reviewer invitations sent via email (tokenised links)
│
├── Reviewer 1 clicks link → Review360 form
│ └── Completes structured questions (rating + comments)
│ └── tokenConsumedAt set on submission
│
├── Reviewer 2 clicks link → Review360 form
│ └── Completes structured questions
│
└── Reviewer N (reminders sent if not responded)
└── Completes structured questions
│
└── All reviewers responded → status: 'supervisor_review'
│
└── Supervisor reviews aggregated report (Review360Table)
├── Reads anonymised feedback
├── Writes supervisor summary
└── Signs off → status: 'completed'
Trainee views anonymised aggregated report
└── Ratings table with reviewer groups, no individual identificationData Model
| Table | Key Fields |
|---|---|
ppp_360 | id, name, date, status, userId, supervisorId, supervisorReviewDate, supervisorSummary, supervisorSignOff |
ppp_360_reviewers | ppp360Id (FK), name, email, group, tokenConsumedAt, lastReminderSentAt |
ppp_360_reviews | ppp360reviewerId (FK), question, answer, isComment, order |
Status Workflow
pending → sent → in_progress → supervisor_review → completed
Key Differences from Other Types
- Separate table structure — not stored in
activitiestable at all; uses dedicatedppp_360tables - External reviewers — invited by email, no PPP account required, tokenised access
- Anonymous feedback — reviewer identities hidden in aggregated reports
- Supervisor sign-off — dedicated step with summary and explicit sign-off flag
- Reminder system — automated reminders for non-responding reviewers (
lastReminderSentAt) - Reviewer groups — categorised (e.g. consultant, peer, nurse, admin) for analysis
- Broader participant pool (not limited to consultants)
Comparison Matrix: Detailed Differences
| Dimension | MSF | MCR | 360 Review |
|---|---|---|---|
| Module location | Appraisals → MSF | WBA (sub-type) | Appraisals → 360 Reviews |
| Database | activities table | activities + junction table | Dedicated ppp_360 tables |
| Reviewer access | Must be PPP user | Must be PPP user | External (email + token) |
| Reviewer count | Multiple (typically 3-8) | Multiple (typically 3-6) | Multiple (typically 5-15) |
| Educational supervisor | No | Yes (one designated) | Supervisor assigned separately |
| Supervisor sign-off | No | No (educational role only) | Yes (formal sign-off with summary) |
| Anonymity | Not anonymous | Not anonymous | Anonymous in reports |
| Collaboration window | No | Yes (time-limited) | No (open until all respond) |
| Reminders | Via notifications | Via notifications | Automated email reminders |
| Report format | Individual assessor views | Tabular side-by-side comparison | Aggregated anonymous table |
| Assessment scope | Professional skills (5 domains) | Competency (14 domains, 2 parts) | General professional feedback |
| Frequency | Quarterly | As needed per case/rotation | Annually (for appraisal) |
| Use in appraisal | Section 5 evidence | Section 5 + Section 6 evidence | Section 5 evidence |
Source
These process flows are derived from Matt Randell's clinical knowledge and the existing PPP implementation. They align with UK/Australian medical training standards. Do not modify without Matt's consultation, as these reflect industry-standard assessment workflows.