Skip to content

WBA Process Flows: MSF, MCR, and 360 Reviews ​

This document describes the process flows for the three multi-source assessment types in PPP, covering who initiates, who reviews/completes, data model requirements, user journey steps, and differences between the types.

Assessment Type Summary ​

AspectMulti-Source Feedback (MSF)Multi-Consultant Report (MCR)360-Degree Review
PurposeQuarterly 360-degree feedback on professional skillsStructured competency assessment by multiple consultantsAnonymous colleague feedback for appraisal evidence
Who initiatesTrainee (creates and submits)Trainee (creates and submits)Trainee or supervisor (creates and invites reviewers)
Who completesMultiple assessors (consultants/supervisors)Multiple assessors with one educational supervisorExternal reviewers (colleagues, peers, nurses, etc.)
Assessment structure5 domains, 17 questions + optional free text2 parts: 9 professional domains + 5 clinical domainsStructured questions per reviewer with rating scale
Reviewer typeInternal PPP users (consultants)Internal PPP users (consultants)External (anyone with email, no PPP account needed)
Data storageactivities table (wbaType: 'qmf')activities table (wbaType: 'mcr') + mcr_assessor_responsesppp_360 + ppp_360_reviewers + ppp_360_reviews
Supervisor sign-offNo (assessor reviews individually)One assessor designated as educational supervisorYes (dedicated supervisor review and sign-off)
AnonymityAssessor identity visible to traineeAssessor identity visible to traineeReviewer identity hidden in aggregated report

1. Multi-Source Feedback (MSF) ​

Overview ​

MSF (stored as wbaType: 'qmf' for backward compatibility) is a quarterly feedback mechanism where a trainee requests structured assessments from multiple consultants. Each assessor independently completes a feedback form covering clinical care, professional behaviour, learning aptitude, and relationships.

Who Initiates ​

  • Trainee creates the MSF request from the MSF module under Appraisals.

Who Reviews/Completes ​

  • Multiple assessors (consultants/supervisors within PPP) each complete the structured feedback form independently.
  • Each assessor rates the trainee across 5 domains with 17 questions plus optional free-text comments.

Process Flow ​

Trainee creates MSF
    ├── Fills: date, hospital, job duration, post-grad year
    ├── Selects multiple assessors
    └── Submits → status: 'pending'
        │
        ├── Assessor 1 receives notification
        │   └── Completes FormMSF (5 domains, 17 questions)
        │       └── Submits review → status: 'verified'
        │
        ├── Assessor 2 receives notification
        │   └── Completes FormMSF
        │       └── Submits review → status: 'verified'
        │
        └── Assessor N receives notification
            └── Completes FormMSF
                └── Submits review → status: 'verified'

Trainee views aggregated report
    └── Can download as PDF or bulk ZIP

Assessment Domains ​

  1. Clinical Care (5 questions) - clinical knowledge, examination skills, diagnosis, management, record keeping
  2. Maintaining Good Medical Practice (5 questions) - ethics, probity, patient safety, teamwork, time management
  3. Learning and Teaching (2 questions) - self-directed learning, teaching others
  4. Relationships (4 questions) - communication with patients, relatives, colleagues, accessibility
  5. Global Summary (1 question) - overall performance rating

Data Model ​

TableKey Fields
activitiestype: 'wba', wbaType: 'qmf', userId, assessorId, hospitalId, jobDuration, postGradYear, status, attributes (JSON with responses)

Status Workflow ​

draft → pending (submitted to assessor) → verified (assessor reviewed) → accepted

Key Differences from Other Types ​

  • Uses the WBA activities table (shared with CBD, CEX, SSA, PBA)
  • Each assessor gets their own activity record (one-to-one: activity ↔ assessor)
  • No dedicated junction table; responses stored in attributes JSON
  • No supervisor sign-off step
  • Assessor identity is visible to the trainee

2. Multi-Consultant Report (MCR) ​

Overview ​

MCR is a comprehensive competency assessment where multiple consultants evaluate a trainee across professional capabilities and clinical activities. One assessor is designated as the educational supervisor. MCR uses a collaboration window to allow multiple assessors to provide responses before the report is finalised.

Who Initiates ​

  • Trainee creates the MCR from the WBA module (MCR is a WBA sub-type).

Who Reviews/Completes ​

  • Multiple assessors (consultants within PPP) each complete a structured assessment.
  • One assessor is designated as the educational supervisor, providing oversight and final review authority.
  • All assessors respond via the same MCR activity, with responses stored in a dedicated junction table.

Process Flow ​

Trainee creates MCR
    ├── Fills: date, hospital, case details
    ├── Selects multiple assessors (designates one as educational supervisor)
    └── Submits → status: 'pending'
        │
        ├── Collaboration window opens (time-limited)
        │
        ├── Assessor 1 receives notification
        │   └── Completes FormMCR
        │       ├── Part 1: Professional Capabilities (9 domains)
        │       ├── Part 2: Clinical Activities (5 domains)
        │       └── Supervision level assessment
        │
        ├── Assessor 2 (educational supervisor) receives notification
        │   └── Completes FormMCR (same form, flagged as educational)
        │
        └── Assessor N receives notification
            └── Completes FormMCR
        │
        └── Collaboration window closes
            └── status: 'verified' / 'accepted'

Trainee views tabular MCR report (MCRReportView)
    └── Aggregated ratings across all assessors by domain

Assessment Structure ​

Part 1 — Professional Capabilities (9 domains):

  1. Good Clinical Care
  2. Maintaining Good Medical Practice
  3. Teaching and Training
  4. Relationships with Patients
  5. Working with Colleagues
  6. Probity
  7. Health
  8. Clinical Knowledge
  9. Communication

Part 2 — Clinical Activities (5 domains):

  1. History Taking
  2. Examination
  3. Diagnosis
  4. Treatment Planning
  5. Procedural Skills

Each domain uses a structured rating scale plus optional comments. The educational supervisor additionally assesses the supervision level required.

Data Model ​

TableKey Fields
activitiestype: 'wba', wbaType: 'mcr', userId, hospitalId, status, collaborationWindowExpiresAt, collaborationWindowExtended
mcr_assessor_responsesactivityId (FK → activities), assessorId (FK → users), educational (boolean), attributes (JSON with structured ratings)

Status Workflow ​

draft → pending (submitted, collaboration window open) → verified (all responses in) → accepted

Key Differences from Other Types ​

  • Uses a junction table (mcr_assessor_responses) — one activity with many assessor responses
  • Has a collaboration window with expiry and extension capability
  • One assessor is flagged as educational supervisor (educational: true)
  • Two-part assessment structure (professional + clinical)
  • Tabular report view aggregates all assessor ratings side-by-side
  • Assessor identity is visible to the trainee

3. 360-Degree Review ​

Overview ​

360-degree reviews collect anonymous structured feedback from a broad group of colleagues — including non-PPP users such as nurses, allied health professionals, and administrative staff. Unlike MSF and MCR, reviewers are external (invited by email) and do not need a PPP account. The process includes a dedicated supervisor review and sign-off step.

Who Initiates ​

  • Trainee (or supervisor) creates the 360 review from the 360 Reviews module.

Who Reviews/Completes ​

  • External reviewers — anyone invited via email (colleagues, peers, nurses, etc.). They access a tokenised form without logging in to PPP.
  • Supervisor — reviews the aggregated feedback and provides sign-off with a summary comment.

Process Flow ​

Trainee creates 360 Review
    ├── Sets: name, date
    ├── Assigns supervisor for final review
    ├── Adds reviewers (name, email, group)
    └── Submits → status: 'pending'
        │
        ├── Reviewer invitations sent via email (tokenised links)
        │
        ├── Reviewer 1 clicks link → Review360 form
        │   └── Completes structured questions (rating + comments)
        │       └── tokenConsumedAt set on submission
        │
        ├── Reviewer 2 clicks link → Review360 form
        │   └── Completes structured questions
        │
        └── Reviewer N (reminders sent if not responded)
            └── Completes structured questions
        │
        └── All reviewers responded → status: 'supervisor_review'
            │
            └── Supervisor reviews aggregated report (Review360Table)
                ├── Reads anonymised feedback
                ├── Writes supervisor summary
                └── Signs off → status: 'completed'

Trainee views anonymised aggregated report
    └── Ratings table with reviewer groups, no individual identification

Data Model ​

TableKey Fields
ppp_360id, name, date, status, userId, supervisorId, supervisorReviewDate, supervisorSummary, supervisorSignOff
ppp_360_reviewersppp360Id (FK), name, email, group, tokenConsumedAt, lastReminderSentAt
ppp_360_reviewsppp360reviewerId (FK), question, answer, isComment, order

Status Workflow ​

pending → sent → in_progress → supervisor_review → completed

Key Differences from Other Types ​

  • Separate table structure — not stored in activities table at all; uses dedicated ppp_360 tables
  • External reviewers — invited by email, no PPP account required, tokenised access
  • Anonymous feedback — reviewer identities hidden in aggregated reports
  • Supervisor sign-off — dedicated step with summary and explicit sign-off flag
  • Reminder system — automated reminders for non-responding reviewers (lastReminderSentAt)
  • Reviewer groups — categorised (e.g. consultant, peer, nurse, admin) for analysis
  • Broader participant pool (not limited to consultants)

Comparison Matrix: Detailed Differences ​

DimensionMSFMCR360 Review
Module locationAppraisals → MSFWBA (sub-type)Appraisals → 360 Reviews
Databaseactivities tableactivities + junction tableDedicated ppp_360 tables
Reviewer accessMust be PPP userMust be PPP userExternal (email + token)
Reviewer countMultiple (typically 3-8)Multiple (typically 3-6)Multiple (typically 5-15)
Educational supervisorNoYes (one designated)Supervisor assigned separately
Supervisor sign-offNoNo (educational role only)Yes (formal sign-off with summary)
AnonymityNot anonymousNot anonymousAnonymous in reports
Collaboration windowNoYes (time-limited)No (open until all respond)
RemindersVia notificationsVia notificationsAutomated email reminders
Report formatIndividual assessor viewsTabular side-by-side comparisonAggregated anonymous table
Assessment scopeProfessional skills (5 domains)Competency (14 domains, 2 parts)General professional feedback
FrequencyQuarterlyAs needed per case/rotationAnnually (for appraisal)
Use in appraisalSection 5 evidenceSection 5 + Section 6 evidenceSection 5 evidence

Source ​

These process flows are derived from Matt Randell's clinical knowledge and the existing PPP implementation. They align with UK/Australian medical training standards. Do not modify without Matt's consultation, as these reflect industry-standard assessment workflows.

Internal documentation — org members only