Chapter 7

Choosing and combining evidence

A person sorting a fan of index cards into four neat piles on a kitchen table, a few cards resting on the borders between piles.

Sam Archer sits with two documents on the kitchen table. On one side, his shortlist from the inventory: sixteen named items, each with an E-number and a redacted copy in the folder. On the other side, the framework: thirty-eight capabilities in four columns, every box empty. One end is what he owns; the other is what he must show. His pen hovers, and the only question left is which end to start from.

Either end works, because both end at the same place: a join document where each item carries its ticks and its pillar home. What decides the outcome is not the direction but the quality of the join.

By the end of this chapter you will have
  • a pass over every shortlisted item against six worth-submitting criteria, with a keep, gather or drop verdict on each;
  • a claim for every kept item: the pillar a stranger would place it in, and what it proves there;
  • the mix arithmetic checked against your own numbers: about eighteen items, roughly two ticks each, three or four honest mixers;
  • a direction chosen, inventory-first or framework-first, after a twenty-minute trial of each.

What makes an item worth submitting

The shortlist from chapter 6 says what you own. These six criteria are the judgement, and they are the same six questions a verifier quietly asks.

The types, and what they show

CodeTypeWhat it shows
CSCase studies, two, reflectiveDeep clinical reasoning under complexity and unpredictability
REFLReflective accounts, twoLearning and change; one carries a team leadership episode
QI / AU / SIQuality improvement, audit, service improvementResearch, and Leadership when you led the change
FBColleague and patient feedbackHow others experience your practice
EDU / TRAINEducation and training delivery Teaching and supervision
REApplying researchUsing and appraising evidence in practice
Leader / LPEPLeadership skills, committee and episode workOrganisational leadership
JP/JD and CVJob description and CVThe role itself, current and advanced

The categories are the checklist from chapter 6; this table is what each category proves.

The magic of the mix

Choosing evidence is not eighteen separate decisions; it is one piece of arithmetic you can hold in your head. Thirty-eight capabilities want one or two items each, and eighteen items carrying about two ticks apiece supply roughly thirty-six ticks. Four pillars want four to six distinct items each, which is sixteen to twenty-four slots, and eighteen items fill them if three or four of your items honestly serve two pillars. The mix is the trick: a few double-duty items, no more.

  1. Give every item its natural home. The pillar a verifier would guess without reading the document is the item's Core. Case studies and competence assessments are Clinical; leadership episodes and change projects are Leadership; teaching and mentoring are Education; audits, QI and critical appraisals are Research.
  2. Count the Cores per pillar. Any pillar with fewer than four Cores is a genuine gap: gather for it, or promote an honest item you had filed elsewhere.
  3. Then look for second homes, the mixers. A QI project is Research at heart but also Clinical, because it changed practice. Leading a service change is Leadership and Research. Teaching a clinical skill is Education and Clinical. If you have to argue for the second home, it is not a mixer; drop it.
  4. Cap each pillar at six distinct items. Over six reads as dilution. If a pillar overfills, demote the weakest Supporting item; do not delete the item itself, it still serves its home pillar.
  5. Run the sanity checks. Every item has at least one tick; most items have exactly two; nothing claims all four pillars; every capability has one or two items behind it.
PillarCore itemsSupportingDistinct
Clinical PracticeE3, E4, E5, E14E12, E76
Leadership and ManagementE9, E2, E15E8, E15
EducationE10, E16, E13E17, E85
ResearchE7, E18, E6E20, E175

That table is eighteen items filling twenty-one slots, because exactly three items do double duty: E7 (Research Core, Clinical Supporting), E8 (Education Core, Leadership Supporting) and E17 (Research Core, Education Supporting). Three mixers in eighteen is the healthy ratio; ten mixers would be inflation, zero would mean a pile of single-purpose documents you had to keep adding to.

The same arithmetic in one breath: eighteen items carrying about two ticks each supply the thirty-eight capabilities, and three or four honest double-duty items fill the sixteen to twenty-four pillar slots.

Two ends, one join document

Inventory-first is the direction chapters 5 and 6 teach: write down what you own, name it, then ask which capabilities each item shows. Framework-first runs the other way: start at the thirty-eight capabilities and, for each, ask what you have that shows it, letting the framework's wording pull up memories the inventory missed.

Both directions end at the same join document, one row per item, with its ticks and its pillar home. They differ only in which memory they trust first, your own recall or the framework's prompts, and most people find that one of the two produces truer ticks.

Two windows side by side: the portal evidence form on the left, your join document on the right, with a teal arrow copying the evidence link across and an ink arrow ticking what the record shows.
Tip

Spend twenty minutes on each method with five items. Keep whichever produced truer ticks; the other becomes your checking pass later, when you want a second opinion on the grid.

If you are visual: postcards, mind maps, or the official template

  1. Write one index card per item: title, code and date on the front; capabilities and pillar home on the back.
  2. Lay the cards on a table in four columns, one column per pillar.
  3. Let the mixers rest on the border between two columns, half in each; that is what a mixer looks like.
  4. Photograph the layout before you move anything.
  5. Transcribe the photograph into the join document, one row per card.

Supervising teams reportedly run the same exercise as a big spreadsheet, one that tracks every applicant against the framework (webinar 01 transcript, 0:38:06). Your join document is your personal version of that spreadsheet, kept by you and shared with your supervisor.

Easy mistake
  • The mistake. Choosing items for impressiveness instead of guessability: the glossy conference certificate goes in, the humble departmental audit stays out.
  • What goes wrong. The certificate proves attendance, which on its own counts for nothing, and a verifier cannot place it in a pillar without help. The audit, meanwhile, carries four capabilities: it evaluated practice, changed it, led a small team, and improved care. Impressiveness and coverage pull in different directions, and coverage is what the grid reads.
  • Do this instead. Ask of every candidate: which pillar would a stranger place this in, without me in the room? Keep the items that answer themselves. If the audit places itself in Research and Leadership while the certificate argues for a home, the audit goes in and the certificate goes to the spare bench.
Choose items a stranger could place in the right pillar without arguing. The mix then looks after itself.
Sam, so far

Sam Archer spent twenty minutes on each direction with five items. Framework-first, he caught himself stretch-ticking to fill the page; inventory-first, the ticks came slower and truer, so that is his direction. At the weekend he laid sixteen postcards in four columns and found three resting on borders, which matched his mixers exactly. The photograph is on his phone, and the join document now has a pillar home for every row. His remaining worry is the full grid pass: do the ticks really reach all thirty-eight?

Your pile so far
  • The shape, the map, and what good looks like (chapters 1-4).
  • One folder, one brain-dump page, three candidate items (chapter 5).
  • A named register of about eighteen rows and a join document with its first rows (chapter 6).
  • Your pillar plan: Cores placed in every pillar, three or four honest mixers chosen.
Done looks like
  • every shortlisted item has a keep, gather or drop verdict against the six criteria;
  • every kept item has a pillar home a stranger would guess, and a one-line claim of what it proves;
  • you can say the arithmetic in one breath: about eighteen items, two ticks each, three or four mixers, sixteen to twenty-four pillar slots;
  • you have chosen inventory-first or framework-first after the twenty-minute trial, and the join document shows it.

Your next 60-minute session

Read chapter 8 (twenty minutes), the capability grid. Then spend forty minutes on the paper pass: one pillar at a time, record the plausible ticks for each capability in your join document, and mark empty capabilities gather or discuss. Do not open the portal yet; the paper pass is faster.