We Graded 12 Manager 1:1 Recordings Against a Coaching Rubric. Here's What Separated the Top Two.
Not tone. Not energy. Not rapport. The top two did one specific thing the other ten never did once.
Twelve recorded manager 1:1s, one rubric, two raters working blind from transcripts with names and org context stripped out. That was the whole method behind a coaching audit I ran for a client last month, and going in, my money was on rapport. Managers who build trust get more honest disclosure from reps, more disclosure means the real problem surfaces, and a surfaced problem is one you can actually coach — that was the theory. The scores didn't cooperate. The two highest-rated 1:1s in the batch were run by managers who, by their own reps' account afterwards, are "a bit dry." The lowest-rated 1:1 was run by the manager everyone in the building would tell you is best with people. Rapport predicted almost nothing. One thing predicted almost everything.
Building a rubric that wasn't a vibe check
We scored each recording against six dimensions, 1 to 5, two raters working independently and reconciling anything more than a point apart by rewatching together. The dimensions:
- Rapport & energy — did the rep sound at ease, did the manager show genuine warmth
- Question depth — open questions that drew the rep's own analysis out, versus the manager doing the thinking for them
- Feedback specificity — situation, behaviour, impact stated concretely, not "that call went well"
- Named the skill gap — did the manager state an explicit, named competency before offering advice, or go straight to advice
- Concreteness of next rep — one specific, near-term action, versus "keep working on it"
- Follow-through check — did the manager reference what was committed to in the previous 1:1
Where the twelve actually landed
Total scores ranged from 14 to 27 out of 30. Ten managers clustered between 14 and 21. Two broke clean away at 26 and 27. That gap is the whole story of this piece, so I lined up the average score on each dimension for the bottom ten against the top two.
| Dimension | Bottom 10 avg | Top 2 avg | Gap |
|---|---|---|---|
| Rapport & energy | 3.9 | 4.3 | 0.4 |
| Question depth | 3.2 | 3.8 | 0.6 |
| Feedback specificity | 2.9 | 4.0 | 1.1 |
| Named the skill gap | 1.6 | 5.0 | 3.4 |
| Concreteness of next rep | 2.4 | 4.5 | 2.1 |
| Follow-through check | 2.8 | 3.5 | 0.7 |
Five of the six dimensions show a modest, unsurprising gap — the top two managers are a bit better at most things, as you'd expect from anyone good at their job. Two dimensions carry two-thirds of the entire spread between best and rest, and they're not independent of each other. Once a manager names the actual skill gap, the next practice step nearly writes itself. Skip the naming, and "concreteness of next rep" collapses into "just keep at it," which is what happened in nine of the ten bottom recordings.
What naming it actually sounds like
Bottom-ten recording, manager to rep after a lost-deal review: "Yeah, that call was fine — I liked how you kept the energy up when he pushed back on price. Just keep doing that."
Top-two recording, manager to rep, same situation: "The moment he said 'we're not looking to switch right now,' you went straight back into feature justification. That's not an energy problem, that's a discovery-questioning gap — you didn't have a next question ready for a stall response. That's specifically what we're drilling this week."
Both managers listened to the same kind of moment. One described a mood. The other named a competency the rep didn't have queued up, and turned it into something rehearsable by Thursday.
Why naming it is the mechanism, not the manners
Deliberate practice needs a target with a name. "Keep the energy up" isn't a skill a rep can drill in isolation — it's an outcome of several things going right at once, and nobody can rehearse an outcome directly. "Discovery-questioning for stall responses" is a skill. It can be drilled against a script, checked for presence in the next three calls, and graded. The moment a manager puts a name on the gap, the 1:1 stops being an event the rep sits through and starts being an input into a training plan. Skip the naming and the advice — however warm, however well-intentioned — evaporates by the next call, because there was never anything concrete enough to carry forward.
This is also why rapport scored so poorly as a predictor. Warmth makes a rep more receptive to feedback. It does nothing to make the feedback itself more specific. You can be liked and useless in the same nineteen minutes, and ten of these twelve managers were living proof.
What this means if you run enablement
Don't take a manager's word for their own coaching quality, and don't take a rep's word for it either — reps rate managers they like highly regardless of what actually got fixed. Score the recordings against something structured, like a Coaching Effectiveness Scorecard for Managers, and specifically check whether a named competency appears before the advice does. If you want a live check rather than a retrospective one, pair it with a Call Shadowing & Ride-Along Checklist so a skip-level is watching for the pattern across several 1:1s, not judging a single good or bad day. And ask the rep directly, ideally with a Skip-Level 1:1 Question Bank in hand: "what's the specific skill your manager last coached you on, and what have you done differently since." If the rep can't name it either, the manager didn't name it clearly enough for it to stick — regardless of how good the meeting felt from the outside.
None of the twelve managers in this batch were bad at their jobs. Ten of them were bad at exactly one habit, repeated in every single 1:1 they ran. That's a training problem, which is fixable in a single workshop, not a talent problem, which isn't. Whether that's good news or very bad news depends entirely on how many of your managers you'd have sworn were naturals before you actually watched the tape.