Sales Aptitude Tests, Explained: What They Actually Validate Against, and What They Don't
The vendor will show you a validity study. Read it before you buy the seat license.
Every vendor selling a sales aptitude test will hand you a validity study when you ask, and the number in it will be more reassuring than the test deserves — because the study is very rarely answering the question you think it's answering. Read the fine print, specifically what the test was actually scored against when it was built, before you sign for the seat licence. In a meaningful share of these tools, that number describes something closer to trainability or personality fit than it does the on-the-job competency you're buying the test to predict.
The gap: what's tested vs what's claimed
"Validated" is doing a lot of work in sales-tool marketing, and it's worth being precise about what the word means here. A test is validated against something — a criterion. The criterion chosen when the test was built determines what the test can honestly claim to predict, and it is very often not the criterion the buyer has in mind.
Three things commonly get used as the criterion, and none of them is closed revenue:
- Supervisor or manager ratings. Cheap and easy to collect, so it's the most common criterion in commercial test validation. The problem: manager ratings of sales performance correlate strongly with how much a manager likes someone, how recently they closed something visible, and how well they communicate upward — not cleanly with actual quota attainment. A test validated against manager ratings is, in effect, partly validated against likeability.
- Tenure and turnover. Does the person stay in the role for twelve months? That's a legitimate and useful thing to predict — turnover is expensive — but it's a different question from "will they be good at the job while they're in it." A test that predicts retention is not thereby a test that predicts competency.
- Training completion or ramp speed. How fast someone gets licensed on the product, passes certification, hits activity minimums. Genuinely useful, genuinely predictable by cognitive-ability and conscientiousness measures, and genuinely not the same thing as competency at discovery, negotiation, or forecasting under pressure.
None of these criteria are illegitimate to test for. The problem sits entirely in the gap between what gets validated and what gets marketed. A test built and normed against tenure gets sold with language like "identifies top sales performers," and the buyer reasonably assumes "performers" means people who sell more — when the study behind the claim never measured that.
The main categories, and what they're actually good for
| Test type | Typically measures | Usually normed against | What buyers assume it predicts | What it's actually good for |
|---|---|---|---|---|
| DISC / behavioural-style profiles | Self-reported communication style | Internal consistency and factor structure, not job outcomes | Sales performance | Coaching conversations and team communication — not selection decisions |
| Personality inventories (trait-based) | Conscientiousness, extraversion, emotional stability and similar | Retention, manager ratings, occasionally training grades | Who will close deals | Screening for coachability and resilience under rejection — genuinely useful, narrowly |
| Cognitive ability / aptitude tests | Reasoning speed, problem-solving | Training performance and ramp speed | Sales skill | Predicting how fast someone gets productive — a real and useful signal, mis-sold as a skill measure |
| Commercial "sales DNA" / will-skill inventories | Proprietary blend of trait and self-report skill items | Often a mix of the above, frequently under-disclosed | Direct performance prediction | Whatever the specific validity study actually shows — ask before you buy, don't assume from the marketing page |
| Simulation / work-sample assessments (live roleplay, recorded call review, scored against a competency rubric) | Observed behaviour against defined competencies | Actual demonstrated performance on the task itself | Sales skill | The only category on this list actually built to answer the question buyers think they're asking |
The pattern across the first four rows: the further a test sits from observing someone actually doing the job, the more it's really measuring trainability, personality, or retention risk — all legitimately useful, none of them a substitute for watching someone run a discovery call and scoring what they actually did against a defined set of competencies.
What to ask the vendor before you price the seat licence
Four questions, in order, and don't accept a marketing deck as the answer to any of them:
- "What was the criterion in your validity study?" If the answer isn't closed revenue, quota attainment, or a competency-scored observation of actual selling behaviour, you're buying a trainability or retention screen, not a performance predictor. Price it accordingly.
- "Concurrent or predictive?" Concurrent means they tested current employees and correlated scores with current performance — weaker, because it can't rule out that good performers simply learn to answer the test well over time. Predictive means they tested at hire and tracked forward. Ask which, and be sceptical of "validated" claims that don't specify.
- "What's the sample, and is it my industry?" A test normed on retail insurance sales twelve years ago tells you very little about a technical B2B SaaS motion today.
- "What's the effect size?" A statistically significant correlation and a usefully large one are different things. Ask for the actual coefficient, not just "statistically significant."
If the vendor can't answer question one cleanly, you already have your answer about what the tool is actually for.
Pricing the tool correctly
None of this means aptitude tests are worthless. A good trainability screen genuinely reduces early attrition and speeds ramp, and that's real money saved. It means pricing them as what they are: a volume-hiring filter for coachability and staying power, not a substitute for judgment on who can actually run a sales conversation. If competency is the thing you're trying to buy certainty on, that's what a structured, observed assessment is built to answer — something like a Coachability Self-Assessment for Sales Candidates paired with a proper AE, SDR & CSM Competency Framework scored against real behaviour — and a personality inventory, however well-marketed, isn't.
Keep a Sales Candidate Scorecard Calculator in the room either way. It won't replace the aptitude test. It'll stop you outsourcing the decision to it.