Same Qualifications, Different Performance: What Hiring Decisions Often Miss

Two candidates can have the same degree.

They may have studied similar subjects, worked in similar industries and accumulated roughly the same number of years of experience.

On paper, they can look remarkably alike.

Put them into the same workplace situation, however, and the similarities may begin to disappear.

One may break an unfamiliar problem into smaller parts before acting. Another may immediately apply a solution that worked previously.

One may adapt quickly when circumstances change. Another may perform exceptionally well when the process is clearly defined.

One may ask questions when information is incomplete. Another may prefer to make a decision independently.

Neither difference automatically makes one person better than the other.

But it can make one person better suited to a particular role.

That is why technical knowledge, while essential, does not always tell the full hiring story.

Knowing something and working with what you know are not the same thing

Qualifications and technical assessments can answer important questions.

Does this person understand the subject?

Do they have the required technical foundation?

Have they performed similar work before?

For many positions, these are non-negotiable requirements.

But work rarely consists entirely of situations for which the answer has already been learned.

Employees encounter incomplete information, changing requirements, unexpected problems, competing priorities and situations they have never seen before.

At that point, knowledge still matters.

So does the way the individual uses that knowledge.

How do they interpret new information?

Can they recognise patterns?

How quickly do they understand something unfamiliar?

Do they question assumptions?

How do they approach a problem when the usual solution does not work?

How do they respond when there is no obvious answer?

These differences can exist even between people with very similar educational and professional backgrounds.

For roles where reasoning, information processing, problem-solving and learning are relevant, tools such as Psychometrica's Cognitive Ability Test can provide one additional source of structured information alongside technical evaluation and interviews.

The important word is additional.

An assessment should add evidence, not attempt to replace everything else we know about the candidate.

Google learned an interesting lesson about interviews

Google provides an unusually useful example from hiring history.

The company was once famous for interview brainteasers—questions such as estimating how many golf balls might fit inside an aircraft or how many petrol stations might exist in a city.

They sounded difficult.

They appeared to test intelligence and problem-solving.

But Google eventually examined its own hiring data.

In 2013, Google's then Senior Vice President of People Operations, Laszlo Bock, said the company had looked at tens of thousands of interviews and compared interviewer ratings with how those people subsequently performed. In the historical interview data Google examined, interviewer scores showed essentially no relationship with later performance. Bock was particularly dismissive of brainteasers, saying they did not predict anything useful.

That does not mean interviews are useless.

In fact, Google's response was partly to make interviewing more structured.

By 2015, Google publicly described using structured interviews, work-sample-style technical problems and measures related to cognitive ability. Its own explanation emphasised looking at how candidates approached actual problems and learned, rather than relying on clever riddles.

That distinction matters.

The lesson from Google's experience is not:

“Stop interviewing candidates.”

It is closer to:

An interview can feel demanding without necessarily measuring something relevant to future job performance.

The same caution applies to every selection method.

A difficult test is not automatically a useful test.

A confident interview performance is not automatically evidence of strong workplace performance.

And an impressive CV does not automatically tell us how someone will handle the situations the next job will actually present.

Interviews remain valuable—but they cannot answer everything

Modern research does support structured interviews as a useful selection method.

A major 2022 re-evaluation of personnel-selection research by Sackett, Zhang, Berry and Lievens found structured interviews among the strongest selection procedures examined. At the same time, the researchers concluded that relationships between selection methods and subsequent performance were generally lower than some historically quoted estimates.

That should encourage balance rather than replacing one hiring fashion with another.

A well-designed structured interview can provide valuable information.

A technical exercise can provide different information.

A work sample provides another perspective.

Relevant psychometric assessments may contribute evidence about reasoning abilities or behavioural tendencies.

Previous experience adds context.

References and appropriate background checks can add still more information.

The strongest question is therefore not:

“Which one hiring method should we trust?”

It is:

“What do we need to understand about this role, and what evidence will help us understand the candidate against those requirements?”

Psychometrica's Pre-Recruitment Packages reflect this broader idea by combining different assessment dimensions for different recruitment situations rather than treating one score as the entire hiring decision.

Similar experience can hide very different experiences

Years of experience are particularly easy to misunderstand.

Two candidates may each have “five years of experience.”

But those five years may not have required the same things.

One person may have repeatedly handled familiar processes in a stable environment.

Another may have moved between projects, learned new systems and dealt frequently with unfamiliar problems.

One may have had considerable independence.

Another may have worked within detailed supervision.

One may have spent years interacting with customers and stakeholders.

Another may have developed deep technical expertise while working largely independently.

The length of experience is identical.

The experience itself is not.

The same applies to education.

Two graduates from the same course may have encountered the same curriculum but developed different ways of thinking, learning, collaborating and responding to responsibility.

A qualification establishes something important.

It does not establish everything.

Job fit is not about finding one ideal personality

This conversation can easily become misleading if “job fit” is interpreted as finding one type of person who succeeds everywhere.

That is not the point.

A person who thrives in a highly structured role may find a constantly changing, ambiguous environment exhausting.

Another person may enjoy exactly that uncertainty but become frustrated by work requiring strict repetition and procedure.

Someone may be excellent at independent analytical work but have little interest in spending most of the day managing stakeholders.

Another may gain energy from interaction and struggle with prolonged solitary work.

The hiring question therefore should not simply be:

“Is this a good candidate?”

A more useful question is:

“How well do this person's capabilities, tendencies, interests and experience correspond with what this particular role actually requires?”

Research into person–job fit supports taking that relationship seriously. A large meta-analysis covering 172 studies examined links between different forms of workplace fit and outcomes including job attitudes, performance, withdrawal behaviour, strain and tenure.

Fit is not a guarantee of success.

But neither is it an irrelevant HR concept.

A wrong fit can hurt the candidate too

Organisations usually discuss bad hiring in terms of cost.

Recruitment costs.

Training costs.

Lost productivity.

Managerial effort.

Replacement hiring.

Those consequences matter.

But there is another person involved in the hiring decision.

The candidate.

Imagine someone joining a role because their technical background appears perfect.

A few months later, the reality becomes clearer.

The job requires far more stakeholder interaction than expected.

Or far more ambiguity.

Or substantially more repetitive procedural work.

Or rapid independent decision-making.

Or people management when the person would rather remain a technical specialist.

Performance begins to fall below expectations.

Confidence declines.

The manager becomes frustrated.

The employee becomes disengaged.

Eventually, they leave—or are asked to leave.

From the organisation's perspective, this may be recorded as a bad hire.

From the employee's perspective, it can feel like personal failure.

Sometimes the underlying problem is simpler:

the role and the person were not a particularly good match.

Research on realistic job previews reinforces the importance of the employee understanding what they are joining. Meta-analytic research has linked realistic previews with outcomes including expectations and voluntary turnover, partly through employees' perceptions that the organisation has been honest with them.

Hiring therefore works in both directions.

The employer is evaluating the candidate.

The candidate should also be given enough information to evaluate the job.

Better hiring is about better evidence

A CV remains useful.

Qualifications remain important.

Technical knowledge remains essential for technical work.

And interviews remain an important part of recruitment.

The problem begins when any one of these is expected to answer questions it was never designed to answer.

A more thoughtful hiring process starts with the role.

What knowledge is required?

What problems will this person actually encounter?

How quickly will they need to learn?

How much ambiguity will they face?

How independently will they work?

What kinds of interactions will occupy their day?

What responsibilities will they carry?

What kind of environment will they be entering?

Only then should organisations decide what combination of evidence will help them evaluate candidates.

That may include technical assessments, structured interviews, work samples, relevant psychometric assessments, experience and other appropriate information.

The goal is not to turn hiring into a laboratory experiment.

And it is not to remove human judgment from recruitment.

It is simply to give human judgment better information to work with.

Because when two candidates look almost identical on paper, the things that distinguish their eventual experience at work may be precisely the things the CV never showed.

Frequently Asked Questions

Why can two candidates with similar qualifications perform differently?

Qualifications demonstrate education or technical preparation, but workplace performance can also involve reasoning, learning, behavioural tendencies, motivation, previous experiences and the specific demands of the job. Two candidates with similar credentials can therefore approach the same workplace situation differently.

Is technical knowledge not enough when hiring?

For many jobs, technical knowledge is essential. The issue is not whether it matters, but whether it provides all the information required for a particular role. Jobs involving unfamiliar problems, learning, decision-making, collaboration or changing circumstances may require additional capabilities beyond existing technical knowledge.

Can interviews identify problem-solving ability?

Interviews can provide useful evidence, particularly when they are structured and based on job-relevant criteria. However, an interview should not automatically be assumed to measure every capability relevant to a job. Work samples, technical exercises and appropriate assessments can sometimes provide complementary information.

What did Google learn from its hiring process?

Google reported that some of its earlier hiring practices—particularly brainteaser questions and historical interviewer ratings—were not providing the predictive information it had expected. The company subsequently emphasised more structured interviews and job-relevant assessment approaches. This does not mean Google abandoned interviews; rather, it illustrates the importance of evaluating whether a selection method measures something relevant to future work.

What does job fit mean in recruitment?

Job fit refers broadly to the relationship between a person's characteristics and what a particular role requires. It should not be interpreted as finding one “ideal personality.” Different roles can demand different combinations of knowledge, abilities, behaviours and ways of working.

Can psychometric assessments decide which candidate should be hired?

They should not be used as the sole basis for a major hiring decision. Relevant psychometric assessments can provide structured information about particular abilities or behavioural tendencies, which should be considered alongside interviews, qualifications, experience, technical evaluation and other job-relevant evidence.

Why does job fit matter to candidates as well as employers?

A poor fit can leave an employee working in an environment or role whose demands differ significantly from their expectations or strengths. That can contribute to dissatisfaction, difficulties meeting expectations and eventual turnover. Better hiring therefore benefits both sides when it helps organisations and candidates understand the role more realistically.

References

1. Google Student Blog. How are interviews at Google different? June 19, 2015. Google described the use of structured interviews, work-sample-style technical assessment and cognitive-ability-related evaluation within its hiring process.
2. Bock, L. / Google hiring observations, reported by Wired and other publications. Google's analysis of historical interview data and its move away from brainteasers were discussed publicly beginning in 2013.
3. Sackett, P. R., Zhang, C., Berry, C. M., & Lievens, F. Revisiting meta-analytic estimates of validity in personnel selection: Addressing systematic overcorrection for restriction of range. Journal of Applied Psychology, 2022, 107(11), 2040–2068.
4. Kristof-Brown, A. L., Zimmerman, R. D., & Johnson, E. C. Consequences of Individuals' Fit at Work: A Meta-Analysis of Person–Job, Person–Organization, Person–Group, and Person–Supervisor Fit. Personnel Psychology, 2005, 58, 281–342.
5. Earnest, D. R., Allen, D. G., & Landis, R. S. Mechanisms Linking Realistic Job Previews With Turnover: A Meta-Analytic Path Analysis. Personnel Psychology, 2011, 64, 865–897.
6. Phillips, J. M. Effects of Realistic Job Previews on Multiple Organizational Outcomes: A Meta-Analysis. Academy of Management Journal. Meta-analysis of 40 studies examining recruitment attrition, expectations, performance and turnover.