How to conduct a structured interview

Action sheet

Structured interviews are over 2x better than standard unstructured interviews at identifying talent. What’s the secret?

Myth

Hiring managers consistently claim that standard (unstructured) interviews are highly effective for finding good hires.

Reality

Unstructured interviews are among the worst predictors of on-the-job success. Structured interviews are over 2x better at identifying talent.

So: How can I conduct a structured interview?

  1. Before the Interview

    What are the most important qualities for a successful candidate to have? Rank them before you set eyes on the candidates and try to make sure you ask questions assessing those competencies.

    Write out your questions. Ask each candidate the same questions in the same order to reduce subjectivity and make it easier to compare candidates.

    For each question, have specific follow-up questions at the ready. Aim to make them as similar as possible across candidates. This lets you dig deeper while still staying on script.

    Pilot test. Testing your questions ahead of time ensures that they’re phrased to produce the data you’re looking for. Try a mock interview with a colleague. Make sure the environment and process is close to the real thing.

    Make a rubric. Attempt to remove subjectivity in scoring responses by creating a rubric for each question (e.g., a 1-5 scale). Include example responses for each score on the scale. This will help quantify who the best candidate really is.

    Create a “Resume Form” for your company. Applicants may emphasize or omit information when they are allowed to submit their own resumes. Create a resume form tailored to your organization’s needs to get relevant information (in the same order) from each candidate.

  2. During the Interview

    Use the same, diverse set of interviewers for all candidates. A diversity of interviewers is like having diversity in your financial portfolio; it is protective. Having a diverse set of opinions on candidates makes it more likely you’ll make the best choice.

    Take good notes. Memories are flawed and are influenced by everything from first impressions to how tired you are. Try to score answers immediately for all candidates so you aren’t relying on your potentially faulty memory.

    Stick to your script.

  3. Evaluating the Interview

    Remove the word “fit” from your vocabulary...unless you are prepared to explain exactly what you mean by it (not easy!). “Good fit” is often just a proxy for “I like their personality” or “They like the same things I do.”

    Avoid discussing candidates in informal settings. If conversations about candidates are occurring at the water cooler, the loudest voices or opinions of more senior employees can shape what others will say, creating a false sense of consensus. Also try to keep written evaluations private until it’s time to know what each evaluator thinks. In fact, if your group seems to be in strong agreement about candidates, become skeptical and ask which hidden bias may be operating.

    State both positive and negatives of each candidate. In the final discussion, ask for both the ups and downs of each candidate. They all have them! When only positive comments are mentioned, we tend to over-accentuate the good qualities of our preferred candidate.

Subscribe to Outsmarting Implicit Bias

References

DeVaul RA, Jervey F, Chappell JA, Caver P, Short B, O’Keefe S. Medical School Performance of Initially Rejected Students. JAMA. 1987;257(1):47–51. doi:10.1001/jama.1987.03390010051027

Highhouse, S. (2008). Stubborn reliance on intuition and subjectivity in employee selection. Industrial and Organizational Psychology, 1(3), 333-342.

Kahneman, D. (2011). Thinking, Fast and Slow. Macmillan.

Malouff, J. M., Stein, S. J., Bothma, L. N., Coulter, K., & Emmerton, A. J. (2014). Preventing halo bias in grading the work of university students. Cogent Psychology, 1(1), 988937.

Quinn, D. M. (2020). Experimental evidence on teachers’ racial bias in student evaluation: The role of grading scales. Educational Evaluation and Policy Analysis, 42(3), 375-392.

Rivera, L. A. (2012). Hiring as cultural matching: The case of elite professional service firms. American Sociological Review, 77(6), 999-1022.

Schmidt, F. L., & Hunter, J. E. (1998). The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings. Psychological Bulletin, 124(2), 262.

Uhlmann, E. L., & Cohen, G. L. (2005). Constructed criteria: Redefining merit to justify discrimination. Psychological Science, 16(6), 474-480.

Credits

Outsmarting Implicit Bias is a project founded by Mahzarin Banaji, devoted to improving decision-making using insights from psychological science.

This action sheet was written by Olivia Kang, Alex Sanchez, Caitlyn Finton, and Mahzarin Banaji.

Artwork by Olivia Kang and Evan Younger.

Support for Outsmarting Implicit Bias comes from PwC, P&G, and Harvard University.