VIDEO Q&A (1:21 min)
Rachel Wolford is the Product Manager for the Triplebyte Assessments team. Eric Bakan leads the Triplebyte Machine Learning team.
Do you show the specific assessment questions that candidates have answered?
RACHEL: We don't show specific questions for a number of reasons. One reason is that the interpretation of a question internally, in terms of grading a candidate's abilities, depends on a lot of factors that are not just the text of the question. We know empirically that some questions are more difficult than they look, or are easier than they look, or do a worse job or better job of differentiating candidates than it looks like they do. We think that, insofar as our questions are predictive, using empirically-verified measures of their difficulty and power is better than relying on subjective impressions of those questions on the recruiter's side.
ERIC: Riffing on what Rachel is saying, the specific questions that a candidate gets right and wrong aren't always super representative of their actual knowledge or their ability to perform in that skill area. [Displaying] specific questions that they got right and wrong might be helpful for understanding what are the types of questions that we ask, what is the content that we're looking for, what are the sorts of skills that we expect candidates to be able to demonstrate, or what sort of skills could they show off in an interview. But when we've done interviews with candidates and companies, we haven't found specific questions to be super helpful in increasing that understanding or that confidence.
Please Note: Current Triplebyte company users must create an account and log in to see the complete Company Help Center. Some general content is visible in logged-out mode, with additional content available for logged-in users. Learn how to set up your Company Help Center account.