eval. today.
And what’s next.
From setting up a round to reviewing a candidate’s work, see how eval. fits together today — and how the next five months could build on it.
Start with the productThe product, in five slides.
In the current buildgroup-by.js
export function groupBy(items, keyFn) { // Read the task. // Build your solution. }
Explain your
trade-offs.
Current question
const result = items .filter(isActive) .map(toSummary);
Final verdict: reviewer’s decision
Next: useful at every step of hiring.
Proposed target windows
Final scope and timing
follow validation.
December
2026
01 / ConsistencyInterview kits & evidence briefs
For companies
One approved plan.
A clearer reason for every rating.
Reuse role-specific interview plans and give reviewers a concise brief linked to the candidate’s actual work.
Delivery scope
- Versioned kits with questions, timing, competencies, and scoring anchors.
- A printable, single-interview brief with evidence links and reviewer approval.
- A small set of company-reviewed answers to seed scoring calibration.
Success looks likeA team reuses a published kit, and a reviewer can trace a brief’s claims to saved evidence.
January
2027
02 / OperationsRecruiter workflows & candidate support
For companies
Less coordination.
More time for the right
conversations.
Organize interview batches, follow up on outstanding work, and help candidates clarify the task within agreed boundaries.
Delivery scope
- Explicit job/application links; CSV preview, batch invitations, and assignments.
- Per-row failures, manual reminders, and retries with clear operational status.
- Question-linked messaging and an opt-in AI clarification pilot that excludes solution guidance.
Success looks likeA recruiter can identify and retry failed rows without recreating successful invitations.
February
2027
03 / Real workWork simulations & assessment calibration
For companies
See how candidates investigate,
fix, and verify.
Assess realistic debugging work across files. Check how grading changes against answers your reviewers have already assessed.
Delivery scope
- Multi-file question generation, file navigation, and complete file-map submissions.
- One selected runtime with isolated execution and public test feedback.
- Reference answers, current/proposed grading comparisons, and human review of differences.
Success looks likeOne bounded debugging exercise runs end to end, with execution evidence and reviewable grading changes.
March
2027
04 / ConnectionATS screening workflows & team handoffs
For companies
Screen candidates inside
your existing hiring flow.
An event in the organisation’s ATS triggers an Eval screening interview. Results return to the same candidate profile for the hiring team to review.
Delivery scope
- Map the ATS job and stage to a screening plan; preserve the application ID.
- Create and invite through a webhook to Eval’s API; retry without duplicate interviews.
- Return reviewed results to the ATS; support candidate comparisons and next-round briefs.
- Your ATSCandidate reaches screening stage
- Webhook to EvalCandidate profile, job & stage
- Screening interviewCreate, invite & assess
- Back to the ATSScores, summary & report link
Success looks likeAn ATS webhook starts one screening round; its reviewed result returns to the correct candidate/application, with delivery and retries tracked.
April
2027
05 / ConversationConversational AI interviews
For companies
A natural conversation.
A structured assessment.
Let an AI interviewer ask, listen, and follow up within an approved plan, with a familiar, authorized voice and a report people can review.
Delivery scope
- One spoken interview format: approved questions, bounded follow-ups, and interruption handling.
- Correctable transcripts, confirmed answers, question-linked grading, and human review.
- An authorized custom-voice trial, clear AI introduction, and per-interview voice/LLM usage tracking.
Success looks likeA complete spoken round produces saved, question-linked answers and a reviewable assessment.
One platform. More kinds of interviews.
Exploration / not yet scheduledMore roles. More realistic work.
Expand from the first debugging and spoken rounds into sales, support, product, and design work samples.
A broader hiring stack.
Extend the first ATS pilot into additional connectors and scheduling workflows, guided by company demand.
Richer conversational rounds.
Explore voice alongside coding and whiteboards, more languages, and additional authorized interview voices.