What an AI interview platform is, and how to evaluate one

The phrase covers several different products, and most disappointment with them starts with buying one kind while expecting another. Broadly there are three.

• Recorded interviews with automated review. The candidate sees a question on screen, records an answer against a timer, and moves to the next one. The questions are fixed in advance. Software may transcribe or score the answers afterwards.
• Chat and text screeners. Questions arrive by chat or text message. Good at eligibility questions and booking calls; rarely an interview in any real sense.
• Conversational interviewers. The candidate speaks with an AI that listens to each answer and decides what to ask next, including a follow-up when the answer was thin. This is the closest thing to a human first-round screen.

A fourth category often appears in the same searches: tools that record and summarise interviews held by people. Those help an interviewer take notes. They do not conduct the interview, so they do not remove the scheduling problem.

Career1 is the third kind. Its AI interviewer holds a spoken conversation in the browser, builds its questions from the job and the applicant's resume, and follows up on the answers.

This is the criterion that decides whether the tool is an interview at all. A first answer is the part a candidate can rehearse, and every prep guide teaches the same one.

The second question (what exactly did you do, what broke, what would you change) is where borrowed experience runs out. A fixed list cannot ask it.

Structure still matters. A widely cited 2022 re-analysis of personnel selection research ranked structured interviews among the most predictive hiring methods it examined. The goal is a consistent structure with room to probe, not a script.

You can test this in five minutes. Take the interview yourself and give one deliberately vague answer, such as "I led a big migration and it went well."

A conversational interviewer asks what you migrated, what went wrong, or what your part was. A script moves on to question three.

Check where the questions come from as well. Questions built only from the job description are the same for every applicant. Questions that also draw on the applicant's resume can test whether the experience they listed is real, which is most of what a first-round screen is for.

A score on its own is not evidence. Your hiring manager will disagree with some of them, and the question is whether they can check the reasoning in two minutes or have to take a number on trust. Ask every vendor for a sample report and look for:

• the full transcript, and ideally the recording;
• the specific answers behind each judgement, quoted rather than summarised;
• risks and gaps, not only strengths;
• a recommendation the reviewer can overrule, with the reasons it gave.

For reference, this is what a Career1 report contains for each applicant: a match score against the role, an overall interview score, a recommendation from strong hire to no hire, scores with a written rationale for technical depth, communication, problem solving, experience fit and culture fit, a ledger of the skills on the resume showing whether each one was demonstrated (with a quote), strengths, risks, required skills that were not shown, and suggested questions for the next, human, round. The transcript and recording sit next to it.

Your strongest applicants usually have other options, and they are the likeliest to abandon a process that feels like a chore. Take the interview on a phone, as a candidate would, and note:

• Length. Long enough to test a few skills properly, short enough to finish on a lunch break.
• Access. Whether it runs in a browser or needs an app, and whether it works on a phone with an ordinary connection.
• Scheduling. Whether the candidate can start at any hour, or has to book.
• Disclosure. Whether it is clear from the start that the interviewer is an AI.
• Language. Which languages the interview can run in.

Career1's interview takes about eight minutes and is capped at ten. It runs in the browser on a laptop or a phone, with nothing to install and no time to book, and the room is labelled as an AI interview.

Candidates never pay. At the time of writing the interview is conducted in English only.

Any system that ranks people can encode bias, whether it is software or a tired recruiter reading the fortieth resume. The useful questions are specific.

• What is scored? The content of the answers, or signals such as voice, facial expression or video quality that have little to do with the job?
• Is it consistent? Does every applicant for a role get the same structure and the same criteria?
• Can a person check it? Is the evidence behind every score visible to the reviewer?
• Does it reject anyone automatically, or does it rank candidates for a person to decide?

Some of this is now law. New York City's Local Law 144 requires a bias audit within one year before an automated employment decision tool is used, public information about that audit, and notices to candidates.

Illinois's Artificial Intelligence Video Interview Act requires employers to explain and get consent before AI evaluates a video interview, and to delete the videos on request. The EU AI Act lists AI systems used to evaluate job candidates among its high-risk uses (Annex III). None of this is legal advice; ask counsel what applies to you.

Career1 is one of those tools, and so is every product on this page. An eight-minute interview that scores candidates and ranks a shortlist is an automated employment decision tool under Local Law 144 when the role sits in New York City, and it is an Annex III system in the EU.

The duties fall on the employer, not the vendor: New York's own guidance says the vendor that built the tool is not responsible for its bias audit, and an auditor is not independent if they work for the vendor. Ask any vendor, including us, whether they will commission an audit and share the results; the obligation to have one still sits with you.

On Career1, the report is written from the transcript, the resume and the job. The video is recorded so people can watch it; it is not analysed for faces or expressions. Every applicant to a role gets the same interview structure, and Career1 does not reject anyone: it ranks and recommends, and your team decides.

Interview recordings are among the most sensitive material in hiring. Before you sign up, get written answers to these:

• What is recorded: audio, video, the transcript, or all three?
• Who at the vendor can access it, and who on your team can?
• How long is it kept, and can a candidate have it deleted?
• Is candidate data used to train models, and can you opt out?
• Do candidates see their own results?

Career1 records the interview (audio, video and transcript) to produce the report, and the interview room tells candidates it is recorded before they start. Its terms say interview results belong to the candidate and are shared with the company they applied to, and that Career1 does not sell candidate data.

Applying to your job does not put anyone in Career1's separate talent pool; only a candidate who signs up and takes its vetting interview joins it. The published terms do not set a retention period for interview recordings, so if your policy requires one, ask before you start.

Pricing in this category tends to follow one of four shapes: per recruiter seat, per interview or credit, a monthly allowance of interviews in tiers, or an annual platform contract agreed on a sales call. None is wrong. What matters is how it behaves at your real volume.

• What counts as a billable interview: started, completed, or abandoned halfway?
• What happens when you reach the limit mid-month?
• Are the report, transcript or recording reserved for a higher tier?
• Is there a minimum contract length?

Career1 uses monthly plans priced by the number of candidates vetted, with a free plan for two candidates a month that needs no card.

Reports, recordings and transcripts are included on every plan. When a plan's allowance is used up, live jobs pause until it renews. Current plans are on the pricing page.

A tool nobody remembers to use screens nobody. Ask how an applicant reaches the interview: automatically when they apply, or only when someone on your team sends a link. Ask whether results sync into the system you already track candidates in, and whether you can keep advertising the role where you do today.

On Career1, each company gets a careers page and a page per job, and applying triggers the interview automatically, so nobody has to remember. The job link can be posted anywhere you advertise. Career1 is not an applicant tracking system and does not sync with one at the time of writing; if you run an ATS, read whether you need both.

1. Set up a test role that matches a real one you hire for.
2. Apply to it yourself, on a phone, as a candidate would.
3. Give one strong answer and one vague one, and see what happens after each.
4. Read the report. Pick two claims in it and find the evidence in the transcript. Time how long that takes.
5. Ask a colleague in a different role to apply as well, and compare the two reports for anything that looks generic.
6. Read the terms on recording, retention and deletion.
7. Work out the monthly cost at your real applicant volume, including the month you get three times as many.

Career1's free plan covers two candidates a month with no card, which is exactly enough for steps 2 to 5.

• You need an applicant tracking system. Career1 interviews and ranks applicants; it does not replace an ATS.
• Your first screen is a work sample. If what you need is a coding exercise, a writing test or a portfolio review, a conversation does not replace it.
• You interview in a language other than English. The interview is English-only at the time of writing.
• Screening is purely eligibility. If the only questions are a licence, shift availability or right to work, a form answers them faster than any interview.
• You need references or an audit before buying. Career1 is a new product. If your process requires customer references or an independent bias audit first, it cannot give you those yet.
• You hire rarely, from a handful of applicants. Five applicants a year is five phone calls. An interview platform earns its place when volume makes calling everyone impossible.