Example listing with a fictional company — for demonstration only, not a live vacancy.

Back to AI Jobs
AI Evaluation

AI QA Engineer

Northbridge Analytics

New YorkOn-siteMid-levelFull-time$90k–120k
Apply Now
Example — Signed-In Preview

Your Match

This is what a signed-in ITtoAI member sees here, based on their verified skill profile. Sign in and complete your AI Readiness Assessment to see your own match.

MATCH SCORE FOR THIS ROLE

Based on verified skills against AI QA Engineer's required capabilities. A higher score reflects closer skill alignment — it does not guarantee an interview or offer.

Matched Skills

Python

Skill Gaps

AI TestingAI EvaluationLLM QA

RECOMMENDED PREPARATION

Focus on Evaluation methodology and testing for AI systems, then build practical evidence with a project like AI Research Agent. Revisit the relevant section of the AI Readiness Assessment to track progress.

Illustrative example. Match scores reflect assessed skill alignment — they do not guarantee an interview, offer or hiring outcome.

Job details

Overview

Northbridge Analytics is hiring an AI QA Engineer to build rigorous testing and evaluation practices around its AI-powered analytics features — ensuring model outputs are accurate, safe and consistent.

Responsibilities

  • Design test suites for LLM-based features, including regression and edge-case testing.
  • Build evaluation frameworks to measure output quality and safety.
  • Partner with engineering to triage and reproduce AI-specific defects.
  • Track and report on model quality metrics over time.
  • Advocate for testable, observable AI system design.

Required Skills

PythonAI TestingAI EvaluationLLM QA

Preferred Skills

Python Test AutomationAI FundamentalsResponsible AI

AI Technology Stack

PythonEvaluation FrameworksPrompt Regression ToolsCI/CD Pipelines

Interview Process

What to expect

Application Review

Initial review of your profile, projects and assessed skills.

Technical Screen

A conversation covering test design for LLM-based systems.

Practical Exercise

Write an evaluation suite for a sample AI feature.

Team Interview

Meet the QA and engineering teams to discuss quality practices.

Ready to take the next step?

Applying connects you with the ITtoAI team — your verified profile and assessed skills go with you.

Apply Now

This is an example listing. Match scores and outcomes are illustrative and do not guarantee employment or hiring.