Proctor Quality and Learning Manager, Scaling Operations

New York, NY · Pittsburgh · USD 142,800-193,200 · 5+ years experience · Remote · Posted Sep 30, 2026

At a glance

As the Proctor Quality and Learning Manager in Scaling Operations at Duolingo, you will own the end-to-end quality standard and learning system that keep the global proctor network aligned and effective.
You will define standards, run calibration and adjudication programs, and build ongoing training to ensure the integrity of the Duolingo English Test.
This is an individual-contributor role within DET Proctoring Operations with functional leadership over Training Specialists and adjudicators.

Own the DET proctoring quality standard by maintaining rubrics, decision rules, examples, and guidance.
Lead calibration and adjudication by operating recurring Proctor Certification Test cycles and resolving disputed decisions.
Build and run an ongoing learning program, including publishing a training calendar and delivering monthly interventions.
Measure effectiveness using calibration results, audits, and performance trends to evaluate training impact.
Guide specialist execution by setting expectations, reviewing outputs, and operating onboarding and certification.
Maintain durable sources of truth by keeping calibration, adjudication, and training runbooks current.
Evolve quality alongside proctoring by translating new threats and workflow changes into clear standards and controls.
Represent the proctoring craft by bringing frontline proctor evidence into product experiments and workflow decisions.
Connect human and technology-assisted quality by establishing benchmarks for AI-assisted workflows and validating automated capabilities.

5+ years in assessment development, scoring/rater quality, certification, quality assurance, or a field involving complex, consequential judgments.
Adult-learning program experience spanning onboarding, certification, ongoing training, remediation, and effectiveness measurement.
Exceptional attention to detail and strong judgment in ambiguous cases to produce clear, defensible decisions and guidance.
Analytical fluency to interpret quality data, disagreement patterns, and performance trends into practical interventions.
Clear written and verbal communication skills to turn complex standards into precise, usable guidance.
Cross-functional leadership without formal authority, including directing contractors or partners toward accountability and outcomes.
Demonstrated skill in quality standards and rubric design, building living systems with decision logs and audit controls.
Experience defining quality benchmarks and validation methods for human-technology workflows, including AI-assisted processes.
Adaptability and comfort revising standards and programs as risks, products, and technology change.