Job Description
Executive Director, Advanced Placement, Curriculum and Assessment, Reading and Scoring
College Board – Advanced Placement & Instruction
Location: This is a fully remote role. Candidates who live near CB offices have the option of being fully remote or hybrid (Tuesday and Wednesday in office).
Role Type: This is a full-time position
About the Team
The AP Curriculum and Assessment Team at College Board (110+ staff) collaborates with colleagues across all aspects of the AP Program to develop, manage, and deliver AP’s 40+ courses in a wide variety of subject areas. AP® is a rigorous academic program built on the commitment, passion, and hard work of students and educators from secondary schools and higher education. AP provides willing and academically prepared high school students with the opportunity to study and learn at the college level.
The AP Reading and Scoring function lies at the heart of AP’s assessment integrity and instructional value. Each year, more than 18,000 college faculty and AP teachers convene to evaluate millions of student responses, ensuring scoring quality, fairness, and consistency across subjects. The AP Curriculum & Assessment (C&A) team—through its leadership of Reader training, scoring guidelines, standard and grade setting, and publications—ensures that each exam score represents a valid, reliable measure of student achievement aligned to college-level standards.
About the Opportunity
As Executive Director, Advanced Placement, Curriculum & Assessment, Reading and Scoring, you will lead the strategy, systems, and professional learning infrastructure that power the AP Reading—the foundation of scoring excellence and validity across 40+ AP subjects.
You will serve as the operational and strategic leader for the planning, training, and systems that enable the 18,000+ AP Readers, 40+ Chief Readers, and 80+ internal Course Experts in AP Curriculum & Assessment to execute scoring with fidelity, accuracy, and consistency. This includes leadership over Reader training and readiness, the development and maintenance of scoring guidelines and generic rubrics, the annual grade- and standard-setting processes, and the Reading publications library, as well as ongoing innovation to advance AP scoring quality and efficiency.
Each year, the systems and teams you lead will enable more than 18,000 faculty and AP teachers to accurately score over 20 million student responses across 40+ AP subjects and multiple exam versions. Your leadership will ensure that every AP Exam score reflects fairness, validity, and reliability—empowering students, teachers, and institutions to trust in the rigor and accuracy of AP assessment.
You will collaborate closely with the AP Curriculum & Assessment Leadership Team, within which you will sit, as well as AP Assessment Production, AP Delivery, and AP Psychometrics to ensure the reliability, validity, and fairness of scoring processes and outputs. You will also champion cross-functional alignment, ensuring that all Reading, scoring, and standard-setting activities are planned, executed, and communicated with clarity and excellence.
You will directly lead three senior staff members:
Senior Director, AP Reader Training
Senior Director, Reading Publications and Quality Assurance
Senior Project Manager, Reading, Scoring, and Coordination
In this Role, You Will:
Drive AP Reader Training and Course Expert Readiness (25%)
Lead the strategy and execution of training programs that prepare 18,000+ AP Readers and scoring leaders annually to score 20 million+ student responses across 40+ AP subjects.
Advance training and readiness of 80+ internal AP Course Experts, ensuring all are prepared to facilitate Pre-Reading Prep, Pre-Reading, and Reading activities across all AP Exams.
Develop and deliver the annual AP Reader learning courses, training modules, user guides, and job aids, ensuring readiness by mid-May each year.
Lead the AP Internal Training Series, ensuring C&A staff receive end-to-end training on Pre-Reading planning, sample selection, annotation, digital scoring tools, and post-administration publications.
Partner with AP Assessment Leadership and AP Delivery to ensure training systems, LMS environments, and scoring applications operate seamlessly and meet needs to train Readers and execute all scoring at the AP Reading.
Integrate learning science, accessibility, and AI-driven design tools to improve training quality, efficiency, and consistency.
Establish systems to measure Reader confidence and scoring consistency, achieving a goal of 90% Reader agreement that scoring materials enable accurate and consistent scoring.
Guide the annual selection process of the new cohort of Chief Reader Designates in partnership with AP Delivery.
Develop and Produce Scoring Assets (20%)
Lead the annual development and review of 650+ scoring guidelines across 40+ AP subjects, ensuring alignment with course frameworks, psychometric standards, and instructional validity.
Lead the maintenance and evolution of AP’s library of generic rubrics to ensure consistent, transparent application across all subjects and exam formats.
Direct the development of all Reading planning workbooks (five-part Smartsheet suite) used to identify sample-selection requirements and scoring leadership needs for multiple forms (4–5) across 38 courses.
Lead creation of post-administration publication templates and assets, including Chief Reader Reports, Free-Response Questions, scoring commentaries, Summer Institute workshop packets, and AP Central materials for multiple forms across all subjects.
Partner with AP Assessment to maintain and provision gold-source documentation for scoring systems, including dimension names, IDs, score scales, and form data.
Partner with AP Publications and AP Professional Learning teams to ensure all scoring and publication materials meet accuracy, accessibility, and instructional value standards.
Provide oversight and escalation for all test-security processes related to Exam and Reading assets, ensuring management of timely responses to flagged or exposed content as well as student work flagged as plagiarized or compromised, in alignment with CB Test Security standards and processes.
Drive Innovation, Systems Integration, and Continuous Improvement (20%)
Lead modernization of Reading systems, processes, and training through digital tools and generative AI for workflow automation, content generation, and efficiency.
Advance integration across SharePoint, Smartsheet, LMS, and vendor platforms to enhance coordination, transparency, and reporting.
Define annual technical and MVP requirements for the scoring application, in collaboration with AP Assessment and AP Delivery leaders.
Guide the establishment of calibration and quality configurations supporting AP calibration, rater performance, and validity standards.
Lead data-driven retrospectives to assess rubric design, scoring performance, and training outcomes, implementing improvements across cycles.
Lead and Manage the AP Reading and Scoring Team (15%)
Lead a team of 3 that is responsible for the planning and execution of the annual Reading, ensuring all student responses are scored accurately and fairly, according to assessment best practices.
Set vision and priorities for the team, track and manage progress to goals, and provide coaching and support to ensure team members meet and exceed goals, remain engaged, and contribute meaningfully to our mission.
Cultivate an inclusive and high-achieving culture that enables all team members to live out College Board’s
Operating Principles
effectively.
Bring proven leadership experience and consistently embody College Board’s
Manager Expectations
in your work.
Lead Standard Setting and Grade Setting (10%)
Lead the annual grade-setting process across 40+ AP subjects, ensuring all cut scores are determined through rigorous psychometric methods and established College Board standards.
Collaborate with AP Psychometrics and AP Curriculum & Assessment Course Teams to analyze performance data and establish cut scores for multiple exam forms per subject.
Ensure 100% of AP Exam cut scores are based on psychometric best practices, including equating or Evidence-Based Standard Setting (EBSS), to uphold fairness, validity, and reliability across administrations.
Lead EBSS standard setting processes for selected subjects annually, partnering with Psychometrics and C&A Course Teams to develop the Briefing Book, conduct data analyses, and support the evaluation of score outcomes.
Maintain and analyze AP Exam performance data to inform internal reporting, trend analysis, and continual improvement of exam design, scoring accuracy, and operational quality.
Ensure that by June 30 each year, cut scores are finalized for multiple exam forms across all AP subjects, supporting valid and reliable score setting.
Partner with AP leadership to communicate grade-setting outcomes and ensure alignment between psychometric analyses, scoring policies, and instructional intent.
Lead the documentation, validation, and archival of standard- and grade-setting processes in compliance with College Board research and quality standards.
Strategic Planning (10%)
Lead annual strategic and operational planning cycles for Reading and Scoring, ensuring capacity, change initiatives, and performance metrics align with AP’s strategic priorities.
Partner with finance and operations to ensure fiscal responsibility and strategic use of resources.
Track progress toward AP Program scoring goals and report key outcomes to AP leadership.
About You
You have
10+ years of experience leading high-impact programs with expertise in large-scale assessment operations, scoring, or training systems within complex organizations, ideally in education, nonprofit, or mission-driven environments
Deep understanding of assessment design, scoring quality, rubric development, and learning systems.
Proven ability to apply emerging technologies—including generative AI—to improve scoring and training workflows.
A strategic and inclusive leadership style: you set clear priorities, build effective team structures, plan for future needs, and foster a culture of belonging.
A systems-thinking mindset: you thrive in complexity and create clarity through structure, communication, and data-driven decision-making.
Ability to execute work as both a leader and collaborator across a variety of different internal teams using exceptional communication skills to inspire collaboration.
A master’s degree in a relevant field is required; an advanced degree is strongly preferred.
Willingness to travel approximately 6 times per year, including 2–4 weeks from late May to mid-June for the on-site AP Readings.
All roles at College Board require:
A passion for expanding educational and career opportunities and mission-driven work
Curiosity and enthusiasm for emerging technologies, with a willingness to experiment with and adopt new AI-driven solutions and a comfort learning and applying new digital tools independently and proactively.
Clear and concise communication skills, written and verbal
A learner's mindset and a commitment to growth: welcoming diverse perspectives, giving and receiving timely, respectful feedback, and continuously improving through iterative learning and user input.
A drive for impact and excellence: solving complex problems, making data-informed decisions, prioritizing what matters most, and continuously improving through learning, user input, and external benchmarking.
A collaborative and empathetic approach: working across differences, fostering trust, and contributing to a culture of shared success.
Authorization to work in the United States
About Our Process
Application review will begin immediately and continue until the position is filled.
While the hiring process may vary, it generally includes: resume and application submission, recruiter phone/video screen, hiring manager interview, performance exercise (such as a work simulation), a panel interview, a conversation with leadership, and reference checks.
What We Offer
At College Board, we offer more than a paycheck—we provide a meaningful career, a supportive team, and a comprehensive package designed to help you thrive. We’re a self-sustaining nonprofit that believes in fair and competitive compensation grounded in your qualifications, experience, impact, and the market.
A Thoughtful Approach to Compensation
The hiring range for this role is $144,000–$215,000.
Your exact salary will depend on your location, experience, and how your background compares to others in similar roles at the College Board.
We aim to make our best offer upfront, rooted in fairness, transparency, and market data.
We adjust salaries by location to ensure fairness, no matter where you live.
You’ll have open, transparent conversations about compensation, benefits, and what it’s like to work at College Board throughout your hiring process. Visit our careers page for more.
#LI-REMOTE
#LI-AP1
College Board – Advanced Placement & Instruction
Location: This is a fully remote role. Candidates who live near CB offices have the option of being fully remote or hybrid (Tuesday and Wednesday in office).
Role Type: This is a full-time position
About the Team
The AP Curriculum and Assessment Team at College Board (110+ staff) collaborates with colleagues across all aspects of the AP Program to develop, manage, and deliver AP’s 40+ courses in a wide variety of subject areas. AP® is a rigorous academic program built on the commitment, passion, and hard work of students and educators from secondary schools and higher education. AP provides willing and academically prepared high school students with the opportunity to study and learn at the college level.
The AP Reading and Scoring function lies at the heart of AP’s assessment integrity and instructional value. Each year, more than 18,000 college faculty and AP teachers convene to evaluate millions of student responses, ensuring scoring quality, fairness, and consistency across subjects. The AP Curriculum & Assessment (C&A) team—through its leadership of Reader training, scoring guidelines, standard and grade setting, and publications—ensures that each exam score represents a valid, reliable measure of student achievement aligned to college-level standards.
About the Opportunity
As Executive Director, Advanced Placement, Curriculum & Assessment, Reading and Scoring, you will lead the strategy, systems, and professional learning infrastructure that power the AP Reading—the foundation of scoring excellence and validity across 40+ AP subjects.
You will serve as the operational and strategic leader for the planning, training, and systems that enable the 18,000+ AP Readers, 40+ Chief Readers, and 80+ internal Course Experts in AP Curriculum & Assessment to execute scoring with fidelity, accuracy, and consistency. This includes leadership over Reader training and readiness, the development and maintenance of scoring guidelines and generic rubrics, the annual grade- and standard-setting processes, and the Reading publications library, as well as ongoing innovation to advance AP scoring quality and efficiency.
Each year, the systems and teams you lead will enable more than 18,000 faculty and AP teachers to accurately score over 20 million student responses across 40+ AP subjects and multiple exam versions. Your leadership will ensure that every AP Exam score reflects fairness, validity, and reliability—empowering students, teachers, and institutions to trust in the rigor and accuracy of AP assessment.
You will collaborate closely with the AP Curriculum & Assessment Leadership Team, within which you will sit, as well as AP Assessment Production, AP Delivery, and AP Psychometrics to ensure the reliability, validity, and fairness of scoring processes and outputs. You will also champion cross-functional alignment, ensuring that all Reading, scoring, and standard-setting activities are planned, executed, and communicated with clarity and excellence.
You will directly lead three senior staff members:
Senior Director, AP Reader Training
Senior Director, Reading Publications and Quality Assurance
Senior Project Manager, Reading, Scoring, and Coordination
In this Role, You Will:
Drive AP Reader Training and Course Expert Readiness (25%)
Lead the strategy and execution of training programs that prepare 18,000+ AP Readers and scoring leaders annually to score 20 million+ student responses across 40+ AP subjects.
Advance training and readiness of 80+ internal AP Course Experts, ensuring all are prepared to facilitate Pre-Reading Prep, Pre-Reading, and Reading activities across all AP Exams.
Develop and deliver the annual AP Reader learning courses, training modules, user guides, and job aids, ensuring readiness by mid-May each year.
Lead the AP Internal Training Series, ensuring C&A staff receive end-to-end training on Pre-Reading planning, sample selection, annotation, digital scoring tools, and post-administration publications.
Partner with AP Assessment Leadership and AP Delivery to ensure training systems, LMS environments, and scoring applications operate seamlessly and meet needs to train Readers and execute all scoring at the AP Reading.
Integrate learning science, accessibility, and AI-driven design tools to improve training quality, efficiency, and consistency.
Establish systems to measure Reader confidence and scoring consistency, achieving a goal of 90% Reader agreement that scoring materials enable accurate and consistent scoring.
Guide the annual selection process of the new cohort of Chief Reader Designates in partnership with AP Delivery.
Develop and Produce Scoring Assets (20%)
Lead the annual development and review of 650+ scoring guidelines across 40+ AP subjects, ensuring alignment with course frameworks, psychometric standards, and instructional validity.
Lead the maintenance and evolution of AP’s library of generic rubrics to ensure consistent, transparent application across all subjects and exam formats.
Direct the development of all Reading planning workbooks (five-part Smartsheet suite) used to identify sample-selection requirements and scoring leadership needs for multiple forms (4–5) across 38 courses.
Lead creation of post-administration publication templates and assets, including Chief Reader Reports, Free-Response Questions, scoring commentaries, Summer Institute workshop packets, and AP Central materials for multiple forms across all subjects.
Partner with AP Assessment to maintain and provision gold-source documentation for scoring systems, including dimension names, IDs, score scales, and form data.
Partner with AP Publications and AP Professional Learning teams to ensure all scoring and publication materials meet accuracy, accessibility, and instructional value standards.
Provide oversight and escalation for all test-security processes related to Exam and Reading assets, ensuring management of timely responses to flagged or exposed content as well as student work flagged as plagiarized or compromised, in alignment with CB Test Security standards and processes.
Drive Innovation, Systems Integration, and Continuous Improvement (20%)
Lead modernization of Reading systems, processes, and training through digital tools and generative AI for workflow automation, content generation, and efficiency.
Advance integration across SharePoint, Smartsheet, LMS, and vendor platforms to enhance coordination, transparency, and reporting.
Define annual technical and MVP requirements for the scoring application, in collaboration with AP Assessment and AP Delivery leaders.
Guide the establishment of calibration and quality configurations supporting AP calibration, rater performance, and validity standards.
Lead data-driven retrospectives to assess rubric design, scoring performance, and training outcomes, implementing improvements across cycles.
Lead and Manage the AP Reading and Scoring Team (15%)
Lead a team of 3 that is responsible for the planning and execution of the annual Reading, ensuring all student responses are scored accurately and fairly, according to assessment best practices.
Set vision and priorities for the team, track and manage progress to goals, and provide coaching and support to ensure team members meet and exceed goals, remain engaged, and contribute meaningfully to our mission.
Cultivate an inclusive and high-achieving culture that enables all team members to live out College Board’s
Operating Principles
effectively.
Bring proven leadership experience and consistently embody College Board’s
Manager Expectations
in your work.
Lead Standard Setting and Grade Setting (10%)
Lead the annual grade-setting process across 40+ AP subjects, ensuring all cut scores are determined through rigorous psychometric methods and established College Board standards.
Collaborate with AP Psychometrics and AP Curriculum & Assessment Course Teams to analyze performance data and establish cut scores for multiple exam forms per subject.
Ensure 100% of AP Exam cut scores are based on psychometric best practices, including equating or Evidence-Based Standard Setting (EBSS), to uphold fairness, validity, and reliability across administrations.
Lead EBSS standard setting processes for selected subjects annually, partnering with Psychometrics and C&A Course Teams to develop the Briefing Book, conduct data analyses, and support the evaluation of score outcomes.
Maintain and analyze AP Exam performance data to inform internal reporting, trend analysis, and continual improvement of exam design, scoring accuracy, and operational quality.
Ensure that by June 30 each year, cut scores are finalized for multiple exam forms across all AP subjects, supporting valid and reliable score setting.
Partner with AP leadership to communicate grade-setting outcomes and ensure alignment between psychometric analyses, scoring policies, and instructional intent.
Lead the documentation, validation, and archival of standard- and grade-setting processes in compliance with College Board research and quality standards.
Strategic Planning (10%)
Lead annual strategic and operational planning cycles for Reading and Scoring, ensuring capacity, change initiatives, and performance metrics align with AP’s strategic priorities.
Partner with finance and operations to ensure fiscal responsibility and strategic use of resources.
Track progress toward AP Program scoring goals and report key outcomes to AP leadership.
About You
You have
10+ years of experience leading high-impact programs with expertise in large-scale assessment operations, scoring, or training systems within complex organizations, ideally in education, nonprofit, or mission-driven environments
Deep understanding of assessment design, scoring quality, rubric development, and learning systems.
Proven ability to apply emerging technologies—including generative AI—to improve scoring and training workflows.
A strategic and inclusive leadership style: you set clear priorities, build effective team structures, plan for future needs, and foster a culture of belonging.
A systems-thinking mindset: you thrive in complexity and create clarity through structure, communication, and data-driven decision-making.
Ability to execute work as both a leader and collaborator across a variety of different internal teams using exceptional communication skills to inspire collaboration.
A master’s degree in a relevant field is required; an advanced degree is strongly preferred.
Willingness to travel approximately 6 times per year, including 2–4 weeks from late May to mid-June for the on-site AP Readings.
All roles at College Board require:
A passion for expanding educational and career opportunities and mission-driven work
Curiosity and enthusiasm for emerging technologies, with a willingness to experiment with and adopt new AI-driven solutions and a comfort learning and applying new digital tools independently and proactively.
Clear and concise communication skills, written and verbal
A learner's mindset and a commitment to growth: welcoming diverse perspectives, giving and receiving timely, respectful feedback, and continuously improving through iterative learning and user input.
A drive for impact and excellence: solving complex problems, making data-informed decisions, prioritizing what matters most, and continuously improving through learning, user input, and external benchmarking.
A collaborative and empathetic approach: working across differences, fostering trust, and contributing to a culture of shared success.
Authorization to work in the United States
About Our Process
Application review will begin immediately and continue until the position is filled.
While the hiring process may vary, it generally includes: resume and application submission, recruiter phone/video screen, hiring manager interview, performance exercise (such as a work simulation), a panel interview, a conversation with leadership, and reference checks.
What We Offer
At College Board, we offer more than a paycheck—we provide a meaningful career, a supportive team, and a comprehensive package designed to help you thrive. We’re a self-sustaining nonprofit that believes in fair and competitive compensation grounded in your qualifications, experience, impact, and the market.
A Thoughtful Approach to Compensation
The hiring range for this role is $144,000–$215,000.
Your exact salary will depend on your location, experience, and how your background compares to others in similar roles at the College Board.
We aim to make our best offer upfront, rooted in fairness, transparency, and market data.
We adjust salaries by location to ensure fairness, no matter where you live.
You’ll have open, transparent conversations about compensation, benefits, and what it’s like to work at College Board throughout your hiring process. Visit our careers page for more.
#LI-REMOTE
#LI-AP1
💡 Quick Summary
Seeking a career-building opportunity? The Executive Director, Advanced Placement, Curriculum and Assessment, Reading and Scoring position is now open for candidates interested in the Work from home Jobs sector. This role in Victoria offers a professional environment and growth potential.
Requirement Snapshot: Candidates should possess basic communication skills, a proactive attitude, and the ability to work in a team. Experience in Work from home Jobs is a plus.
