Director of Engineering, IAEF
Quick Summary
The ideal candidate brings deep software engineering expertise, senior technical leadership experience, and a strong understanding of distributed engineering, AI evaluation, platform architecture,
This executive engineering role leads the architecture, delivery, security, and growth of an AI evaluation platform focused on trustworthy AI.
You’ll shape the technical foundation for evaluating AI efficacy, transparency, safety, and reliability in educational contexts.
The position combines hands-on technical leadership with team building, platform strategy, operational excellence, and external representation.
You’ll lead a distributed engineering organization while working closely with executive, evaluation science, security, and external stakeholders.
The role offers significant ownership over platform architecture, evaluation workflows, developer ecosystems, and engineering practices.
You’ll also contribute to fundraising, partner engagement, technical due diligence, and the responsible expansion of AI evaluation capabilities.
This is a remote-first opportunity with approximately 15% travel and a preference for candidates able to participate in quarterly in-person meetings.
The Director of Engineering will own the technical direction and execution of the platform while building a high-performing engineering organization, strengthening security and compliance practices, and representing the technical vision to external stakeholders.
- Own the Workbench’s Design → Test → Analyze → Publish (DTAP) workflow, Component Contract, Artifacts API, component registry, and canvas interface.
- Build a persistent, structured, and queryable evaluation history while integrating existing red-teaming, administrative dashboard, and human-in-the-loop data-capture capabilities.
- Evaluate build-versus-buy decisions for authentication, storage, orchestration, LLM-provider services, sandboxing, and other core platform capabilities.
- Recruit, develop, and retain the engineering organization in partnership with the HR function, including Staff/Senior Backend, Senior Frontend, DevOps/Site Reliability, Applied Machine Learning, and Senior Product Management roles.
- Establish effective planning, code review, on-call, incident response, and roadmap review practices.
- Track engineering progress, risks, and delivery outcomes for board and funder reporting.
- Partner with the CEO and Evaluation Science Lead to translate human-in-the-loop red teaming, automated benchmarks, LLM red teaming, LLM-as-judge, and drift detection into a reusable Component Contract.
- Ensure the platform supports the required Test artifact types and planned agentic components.
- Lead vendor risk reviews covering LLM providers, cloud infrastructure, and third-party evaluation tools.
- Coordinate with organizational leadership on required approvals, funder restrictions, and the appropriate separation of resources, data, and intellectual property across related entities and funded programs.
- Escalate unresolved legal, policy, or sponsor-related risks through the appropriate leadership channels.
- Represent the platform in technical discussions with customers, partners, funders, and press.
- Own technical content for investor fundraising materials, roadmaps, demonstrations, and due diligence reviews in collaboration with executive leadership.
- Shape the developer-relations narrative for SDK and ADK capabilities as the Component Contract becomes available to external developers.
- Partner with planned Developer Relations and Ecosystem leadership to support external developer adoption.
- Provide technical leadership across delivery, operational issues, organizational growth, and continuous platform improvement.
Requirements
~2 min readThe ideal candidate brings deep software engineering expertise, senior technical leadership experience, and a strong understanding of distributed engineering, AI evaluation, platform architecture, security, and organizational development.
- 12+ years of software engineering experience, including at least 4 years in senior technical leadership within a startup, evaluation or audit firm, machine-learning infrastructure company, or research-grade platform team.
- Experience building and operating platforms with plugin, extension, or component models.
- Production experience with AI evaluation, red-teaming, machine-learning observability, model testing, or related systems.
- Proven ability to hire, develop, and retain senior engineers within a distributed organization.
- Experience building or leading teams that include applied machine-learning or agentic-systems expertise.
- Ability to design reusable platform components and work with human-in-the-loop transcripts, benchmark scores, and LLM red-teaming results.
- Strong understanding of platform architecture, engineering delivery, operational reliability, and technical decision-making.
- Ability to communicate complex technical decisions clearly to enterprise security leaders, foundation program officers, investors, customers, partners, and other non-technical stakeholders.
- Strong prioritization skills and the ability to balance competing technical, organizational, and delivery requirements.
- Ability to independently lead distributed engineering teams through delivery, operational challenges, and periods of growth.
- Understanding of the operational separation required between public-benefit organizations, nonprofit entities, and grant-funded programs.
- Strongly preferred experience implementing ISO 42001, the NIST AI Risk Management Framework, or SOC 2 requirements.
- Prior CTO, VP Engineering, or founding-engineer experience at an early-stage company with institutional funding is preferred.
- Experience enabling external developers to build on a platform is preferred.
- Experience developing evaluation methodologies with academic or civil-society partners is a plus.
- Experience working with enterprise security, compliance, vendor risk, or AI governance programs is valuable.
- A PhD or prior experience at a frontier AI research laboratory is not required.
- Strong communication, judgment, collaboration, and team-development skills.
What We Offer
~2 min readLocation & Eligibility
Listing Details
- Posted
- October 2, 2026
- First seen
- October 2, 2026
- Last seen
- October 2, 2026
Posting Health
- Days active
- 0
- Repost count
- 0
- Trust Level
- 68%
- Scored at
- October 2, 2026
Signal breakdown
Browse Similar Jobs
Stay ahead of the market
Get the latest job openings, salary trends, and hiring insights delivered to your inbox every week.
No spam. Unsubscribe at any time.