AI Prompt Engineer

Prompt Design & Engineering

• Write, iterate, and maintain system prompts and instruction sets for Noodle’s AI agents focused on students enrollment, learning, and retention

• Translate complex educational and operational requirements into clear, reliable agent behavior — including persona definition, tone, scope constraints, fallback handling, and multi-turn conversation logic

• Design prompt architectures for multi-step and chained agent workflows, including RAG-augmented agents that draw from program-specific knowledge bases

• Collaborate with the engineering team to configure and deploy agents through Noodle’s AI orchestration platform, including primary prompts, secondary context, knowledge base attachments, and embed definitions

• Create the learner experiences defined by “three-way” chat between the learner, a campus or Noodle support staff member, and that staff member’s AI assistant

Evaluation & Quality

• Build and maintain evaluation frameworks to measure agent accuracy, tone, hallucination rate, task completion, and alignment with rubric-based learning objectives

• Use Langfuse (Noodle’s LLM observability platform) to monitor prompt performance in production, identify regressions, and prioritize prompt improvements

• Design red-teaming and adversarial testing protocols to surface edge cases and failure modes before agents reach students

• Establish prompt versioning practices and maintain a library of tested, reusable prompt components

Collaboration & Enablement

• Partner with Noodle teammates and university stakeholders to design, build, and test agents — translating learning objectives, operational flows, rubric assessments, and more into prompt-level agent instructions

• Work with enrollment and student success teams to tune companion agents for specific programs and university partner contexts

• Contribute prompt engineering guidelines and best practices documentation for internal teams who configure their own agents on Noodle’s AI orchestration platform

• Stay current with model capability changes across OpenAI, Anthropic, and other providers integrated into Noodle’s stack, and proactively surface opportunities or risks

• Perform other duties as assigned 

• 2+ years of experience designing and iterating on prompts for LLM-powered applications in a production environment

• Deep familiarity with prompt patterns: few-shot examples, chain-of-thought, system vs. user roles, output formatting constraints, tool-use prompting, and RAG integration

• Strong written communication — you can write clearly, precisely, and persuasively, because that’s the core of the job

• Experience building and running prompt evaluations: defining metrics, writing test cases, and interpreting results to make improvement decisions

• Comfort working across disciplines — you can hold a conversation with an engineer about context windows and with a faculty member about Bloom’s Taxonomy

• Experience with LLM observability tools (Langfuse, Weights & Biases, or similar)

• Familiarity with LTI (Learning Tools Interoperability) and how AI tools plug into LMS platforms like Moodle, Canvas, or Instructure

• Experience with voice agents or multimodal prompting

• Comfort reading and writing basic code (JavaScript, Python) to support prompt automation and testing pipelines

• Knowledge of OpenAI, Anthropic, or other model provider APIs

• Ability to thrive in ambiguity and iterate quickly based on user feedback

• Ability to work effectively in dynamic, rapidly changing, team-based environment

At Noodle, we hire people who will help us change the future of education. Even if you don't think you check off every bullet point on this list, we still encourage you to apply! We value both current experience and future potential.

Meet the team!