Senior Software Engineer II

This position performs complex research, design, and software development assignments in the design and delivery of production AI systems, including agentic workflows, LLM-powered pipelines, retrieval-augmented generation (RAG), and structured extraction services. The position provides direct input to project plans, schedules, and methodology for cross-functional AI products; performs system design, typically across multiple systems and data sources; mentors more-junior members of the team; and works directly with business users and stakeholders to translate ambiguous, unstructured problems into measurable AI solutions. 

• 5+ years of software engineering experience, including 2+ years building and shipping LLM-based or ML-based systems to production 

• BS in Engineering/Computer Science or equivalent experience required 

• Demonstrated track record of owning an AI feature or service end to end: design, evaluation, deployment, and monitoring 
• Expert proficiency in TypeScript/Node.js and/or Python; working knowledge of C#/.NET is a plus 

• Hands-on experience with LLM platforms and APIs (Azure OpenAI or equivalent), including prompt design, tool/function calling, structured outputs, and model selection tradeoffs  
• Experience building RAG pipelines: chunking, embedding, hybrid retrieval, reranking, and grounding/citation 

• Strong understanding of schema-driven structured extraction from unstructured data (Zod, Pydantic, JSON Schema) and validation strategies 

• Experience with evaluation frameworks for AI systems: golden datasets, LLM-as-judge, precision/recall on extraction tasks, regression testing of prompts and agents 

• Strong SQL proficiency and understanding of relational and vector data storage (SQL Server, PostgreSQL, Elasticsearch/vector stores) 

• Working experience with both AWS and Azure, including compute, storage, networking, IAM, and managed AI services; containerized deployment (Docker, Kubernetes or equivalent), secrets management, and observability (token usage, latency, cost attribution) 
• Strong knowledge of software development best practices, test-driven development, and code review 

We know that your wellbeing and happiness are key to a long and successful career. These are some of the benefits we are delighted to offer:

• →Health Benefits: Comprehensive, multi-carrier program for medical, dental and vision benefits
• →Retirement Benefits: 401(k) with match and an Employee Share Purchase Plan
• →Wellbeing: Wellness platform with incentives, Headspace app subscription, Employee Assistance and Time-off Programs
• →Short-and-Long Term Disability, Life and Accidental Death Insurance, Critical Illness, and Hospital Indemnity
• →Family Benefits, including bonding and family care leaves, adoption and surrogacy benefits
• →Health Savings, Health Care, Dependent Care and Commuter Spending Accounts
• →In addition to annual Paid Time Off, we offer up to two days of paid leave each to participate in Employee Resource Groups and to volunteer with your charity of choice

Please read our Candidate Privacy Policy.

We are an equal opportunity employer: qualified applicants are considered for and treated during employment without regard to race, color, creed, religion, sex, national origin, citizenship status, disability status, protected veteran status, age, marital status, sexual orientation, gender identity, genetic information, or any other characteristic protected by law.

USA Job Seekers:

EEO Know Your Rights.