Staff Backend AI Engineer

Arbiter is the AI-powered care orchestration system that unites healthcare. We are launching our best-in-class, patient-facing agentic platform to optimize patient outcomes through a unique multimodal approach. We optimize complex healthcare workflows that interface with patients using the latest agentic AI approaches to optimize patient outcomes, and we combine it with a sophisticated platform to serve this agentic layer at scale. We are looking for expert engineers and leads to join our team and help us push the frontier of what’s possible with agentic workflows in healthcare.

Backed by one of the largest seed rounds in health tech history and operators who bring the expertise and distribution to scale nationally, we're building the connected infrastructure healthcare should have had all along.

We are a high-performing group of engineers dedicated to delivering innovative, high-quality solutions to our clients and business partners. We believe in:

As a Staff Backend AI Engineer, you will design, build, and operate the backend AI systems that power Arbiter’s intelligent care orchestration platform. Owning critical parts of our agentic infrastructure, from low-latency inference pipelines to workflow automation and service orchestration, working closely with product, data, and clinical partners to ship production-grade AI systems with real customer dependency.

• →

• 8 + years of hands-on experience building and operating production backend systems, recent experience with AI-powered services and automation workflows, in high-availability environments.

• Computer Science or Engineering degree, or equivalent practical experience.

• Experience building and maintaining large-scale Python codebases with strong opinions on structure, quality, and tradeoffs.

• Proven experience designing and operating complex backend systems in production.

• Deep understanding of concurrency, scalability, reliability, and distributed systems patterns.

• Hands-on experience with async or event-driven architectures.

• Experience designing and operating high-scale APIs (REST and/or gRPC), including versioning and backward compatibility.

• Experience with cloud infrastructure (AWS, GCP, or Azure) and production deployments.

• Experience building and shipping AI-powered systems beyond prototypes or internal demos.

• Strong communication skills and ability to work effectively across functions.

• Experience building agentic workflows, including single- or multi-agent systems, orchestration across tools and services, and human-in-the-loop patterns.

• Experience integrating LLM APIs and understanding prompt engineering and evaluation methodologies.

• Proficiency with AI-assisted development tools (e.g., Cursor, Claude Code, GitHub Copilot).

• Track record of delivering complex systems end-to-end with minimal oversight.

• Startup or early-stage experience operating in fast-moving, high-ambiguity environments.

This role can be remote or onsite, based in our New York City or Boca Raton offices, in a fast-paced, collaborative environment where great ideas move quickly from whiteboard to production.