AI Architect (Applied LLM Systems) - 22224
Quick Summary
patterns, reusable components, prompt and model management, and documentation Review and strengthen what we've already built,
- Location: Remote
- Schedule: Full-time. Core hours align with India Standard Time, where our engineering team works, plus a regular overlap window with U.S. Pacific time for leadership syncs.
- Reports to: Co-Founder & CTO
- Works with: Our engineering team in India, including engineers already building AI features into the platform
We are a rapidly growing U.S.-based healthcare technology company building clinical documentation and billing software for community pharmacies. Our platform helps independent pharmacies deliver and get paid for clinical services such as medication therapy management, vaccinations, and pharmacist consultations, and serves insurers with outcomes and analytics tools.
We've grown quickly this year and plan to keep scaling in 2027. AI is now central to our product roadmap.
About the Role
~1 min readWe've already started building AI into our platform. Our engineers are self-taught in AI and have shipped real work, including an internal AI knowledge base built on our own company knowledge. They've done well. What we're missing is someone who has taken AI from idea to production at a company before and knows what good looks like.
That's this role. You'll bring the rigor: the frameworks, guidelines, and best practices that let our team build AI correctly and keep up as the technology changes. You'll find where AI can create the most value across products we sell to existing customers, and guide the team in building it.
We bring deep healthcare and pharmacy domain expertise. You bring the AI expertise. The job is combining the two into products that work in a regulated industry.
Responsibilities
~1 min read- Assess where AI can create the most value across our platform and products, and prioritize opportunities with the CTO
- Keep the team current on fast-moving models, tools, and techniques, and decide which are worth adopting and which aren't
- Translate our domain experts' needs into practical AI approaches, and explain tradeoffs in plain terms
- Design the architecture for AI features across the product, including retrieval, agents and tool use, model selection, and integration with our AWS environment
- Set the frameworks and engineering guidelines the team builds against: patterns, reusable components, prompt and model management, and documentation
- Review and strengthen what we've already built, including our internal AI knowledge base
- Choose the simplest approach that works, using existing models and APIs before custom training
- Take AI features from prototype to reliable production
- Define evaluation and testing practices to measure accuracy and catch regressions
- Monitor performance, cost, and latency once features are live, and improve them over time
- Make sure data pipelines feeding AI features are clean, well-structured, and dependable
- Design AI systems for HIPAA requirements, including de-identification, access controls, and appropriate vendor agreements with model providers
- Set clear rules for what data can and can't go to which models and services
- Guide and mentor the engineering team through design reviews, code reviews, and pairing
- Build reference implementations the team can extend
- Raise the team's overall AI skill level through hands-on coaching and shared standards
Requirements
~1 min read- 5+ years in software or data engineering, including 2+ years building LLM-based features that shipped to production in a real product, not only prototypes
- Hands-on experience designing AI systems such as retrieval (RAG), agents and tool use, and evaluation
- Strong data engineering fundamentals: building clean, reliable pipelines from messy source data
- Experience with major LLM providers and deploying AI on a major cloud platform (AWS preferred)
- A portfolio of AI work you can share and walk us through, whether professional, open-source, or side projects
- Experience setting technical direction or standards that other engineers followed
- Excellent written and spoken English, with the ability to explain technical tradeoffs to non-specialists
- Available to work India Standard Time core hours with a regular overlap window with U.S. Pacific time
- Healthcare industry experience, especially with clinical, pharmacy, or billing data
- Experience building AI on sensitive data under HIPAA or similar regulations, including de-identification and vendor agreements
- Experience with AWS AI services
- Experience at a SaaS startup or high-growth company
- Experience mentoring engineers or leading a small technical team
You are:
- A builder who has shipped. You can point to AI features you've put in front of real users, and explain what broke along the way and how you fixed it.
- Pragmatic. You reach for the simplest approach that works and can explain why it beats the flashier option.
- A multiplier. You make a capable team better through standards, reviews, and coaching, not by doing all the work yourself.
- Security-minded. You think about where data goes before you write the first line of code.
- Curious and current. You keep up with a fast-moving field and can tell real progress from hype.
- A clear communicator. You can talk architecture with engineers and business value with founders, often in the same meeting.
What We Offer
~1 min readLocation & Eligibility
About this job
- Posted
- Today
Listing Details
- First seen
- November 18, 2026
- Last seen
- November 18, 2026
Posting Health
- Days active
- 0
- Repost count
- 0
- Trust Level
- 63%
- Scored at
- November 18, 2026
Signal breakdown
Similar Architect jobs
View all →Browse Similar Jobs
Stay ahead of the market
Get the latest job openings, salary trends, and hiring insights delivered to your inbox every week.
No spam. Unsubscribe at any time.