AI Infrastructure Engineer

We’re looking for Senior+ AI Infrastructure Engineers to build the systems that train and serve Fin's next generation of AI products.

Fin is an AI company that builds from the GPU all the way up to a user agent that resolves millions of customer service queries a month. 

You’ll join a small, highly technical team working at the cutting edge of modern AI infrastructure. The AI Infra team built the training pipelines and runs the inference for custom models like Fin Apex, which outperforms frontier models in customer service tasks, and is the foundation of the AI Group's full stack approach to AI.

• A track record of working on model training or model inference at scale, or on low‑level GPU coding (e.g. CUDA, Triton). Experience with one is great, multiple is even better.

As a Senior AI Infrastructure Engineer focused on model training and inference, you will:

• Implement and scale training pipelines for large transformer and LLM models, from data ingestion and preprocessing through distributed training and evaluation.
• Build and optimize inference services that deliver low‑latency, high‑reliability experiences for our customers, including autoscaling, routing, and fallbacks.
• Work on GPU‑level performance: tuning kernels, improving utilization, and identifying bottlenecks across our training and inference stack.
• Collaborate closely with ML scientists to implement cutting edge training and inference methods and bring them to production.
• Play an active role in hiring, mentoring, and developing other engineers on the team.
• Raise the bar for technical standards, reliability, and operational excellence across Fin's AI platform.

These are indicative, not hard requirements

We’re looking to hire Senior+ AI Infrastructure Engineers. You’re likely a great fit if:

• You have 5+ years of experience in software engineering, with a strong track record of shipping high‑quality products or platforms.
• You hold a degree in Computer Science, Computer Engineering, or a related field (or you have equivalent experience with very strong fundamentals).
• You have hands‑on experience with one or more of the following:
• Model training (especially transformers and LLMs).
• Model inference at scale (again, especially transformers and LLMs).
• Low‑level GPU work, such as writing CUDA or Triton kernels.
• Comfortable working in production environments at meaningful scale (traffic, data, or organizational).
• You communicate clearly, can explain complex technical topics to different audiences, and enjoy close collaboration with both engineers and non‑engineers.
• You take pride in strong technical fundamentals, love learning, and are willing to invest in your own development.
• Have deep knowledge of at least one programming language (for example Python, Ruby, Java, Go, etc.). Specific language experience is less important than your ability to write clean, reliable code and learn new stacks quickly.

None of these are required, but they’re nice to have:

• Experience at AI native companies that train and/or run inference for their own models (e.g. modern AI labs or AI‑native product companies).
• Experience running training or inference workloads on Kubernetes.
• Experience with AWS or other major cloud providers.
• Production experience with Python in ML or infrastructure contexts.
• Demonstrated passion for technology through personal projects, open source, meetups, or publishing content about your work and learnings

Fin has a hybrid working policy. We believe that working in person helps us stay connected, collaborate easier and create a great culture while still providing flexibility to work from home. We expect employees to be in the office at least three days per week.

We have a radically open and accepting culture at Fin. We avoid spending time on divisive subjects to foster a safe and cohesive work environment for everyone. As an organization, our policy is to not advocate on behalf of the company or our employees on any social or political topics out of our internal or external communications. We respect personal opinion and expression on these topics on personal social platforms on personal time, and do not challenge or confront anyone for their views on non-work related topics. Our goal is to focus on doing incredible work to achieve our goals and unite the company through our core values.  

Fin values diversity and is committed to a policy of Equal Employment Opportunity. Fin will not discriminate against an applicant or employee on the basis of race, color, religion, creed, national origin, ancestry, sex, gender, age, physical or mental disability, veteran or military status, genetic information, sexual orientation, gender identity, gender expression, marital status, or any other legally recognized protected basis under federal, state, or local law.