Senior MLOps Engineer

Salvo Software is a global technology company specializing in custom software development and advanced engineering solutions. With distributed teams across the US, LATAM, and India, we partner with clients to build high-performance, scalable systems that solve complex technical challenges. Our culture values innovation, ownership, and engineering excellence. We’re growing our AI department and are looking for a Senior MLOps Engineer to build the platform that takes our models and LLM systems reliably into production.

MLOps Platform & Engineering (core focus)

• →Design, deploy, and operate MLOps platform infrastructure, cloud services (AWS, Azure, GCP), and LLM inference pipelines (Ollama, vLLM).
• →Build automated CI/CD pipelines, IaC, and monitoring/alerting systems to support RAG applications, AI agents, and production deployments.
• →Manage Linux servers, networking, security endpoints, and troubleshoot production issues alongside AI engineering teams.

Technical Leadership

• →Establish department-wide MLOps/DevOps standards, best practices, and reusable infrastructure templates.
• →Partner with AI Developers and RAG Engineers to guide architecture, deployment strategies, tool selection, and production readiness.
• →Translate feature requirements into reliable, secure, cost-effective infrastructure and maintain comprehensive system documentation.

Infrastructure & Operations

• →Provision containerized workloads, Linux servers, and infrastructure using IaC (Terraform, Ansible) across cloud and on-prem environments.
• →Manage CI/CD (GitHub Actions, Azure DevOps), observability tools (Prometheus, Grafana), secure networking, and GPU-enabled hardware.
• →Troubleshoot platform incidents, perform root cause analysis, and maintain operational resilience.

• 5+ years of senior-level experience in DevOps/SRE/platform engineering with at least 1 year deploying ML models and LLM inference engines (Ollama, vLLM) in production.
• Proficiency with Linux, Docker, Kubernetes, virtualization (Proxmox, VMware), GPU infrastructure (CUDA/NVIDIA), and major cloud platforms (AWS, Azure, GCP).
• Hands-on expertise with Infrastructure as Code (Terraform, Ansible), CI/CD platforms (GitHub Actions, Azure DevOps), Bash, and Python scripting.
• Solid background in core networking (DNS, TLS, firewalls, VPNs), monitoring/logging, and security/authentication (OAuth2/OIDC, API gateways, Zero Trust/SOC 2).
• Familiarity with ML tooling (MLflow, Kubeflow), vector DBs, RAG/agent frameworks (MCP), workflow orchestration (Airflow/Kafka), and model optimization/quantization.