Observability & Scale Engineer

At Kyndryl, we design, build, manage and modernize the mission-critical technology systems that the world depends on every day. So why work at Kyndryl? We are always moving forward – always pushing ourselves to go further in our efforts to build a more equitable, inclusive world for our employees, our customers and our communities.

Owns observability/monitoring, utilization analysis, demand insight, capacity forecasting, scaling triggers, and recommendations for NVIDIA AI infrastructure and workloads.

Kyndryl currently does not require employees to be fully vaccinated against COVID-19, however, if you are hired to work at a client, customer, or partner location, you may be required to show proof of vaccination to align with their respective COVID-19 vaccination policies.  Those who believe they are eligible may apply for a medical or religious accommodation prior to the start of employment.

·   Implement and maintain monitoring using DCGM, Prometheus, Grafana, and related telemetry sources.

·   Define service health, GPU, fabric, storage, queue, workload, and utilization measures.

·   Build dashboards, alerts, thresholds, and operational views for platform teams and leaders.

·   Analyze utilization, queue depth, workload demand, bottlenecks, and capacity trends.

·   Develop forecasts, scaling triggers, and evidence-based capacity recommendations.

·   Partner with platform operations, FDE, architecture, finance, and customer teams on demand and growth planning.

·   Validate monitoring coverage during deployment and maintain baselines through the lifecycle.

·   Improve data quality and automate recurring performance and capacity reporting.

·   Experience in infrastructure monitoring, observability, performance analysis, or capacity management.

·   Hands-on experience with Prometheus, Grafana, or comparable monitoring platforms.

·   Experience analyzing time-series data and translating trends into operational recommendations.

·   Working knowledge of Linux, containers, GPU infrastructure, and distributed platforms.

·   Experience with NVIDIA DCGM and GPU telemetry.

·   Experience with Run:ai Scheduler, Kubernetes scheduling, queue analysis, or AI workload demand.

·   Experience with Python, APIs, data analytics, and dashboard automation.

Limited nationwide travel may be required; percentage to be confirmed.

The compensation range for the position in the U.S. is - $115,080 to $218,520 based on a full-time schedule. Your actual compensation may vary depending on your geography, job-related skills and experience.  For part time roles, the compensation will be adjusted appropriately. The pay or salary range will not be below any applicable state, city or local minimum wage requirement. There is a different applicable compensation range for the following work locations:

California (San Francisco Bay Area): $138,120 to $262,320  

California (All Other): $126,600 to $240,480  

Colorado:  $115,080 to $218,520  

Massachusetts $115,080 to $240,480  

New York City:  $138,120 to $262,320  

Washington:  $126,600 to $240,480  

Washington DC: $126,600 to $240,480                    

This position will be eligible for Kyndryl’s discretionary annual bonus program, based on performance and subject to the terms of Kyndryl’s applicable plans. You may also receive a comprehensive benefits package which includes medical and dental coverage, disability, retirement benefits, paid leave, and paid time off. 

Note: If this is a sales commission eligible role, you will be eligible to participate in a sales commission plan in lieu of the annual discretionary bonus program.

NVIDIA DCGM | Prometheus | Grafana | GPU Monitoring | Observability | Capacity Planning | Utilization Analysis | Performance Analysis | Forecasting | Scaling Triggers | Dashboard Development

Diversity is a whole lot more than what we look like or where we come from, it’s how we think and who we are. We welcome people of all cultures, backgrounds, and experiences. But we’re not doing it single-handily: Our Kyndryl Inclusion Networks are only one of many ways we create a workplace where all Kyndryls can find and provide support and advice. This dedication to welcoming everyone into our company means that Kyndryl gives you – and everyone next to you – the ability to bring your whole self to work, individually and collectively, and support the activation of our equitable culture. That’s the Kyndryl Way.

With state-of-the-art resources and Fortune 100 clients, every day is an opportunity to innovate, build new capabilities, new relationships, new processes, and new value. Kyndryl cares about your well-being and prides itself on offering benefits that give you choice, reflect the diversity of our employees and support you and your family through the moments that matter – wherever you are in your life journey. Our employee learning programs give you access to the best learning in the industry to receive certifications, including Microsoft, Google, Amazon, Skillsoft, and many more. Through our company-wide volunteering and giving platform, you can donate, start fundraisers, volunteer, and search over 2 million non-profit organizations.  At Kyndryl, we invest heavily in you, we want you to succeed so that together, we will all succeed.

Get Referred!
If you know someone that works at Kyndryl, when asked ‘How Did You Hear About Us’ during the application process, select ‘Employee Referral’ and enter your contact's Kyndryl email address.