Agentic AI Engineer – Mainframe Modernization
Quick Summary
Deploy & Optimize AI Workflows: Configure and scale KAF, Agentic AI workflows, RAG pipelines, and code-aware agents to accelerate legacy discovery, inventory analysis,
Experience deploying, configuring, integrating, and optimizing enterprise Agentic AI capabilities, orchestration pipelines, custom workflows, and prompt libraries.
At Kyndryl, we run and reimagine the mission-critical technology systems that drive advantage for the world’s leading businesses. We are at the heart of progress; with proven expertise and a continuous flow of AI-powered insight, enabling smarter decisions, faster innovation, and a lasting competitive edge. For our people—Kyndryls—that means doing purposeful work that powers human progress. Join us and experience a flexible, supportive environment where your well-being is prioritized and your potential can thrive.
Your Role:
You will be an AI & Mainframe Modernization Engineer deploying and scaling KAF and Agentic AI capabilities to accelerate legacy enterprise transformations. Working alongside mainframe SMEs, architects, and cloud teams, you will build code-aware AI workflows, automate reverse engineering and refactoring, and enforce validation guardrails to deliver production-ready modernization outcomes.
What You Will Do:
- Deploy & Optimize AI Workflows: Configure and scale KAF, Agentic AI workflows, RAG pipelines, and code-aware agents to accelerate legacy discovery, inventory analysis, and automated reverse engineering across COBOL, PL/I, JCL, CICS, IMS, and DB2.
- Drive Code Transformation: Extract business rules, dependency maps, and architecture artifacts to support code refactoring and cloud migration.
- Integrate into Enterprise Pipelines: Embed AI automation directly into existing enterprise tools, code repositories, and CI/CD development pipelines.
- Enforce Governance & Quality: Establish evaluation frameworks, guardrails, and Human-in-the-Loop (HITL) validation workflows to ensure output accuracy and enterprise security compliance.
- Scale & Mentor: Continuously refine prompt and orchestration frameworks, build reusable AI accelerators, and mentor cross-functional modernization teams on AI-assisted delivery.
Required Qualifications:
- Experience deploying, configuring, integrating, and optimizing enterprise Agentic AI capabilities, orchestration pipelines, custom workflows, and prompt libraries.
- Strong AI engineering expertise in designing code-aware AI agents, Retrieval-Augmented Generation (RAG) pipelines, vector-based knowledge systems, prompt engineering, and context engineering.
- Hands-on mainframe modernization background covering legacy application discovery, inventory analysis, and automated reverse engineering across COBOL, PL/I, JCL, CICS, IMS, DB2, and related technologies.
- Demonstrated ability to generate application documentation, business rules extraction, dependency maps, and architecture artifacts, converting AI outputs into implementation-ready engineering deliverables.
- Practical experience supporting code transformation, refactoring, and migration activities while automating repetitive tasks across analysis, mapping, testing, and documentation generation.
- Proven ability to integrate AI solutions with enterprise tools, repositories, and development pipelines while monitoring and improving performance, accuracy, reliability, and scalability.
- Strong background in AI quality, validation, and governance—including defining evaluation frameworks, validation mechanisms, guardrails, Human-in-the-Loop (HITL) workflows, and enterprise security compliance.
- Proven collaboration skills with Mainframe SMEs, Architects, Cloud Engineers, and Transformation Leads, including mentoring teams on AI-assisted delivery best practices.
Preferred Qualifications:
- Direct experience working with KAF (Kyndryl Agentic Framework) and contributing to reusable AI assets and modernization accelerators across multiple programs.
- Deep expertise in validating AI-generated code, test assets, migration outputs, and documentation within regulated or security-sensitive enterprise environments.
- Track record of identifying recurring modernization challenges and converting them into reusable AI solutions.
- Experience advancing agent orchestration frameworks and legacy-to-cloud transformation architectures.
Your Future at Kyndryl:
Every position at Kyndryl offers a way forward to grow your career. We have opportunities that you won’t find anywhere else, including hands-on experience, learning opportunities, and the chance to certify in all four major platforms. Whether you want to broaden your knowledge base or narrow your scope and specialize in a specific sector, you can find your opportunity here.
You’re good at what you do and possess the required experience to prove it. However, equally as important ,you have a growth mindset; keen to drive your own personal and professional development. You are customer-focused , someone who prioritizes customer success in their work. And finally, you’re open and borderless , naturally inclusive in how you work with others.
Required Qualifications:
- 5-8+ years of software engineering experience, including 2+ years of hands-on experience building and deploying GenAI, Large Language Models (LLMs), and Agentic AI solutions into enterprise production environments.
- Deep expertise in AI & Agentic Engineering, covering Agentic AI Frameworks, Multi-Agent Systems, Prompt Engineering, Context Engineering, and AI Workflow Orchestration.
- Strong proficiency in Python for developing workflow automation, REST APIs, SDK integrations, and third-party tool integrations.
- Hands-on experience with Git/GitHub, CI/CD pipelines, SDLC processes, DevSecOps, and secure development practices.
- Proven experience designing AI Knowledge Systems, including Retrieval-Augmented Generation (RAG), Vector Databases, Semantic Search, Embedding Models, Knowledge Graphs, and Context Retrieval Systems.
- Strong software quality background encompassing source code analysis, test automation, quality engineering, and working with code transformation or developer productivity tools.
- Solid knowledge of Mainframe Modernization, including legacy application discovery, reverse engineering, code understanding, dependency analysis, modernization patterns, and legacy-to-cloud transformation.
Preferred Qualifications:
- Hands-on experience in code-aware agent development, legacy code context modeling, and mainframe application analysis.
- Proven track record implementing automated code transformation and automated test generation solutions.
- Experience building and scaling enterprise AI platform engineering solutions, multi-agent orchestration platforms, and deep tool/platform integrations.
- Strong expertise in AI evaluation frameworks, LLM guardrails and governance, generated code validation, and Human-in-the-Loop (HITL) workflows.
The “Kyn” in Kyndryl means kinship, which represents the strong bonds we have with each other, our customers and our communities. We focus on ensuring all Kyndryls feel included and we welcome people of all cultures, backgrounds, and experiences. Even if you don’t meet every requirement, we encourage you to apply. We believe in growth, and we’re excited to see what you can bring. At Kyndryl, employee feedback has told us that our number one driver of employee engagement is belonging. That sense of belonging — being a valued, respected, trusted member of the team — is fundamental to our culture and fueling great experiences for our customers. This dedication to welcoming everyone into our company means that Kyndryl gives you the ability to thrive and contribute to our culture of empathy and shared success. That’s The Kyndryl Way.
What You Can Expect
Your career with us isn’t just a job—it’s an adventure with purpose. We offer a dynamic, hybrid-friendly culture that supports your well-being and empowers you to grow. Our Be Well programs are thoughtfully designed to support your financial, mental, physical, and social health—because we know that when you feel your best, you do your best.
From your very first day, you’ll dive into impactful work that powers the systems our customers rely on every day. You won’t just contribute—you’ll make a difference, tackling meaningful projects that sharpen your skills and fuel your growth.
We’re here to champion your journey. With powerful tools to chart your career path, personalized development goals aligned with your ambitions, and continuous feedback to keep you inspired and on track, you’ll have everything you need to thrive and evolve. You’ll develop in-demand skills to grow your career and achieve your ambitions with access to cutting-edge learning opportunities—from certifications with Microsoft, Google, and Amazon to coaching and hands-on experiences. And through it all, you’ll be part of a culture that values empathy, restless learning, and a devotion to shared success.
We want you to thrive here—and we’re committed to helping you do just that. Ready to make an impact? Join us and help shape what’s next.
Get Referred!
If you know someone that works at Kyndryl, when asked ‘How Did You Hear About Us’ during the application process, select ‘Employee Referral’ and enter your contact's Kyndryl email address.
Location & Eligibility
About this job
- Posted
- Today
Listing Details
- Posted
- November 13, 2026
- First seen
- November 13, 2026
- Last seen
- November 13, 2026
Posting Health
- Days active
- 0
- Repost count
- 0
- Trust Level
- 55%
- Scored at
- November 13, 2026
Signal breakdown
Similar Machine Learning Engineer jobs
View all →Stay ahead of the market
Get the latest job openings, salary trends, and hiring insights delivered to your inbox every week.
No spam. Unsubscribe at any time.