AWS Kafka - Jefferies

“Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the  British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients across banking, financial and Energy sectors. We are recognized for our deep transformation execution and delivery. 

Innovative thinking, delivery excellence and thought leadership to help our clients transform their business. Together with our clients and industry partners, we deliver disruptive work that is changing energy and financial services.

Capco has a tolerant, open culture that values diversity, inclusivity, and creativity.

With no forced hierarchy at Capco, everyone has the opportunity to grow as we grow, taking their career into their own hands.

We believe that diversity of people and perspective gives us a competitive advantage.

Platform Operations Engineer – AWS & Kafka (Amazon MSK) Overview We’re looking for an experienced Platform Operations Engineer to lead the administration and optimization of our Kafka-based data streaming infrastructure on AWS. This role focuses on ensuring reliability, scalability, and performance across our Amazon MSK clusters and supporting cloud services. You’ll work closely with engineering and DevOps teams to maintain a secure, high-throughput event streaming environment that underpins key business applications and analytics platforms.

Must-Have Qualities • 10+ years of hands-on experience managing and administering Apache Kafka and/or Amazon Managed Streaming for Apache Kafka (MSK). • 10+ years of professional experience with AWS cloud services, including EC2, EKS, IAM, CloudWatch, CloudTrail, S3, and VPC networking. • Proven expertise in Kafka cluster setup, scaling, partitioning, replication, and monitoring. • Strong proficiency with infrastructure-as-code tools especially Terraform. • Solid understanding of Kafka security and data governance in cloud environments. • Experience with DevOps, CI/CD pipelines and automation scripting using Python, Bash, or similar languages. • Skilled in troubleshooting distributed systems, caching architectures, and optimizing message throughput and latency. • Effective communicator with experience collaborating across Cloud, DevOps, Security, and Data engineering teams.

Nice-to-Have Qualities • Familiarity with Kubernetes/EKS and containerized microservices deployments. • Knowledge of Kafka Connect, Schema Registry, and Kafka Streams. • Exposure to monitoring and alerting frameworks (e.g., OTEL, Prometheus, Grafana). • Experience with cross-region or multi-account AWS setups. • AWS certifications such as AWS Certified Solutions Architect - Professional or DevOps Engineer - Professional.

Preferred Experience • 10+ years managing enterprise-scale Kafka environments and AWS cloud infrastructure. • Prior work in large-scale data platforms or high-availability, low-latency systems. • Experience in capital markets companies. • Background in performance tuning, cost optimization, and incident response for streaming platforms.