Data Engineer II

India - Trivandrummid

Data EngineerData

0 views0 saves0 applied

Apply Now

Quick Summary

Overview

The world’s top banks use Zafin’s integrated platform to drive transformative customer value. Powered by an innovative AI-powered architecture, Zafin’s platform seamlessly unifies data from across the enterprise to accelerate product and pricing innovation, automate deal management and billing,…

Key Responsibilities

Data Pipeline Development Design, build, and maintain scalable data pipelines for ingesting, transforming, and loading data across batch and real-time (streaming) systems.

Technical Tools

airflowjavakafkakubernetespythonscalasnowflakesparksqlci-cddatabase-designetl

Zafin empowers banks to drive sustainable growth, strengthen their market position, and define the future of banking centered around customer value.

We are seeking a highly skilled Data Engineer II to design, build, and scale robust data platforms that power analytics and product use cases. This role requires strong ownership in developing data pipelines, optimizing infrastructure, and ensuring high standards of data quality, governance, and performance. The ideal candidate brings deep hands-on experience with modern data technologies and thrives in a fast-paced, product-driven environment.

Responsibilities

~1 min read

Design, build, and maintain scalable data pipelines for ingesting, transforming, and loading data across batch and real-time (streaming) systems.
Integrate data from diverse sources while ensuring reliability, scalability, and efficiency.

Design and implement optimized data models, warehouse schemas, and tables for analytics and reporting.
Apply best practices in data architecture to support scalable data consumption.

Manage and optimize data platforms and infrastructure including Spark, Snowflake, Kafka, Airflow, and Kubernetes.
Ensure high availability, scalability, and fault tolerance of data systems.

Implement data validation frameworks, automated testing, and monitoring systems.
Establish alerting mechanisms to ensure data freshness, accuracy, and completeness.

Enforce data governance standards including access controls, data lineage, and compliance.
Ensure secure handling of sensitive data (PII) aligned with regulatory requirements.

Optimize queries, partitioning strategies, file formats, and compute resources.
Continuously improve system performance while managing infrastructure costs.

Develop and maintain CI/CD pipelines for data workflows.
Build internal tools, reusable frameworks, and automation solutions to improve engineering productivity.

Requirements

~2 min read

5–8 years of experience in data engineering or a related field.
Strong programming skills in Python, Scala, or Java.
Advanced proficiency in SQL and data modeling concepts.
Hands-on experience with:
- Apache Spark (distributed data processing)
- Snowflake or similar cloud data warehouses
- Kafka or other streaming platforms
- Airflow or similar orchestration tools
- Kubernetes (container orchestration)
Proven experience building both batch and real-time data pipelines.
Strong understanding of data quality, observability, and governance frameworks.

What’s in it for you

Joining our team means being part of a culture that values diversity, teamwork, and high-quality work. We offer competitive salaries, annual bonus potential, generous paid time off, paid volunteering days, wellness benefits, and robust opportunities for professional growth and career advancement. Want to learn more about what you can look forward to during your career with us? Visit our careers site and our openings: zafin.com/careers

Zafin welcomes and encourages applications from people with disabilities. Accommodations are available on request for candidates taking part in all aspects of the selection process.

Zafin is committed to protecting the privacy and security of the personal information collected from all applicants throughout the recruitment process. The methods by which Zafin contains uses, stores, handles, retains, or discloses applicant information can be accessed by reviewing Zafin’s privacy policy at https://zafin.com/privacy-notice/. By submitting a job application, you confirm that you agree to the processing of your personal data by Zafin described in the candidate privacy notice.