Senior Data Engineer

Tiger Analytics is one of the fastest-growing AI services firms, partnering with some of the world's largest and most influential organizations to redefine how business gets done. We help Fortune 500 companies harness the power of Artificial Intelligence, Generative AI, Data Science, Data Engineering and Advanced Analytics to solve their most complex challenges, unlock new growth opportunities, and create lasting business impact.

We are at the forefront of the AI revolution, helping enterprises move beyond traditional analytics to embrace Generative AI, agentic AI, intelligent automation, and cloud-native data platforms. A global presence across North America, Latin America, Europe, and India.

We are seeking a Senior Data Engineer to join our advanced analytics and AI team supporting some of our large enterprise clients. In this role, you will be responsible for designing, developing, and maintaining scalable data pipelines, processing large datasets, and managing scheduled data workflows to support enterprise data engineering initiatives.

• →Design, develop, and maintain scalable data pipelines using Databricks, Apache Spark, Python, and Scala.
• →Develop and optimize ETL/ELT processes for data ingestion, transformation, and processing across diverse data sources.
• →Work with Hadoop and its ecosystem to process and manage large volumes of structured and unstructured data.
• →Develop, troubleshoot, and optimize Spark applications to improve performance, scalability, and reliability.
• →Use Control-M to schedule, monitor, and manage batch jobs, workflow dependencies, and data processing pipelines.
• →Troubleshoot job failures, resolve data pipeline issues, and ensure timely completion of scheduled workloads.
• →Implement data validation, error handling, and quality checks to ensure data accuracy and consistency.
• →Collaborate with data architects, analysts, and cross-functional teams to understand requirements and deliver reliable data solutions.
• →Follow coding standards, testing practices, version control, and deployment procedures.
• →Support production deployments, incident resolution, and ongoing maintenance of data engineering solutions.

• 8+ years of overall Data Engineering experience.
• Strong hands-on experience with Databricks and Apache Spark.
• Proficiency in Python and Scala for data processing and application development.
• Hands-on experience with Hadoop and big data technologies.
• Experience with Control-M for batch scheduling, job monitoring, workflow orchestration, and dependency management.
• Strong understanding of ETL/ELT processes, data transformations, and distributed data processing.
• Experience in performance tuning, debugging, troubleshooting, and production support.
• Strong SQL skills and understanding of data management concepts.
• Excellent analytical, problem-solving, and collaboration skills.