Data QA (Azure Data Testing/PySpark Automation)

India·Indoremid

OtherQa Specialist

0 views0 saves0 applied

Apply Now

Quick Summary

Overview

Hello Sr Data QA Professional! Hope you are doing well!We are looking for an " Data QA (Azure Data Testing/PySpark Automation) in Indore, MP." Below is the JD for review.

Technical Tools

OtherQa Specialist

Hello Sr Data QA Professional!

Hope you are doing well!

We are looking for an " Data QA (Azure Data Testing/PySpark Automation) in Indore, MP."

Below is the JD for review.

Job Title: Data QA (Big Data Testing/PySpark Automation)
Location: Indore, MP
Full Time
Experience: 5-10 Years

Must have:

ETL/Data Testing/Azure Databricks + Azure Data Factory: 5+ years (Required)
Strong SQL + Python/Py Spark: 5+ years (Required)

Experienced in end-to-end of ETL (Data Pipeline) QA testing using various technologies in Azure cloud involving ingestion from varied data sources.
Should be familiar with data warehousing target and intermediate structures ideally in environments using data lakes. Well versed in Databricks, SQL Database, Azure Data Factory, Azure Data Lake
Must have hands-on experience in PySpark, SparkSQL, T-SQL
Should be able to go through requirements, design specs and create appropriate test scenarios across various layers/stages of data pipelines.
Should be able to write reusable PySpark and T-SQL script to validate data across layers.
Experience of working in Databricks Delta Lake will be highly desirable.
Ideally should have worked in a team using Agile methodology.
Appreciation of data, its quality, and its usage for business benefit
Very good communication and written skills

Nice to Have
• Experience in the Banking/Finance domain

📩 Interested candidates can apply or share their profiles with us at "rahul@ccube.com"