ETL/ Bigdata Tester

India·Indoremid

Other

1 views0 saves0 applied

Apply Now

Quick Summary

Key Responsibilities

Design, implement, and maintain scalable test automation frameworks from scratch using Java and Python. ETL & Big Data Validation: Formulate automated test suites to validate complex ETL pipelines,

Requirements Summary

Integrate automated test suites into CI/CD pipelines (e.g., Jenkins, GitHub Actions, GitLab CI) to ensure continuous quality gates across all release cycles. Defect Management: Identify, report,

Technical Tools

Other

We are seeking an experienced Big Data Test Automation Engineer to design, build, and maintain robust test automation frameworks across our large-scale data platforms and web applications. In this role, you will validate complex data pipelines (ETL/ELT), ensure high data integrity across distributed data stores, and automate both back-end data processing and front-end interface workflows using modern test frameworks.

Responsibilities

~1 min read

→Test Framework Development: Design, implement, and maintain scalable test automation frameworks from scratch using Java and Python.
→ETL & Big Data Validation: Formulate automated test suites to validate complex ETL pipelines, data transformations, data quality, data completeness, and schema migrations across distributed environments.
→UI & BDD Automation: Automate functional, regression, and end-to-end user workflows using Selenium WebDriver integrated with BDD Cucumber.
→Service & Pipeline Testing: Build and execute test suites using Pytest for data scripts, API services, and scheduled pipeline jobs.
→Database & Query Verification: Author advanced SQL queries to extract, reconcile, and validate high-volume data sets across relational databases, data warehouses, and data lakes.
→Functional & Integration Testing: Partner with product managers and data engineers to derive comprehensive test scenarios, edge cases, and acceptance criteria from functional requirements.
→CI/CD Integration: Integrate automated test suites into CI/CD pipelines (e.g., Jenkins, GitHub Actions, GitLab CI) to ensure continuous quality gates across all release cycles.
→Defect Management: Identify, report, trace, and isolate defects using issue tracking tools (e.g., JIRA), performing thorough root cause analysis on pipeline or automation failures.

Requirements

~1 min read

Experience: 5 years of hands-on experience in Quality Assurance and Test Automation, with significant focus on Data Platform or Big Data testing.
Programming Languages: Strong proficiency in both Java and Python.
Automation Tools & Frameworks:
- Hands-on expertise with Selenium WebDriver.
- Strong working knowledge of BDD frameworks (Cucumber / Gherkin syntax).
- Deep experience with Pytest for Python-based test development.
Database & ETL Skills:
- Advanced SQL skills (joins, window functions, aggregations, subqueries) for large-scale data validation.
- Proven experience in ETL/ELT Testing, validating source-to-target data mappings, reconciliation, and schema integrity.
Testing Methodologies: Solid foundation in Functional Testing, Regression Testing, End-to-End Testing, and Data Quality Assurance best practices.
Education: Bachelor’s or Master’s degree in Computer Science, Software Engineering, Information Technology, or a related technical discipline (or equivalent practical experience).