Data Quality Engineer(Databricks)

Data Quality Engineer is required by a global IT company to join their growing data engineering team.

You will be responsible for:

• Defining, implementing and managing data quality rules across data ingestion, transformation and reporting layers within a Databricks-based lakehouse.
• Developing automated regression and contract tests for data pipelines and business-critical reports.
• Building automated data quality assertions and deployment quality gates for CI/CD pipelines.
• Reproducing reported data issues and converting them into automated regression tests.
• Reviewing transformation logic and data quality changes, ensuring appropriate test coverage.
• Working closely with data engineers and business stakeholders to identify, prioritise and resolve data quality issues.
• Maintaining testing documentation and contributing to continuous improvement of data quality practices.

Required experience and skills:

• Extensive experience testing data pipelines and ETL/ELT processes.
• Databricks.
• Strong SQL skills with experience of complex data transformations.
• Experience designing and implementing automated data quality and regression testing.
• Knowledge of schema validation, data reconciliation and contract testing.
• Experience of integrating automated testing into CI/CD pipelines.
• Agile environment experience.