~4mo ago

Data Engineer

mid

Data EngineerData

2 views0 saves0 applied

Quick Summary

Overview

Build, maintain, and document scalable data pipelines and data ingestion processes. Develop and support ETL/ELT workflows to ensure reliable and efficient data movement across systems.

Technical Tools

Data EngineerData

Build, maintain, and document scalable data pipelines and data ingestion processes.
Develop and support ETL/ELT workflows to ensure reliable and efficient data movement across systems.
Assist in developing batch and real-time data processing solutions.
Support the implementation and maintenance of modern data lake and lakehouse architectures.
Write and optimize data transformation logic using PySpark and PL/SQL.
Develop, monitor, and maintain Apache Airflow DAGs for workflow orchestration.
Ensure data quality, accuracy, and consistency across data platforms.
Collaborate with Data Scientists, BI Developers, Machine Learning Engineers, and Platform Teams to deliver data solutions.
Participate in troubleshooting, performance tuning, and optimization of data pipelines.
Follow data engineering best practices, coding standards, and version control processes.

Requirements

~1 min read

2–4 years of experience in Data Engineering or a related field.
Strong foundation in PySpark and PL/SQL.
Hands-on experience with Apache Airflow and workflow orchestration.
Proficiency with Git and version control best practices.
Solid understanding of ETL/ELT processes and data modeling concepts.
Exposure to cloud-based environments and big data platforms such as Databricks or similar technologies.
Familiarity with data integration, transformation, and data quality practices.
Strong analytical and problem-solving skills.
Good communication and collaboration abilities.