Data Engineering Lead
Quick Summary
Lead the architecture, design, and development of scalable data pipelines using AWS Glue, EMR, S3, Python, and PySpark.
Strong experience in AWS data engineering, particularly Amazon S3, AWS Glue, and Amazon EMR. Proficiency in Python, PySpark, SQL, and ETL/ELT development. Expertise in designing, developing,
We are seeking an experienced Data Engineering Lead to drive the design, development, and delivery of scalable cloud-based data solutions. In this role, you will leverage AWS native services, Python, and PySpark to build robust data pipelines and modernize enterprise data platforms. You will play a key role in shaping data architecture, improving data integration, and developing high-performance data products. Working across complex enterprise environments, you will establish engineering standards and ensure the reliability, quality, and scalability of data solutions. You will also provide technical leadership, mentor engineering teams, and collaborate with architecture, technology, and business stakeholders. This is an opportunity to make a meaningful impact in a flexible, remote-first environment while contributing to large-scale data transformation initiatives.
As a Data Engineering Lead, you will oversee technical delivery and guide the development of enterprise-grade data engineering solutions. Your responsibilities will include:
-
Lead the architecture, design, and development of scalable data pipelines using AWS Glue, EMR, S3, Python, and PySpark.
-
Drive enterprise data integration initiatives and the implementation of ETL/ELT workflows.
-
Lead the development of reliable, scalable, and reusable data products.
-
Define and maintain engineering standards, best practices, and development guidelines.
-
Conduct technical design reviews and code reviews to ensure solution quality and consistency.
-
Optimize data pipelines for performance, data quality, processing efficiency, and scalability.
-
Mentor and guide Data Engineers, supporting their technical development and delivery.
-
Collaborate with architecture, technology, and business teams to align data engineering solutions with enterprise objectives.
Requirements
~1 min readThe ideal candidate combines strong hands-on AWS data engineering expertise with proven technical leadership experience. You should demonstrate:
-
Strong experience in AWS data engineering, particularly Amazon S3, AWS Glue, and Amazon EMR.
-
Proficiency in Python, PySpark, SQL, and ETL/ELT development.
-
Expertise in designing, developing, and optimizing large-scale data pipelines.
-
Solid experience with enterprise data integration and complex data engineering environments.
-
Proven ability to provide technical leadership, establish engineering standards, and conduct code and design reviews.
-
Experience mentoring and guiding data engineering teams.
-
Experience with Amazon Redshift, Athena, and DynamoDB.
-
Knowledge of Apache Iceberg and modern data lake or lakehouse architectures.
-
Familiarity with domain-oriented data products and authoritative data sources.
-
Exposure to large-scale enterprise data platform modernization initiatives.
What We Offer
~2 min readLocation & Eligibility
About this job
- Who can apply
- United States
- Posted
- Today
Listing Details
- Posted
- November 3, 2026
- First seen
- November 3, 2026
- Last seen
- November 3, 2026
Posting Health
- Days active
- 0
- Repost count
- 0
- Trust Level
- 68%
- Scored at
- November 3, 2026
Signal breakdown
Browse Similar Jobs
Stay ahead of the market
Get the latest job openings, salary trends, and hiring insights delivered to your inbox every week.
No spam. Unsubscribe at any time.