~10d ago

Senior Data Engineer

South Africa·Johannesburgsenior

Data EngineerData

1 views0 saves0 applied

Apply Now

Quick Summary

Key Responsibilities

Lead the design, development, and maintenance of scalable data pipelines and systems. Implement and oversee data integration solutions to consolidate data from various sources.

Requirements Summary

Bachelors or Masters degree in Computer S

Technical Tools

Data EngineerData

Responsibilities

~1 min read

→Lead the design, development, and maintenance of scalable data pipelines and systems.
→Implement and oversee data integration solutions to consolidate data from various sources.
→Optimize data architecture and data flow for performance, reliability, and scalability.
→Collaborate with data analysts, scientists, and other stakeholders to understand data requirements and deliver solutions.
→Ensure data quality and integrity through rigorous testing, validation, and monitoring.
→Develop and maintain ETL processes to extract, transform, and load data.
→Monitor, troubleshoot, and improve data systems to ensure smooth operation.
→Stay updated with the latest industry trends and technologies to continuously enhance data infrastructure.
→Mentor and guide junior data engineers and other team members.

Requirements

~1 min read

Bachelors or Masters degree in Computer Science, Engineering, Information Technology, or a related field.
Extensive experience as a Data Engineer or in a similar role, with a proven track record of building and maintaining data infrastructure.
Proficiency in advanced data engineering tools and technologies (e.g., SQL, (Python – AI/ML libraries), Hadoop, Apache Spark, Git and Github, Google Colab, AutoML platforms)
Strong understanding of database management systems, data warehousing, and big data technologies.
Experience with cloud platforms (e.g., AWS, Azure, Google Cloud) is highly desirable.
Excellent problem-solving skills and attention to detail.