Data Engineer - AWS and Snowflake (Contract)

This project involves building the data foundation for a generative AI platform that automates and optimises global advertising messaging. Working within a specialist consultancy, you will be responsible for the infrastructure that allows high-volume data to be translated into machine-learned campaign insights.

The Project Scope

• AI Infrastructure: Develop and maintain the scalable data architectures required to support business-critical AI and machine learning applications.
• Architectural Leadership: Propose and implement architectural decisions that ensure long-term scalability and high availability.
• System Observability: Build and manage tools for monitoring and quick resolution of operational bottlenecks within the pipeline.
• Collaborative Engineering: Translate complex business needs into technical solutions while mentoring junior engineers on best practices.

• Data Stack: Heavy utilisation of Snowflake, specifically leveraging Iceberg Tables, data shares, and materialised views.
• Core Language: Professional-grade development in Python.
• Cloud Operations: Full-cycle management of AWS services including IAM, CloudWatch, and Secrets Manager.
• Tooling: Daily use of Airflow, Lambda, S3, and Spark for orchestration and storage.
• Documentation: Clear communication of system designs using UML or C4 Architecture Diagrams.

This is an opportunity to work on a 24x7 high-availability production environment where technical innovation is a requirement, not an afterthought. The culture is built on agile delivery and continuous learning, providing a space for engineers to evaluate and incorporate state-of-the-art tooling into a global product.