[Job-31899] Senior Data Engineer, Campinas (on-site)

Key Responsibilities:
- Develop and maintain data pipelines;
- Integrate data from various sources (APIs, relational databases, files, etc.);
- Collaborate with business and analytics teams to understand data requirements;
- Ensure quality, reliability, security and governance of the ingested data;
- Follow modern DataOps practices such as Code Versioning, Data Tests and CI/CD
- Document processes and best practices in data engineering.

Must-have:

- Availability to work 5x/week at our Campinas office.
- Proven experience in building data pipelines in AWS , leveraging S3, Glue, Lambda, Iceberg tables, Spark and Athena.
- Strong programming skills in Python and SQL for data processing and transformation;
- Understanding of ETL/ELT frameworks, data warehousing, and distributed data processing;
- Experience with modern DataOps practices.
- Familiarity with a variety of cloud platforms (AWS, Azure, or GCP) and related data services).
- Advanced English level.
 
Nice-to-have:
- Experience with Databricks, Lakehouse and Unity Catalog.
- Experience with data contracts, schema evolution, and ensuring compatibility across services.
- Expertise in data quality frameworks (e.g., Great Expectations, Soda, dbt tests, or custom-built solutions).
- Familiarity with DBT, Atlan and Soda.
- Integration with Power BI
- Experience with Data Streaming.

 

#LI-GP1