Senior Data Software Engineer

BrazilRemoteFull-timesenior

Software EngineerSoftware Engineering

1 views0 saves0 applied

Apply Now

Quick Summary

Overview

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Data Software Engineer based in Brazil.

Technical Tools

Software EngineerSoftware Engineering

We are looking for an experienced Senior Data Software Engineer to design and build scalable, reliable data solutions that support critical business decisions. In this role, you will develop and maintain data pipelines, ingestion processes, and data workflows across multiple source systems. You will work with modern data engineering technologies, including PySpark, Spark SQL, Delta Lake, and Databricks ecosystem tools. Collaborating with cross-functional and international teams, you will translate business data requirements into robust technical solutions. You will also contribute to data quality, system reliability, and continuous improvements in engineering standards. This opportunity offers exposure to international projects, a collaborative engineering environment, and ongoing professional development.

Design, develop, and maintain scalable data pipelines that enable reliable data movement across multiple systems.
Build and manage data ingestion processes from a variety of source systems.
Write clean, efficient, maintainable, and well-tested code in accordance with established software engineering practices.
Collaborate with cross-functional teams to understand data requirements and translate them into effective technical solutions.
Monitor data pipeline performance and proactively identify and resolve issues to maintain system reliability.
Participate in code reviews, uphold engineering quality standards, and share technical knowledge with colleagues.
Troubleshoot data quality issues and ensure accuracy, consistency, and reliability across datasets.
Contribute to the continuous improvement of data architecture, engineering practices, and development standards.
Document technical processes, solutions, and workflows to support knowledge sharing and team onboarding.
Participate in agile development activities, including sprint planning and other team ceremonies.

Requirements

~1 min read

At least 3 years of relevant professional experience in data engineering or a related software engineering field.
Strong hands-on experience with PySpark and Spark SQL for building and processing large-scale data workflows.
Experience building and managing Lakeflow pipelines and Jobs for data orchestration.
Proficiency with Auto Loader and JDBC/CDC ingestion methods, working with source systems such as DB2 and SQL Server.
Solid experience with Delta Lake and Unity Catalog for data storage, management, and governance.
Background in data quality assurance and source reconciliation to maintain accurate and trustworthy datasets.
Experience writing unit tests using pytest to validate code reliability and correctness.
Working knowledge of Git and Asset Bundles for version control and deployment management.
English proficiency at B2 level or higher, with the ability to collaborate effectively in an international working environment.
Strong problem-solving skills, attention to detail, and a commitment to clean, reliable, and maintainable code.
Ability to collaborate with cross-functional teams, communicate technical concepts clearly, and contribute to shared engineering goals.