Senior Data Engineer

As a Senior Data Engineer, you’ll play a key role in scaling and improving how we integrate and process customer data. You will design and implement ETLs that reliably process large volumes of customer-provided data and build tools/improve the platform to make customer integrations faster, more accurate, and more scalable. You’ll also contribute to the development of new features that support our expanding product lines. Your work will have a direct and visible impact on our ability to onboard customers more easily and quickly and power our machine learning grocery solution.

• →Build tools and frameworks that streamline customer integrations, enabling faster onboarding and better handling of customer data.
• →Create robust ETLs in PySpark and DBT to process billions of records from customer datasets, ensuring data is accurate, reliable, and ready for downstream use.
• →Investigate and implement new technologies into the data platform, focusing on practical solutions that address current pain points and anticipate future needs.
• →Collaborate with product, engineering, and go-to-market teams to design and deliver data solutions for new products and features.
• →Identify and implement optimizations to improve ETL runtime and data processing scalability, reducing the time and effort required for integrations.
• →Solve real-world data quality challenges by working directly with messy, incomplete, or inconsistent customer data to extract the signal we need.
• →Support team members by mentoring engineers, leading technical discussions, and providing clear, actionable feedback.

We encourage all highly-qualified candidates to apply, even if they don’t meet every listed qualification.

• Significant experience designing and maintaining ETLs that process large-scale datasets.
• Proficiency with Python, PySpark, SQL, and experience working on platforms/tools like Databricks, Snowflake, or DBT.
• Strong problem-solving skills and the ability to work with ambiguous or incomplete requirements to deliver concrete, impactful solutions.
• A focus on practical outcomes—you're skilled at balancing technical rigor with the need to get things done.
• Experience working directly with complex, unclean datasets and finding innovative ways to process and analyze them.
• A knack for identifying areas where tooling or automation can simplify workflows and reduce manual effort.
• Excellent communication skills—you’re able to explain your ideas clearly to both technical and non-technical audiences.
• Proven leadership in technical projects, with a willingness to mentor and help others grow.

Founded in 2017, Afresh is using AI to tackle the #1 solution to curb climate change: reducing food waste. By building AI specifically for the intricacies of grocery—from the fresh perimeter to the center store—we help grocers minimize waste and maximize sales.

Afresh sits at an incredible intersection of positive social impact, rocket ship financial growth, and cutting-edge technology. Our best-in-class AI research has been published in top journals, including ICML, and our investors include Al Gore’s Just Climate, former Whole Foods Market CEO Walter Robb, and Eric Schmidt's Innovation Endeavors.

Grocery is the past, present, and future of our food system – the waste we create today will impact our planet for years to come. Join us as we continue to build a vibrant, diverse, and inclusive team that embodies our company’s values of proactivity, kindness, candor, and humility.

Here at Afresh, many of our employees work remotely provided that they reside in one of the following states: AL, AR, CA, CO, FL, GA, IL, KY, MA, MI, MT, MO, NV, NJ, NY, NC, OR, PA, TX, WA, UT, VA, WI.