Machine Learning Engineer - Perception

United States·Foster CityFull-timemid

Data ScienceMachine Learning EngineerDataData & AI

2 views0 saves0 applied

Apply Now

Quick Summary

Overview

The Perception team at Zoox is at the forefront of leveraging GenAI to create synthetic data, unlocking scalable training and evaluation for our autonomous system's perception and entire stack.

Technical Tools

Data ScienceMachine Learning EngineerDataData & AI

The Perception team at Zoox is at the forefront of leveraging GenAI to create synthetic data, unlocking scalable training and evaluation for our autonomous system's perception and entire stack. As a Generative AI Engineer, you will develop and train cutting-edge models for sensor-level scenario generation, utilizing world models and radiance fields techniques with large-scale proprietary data. This role directly impacts the productivity, safety, and capabilities of Zoox's autonomous system by validating algorithms in real-world conditions.

Design, develop, train and evaluate multi-sensor fusion based deep learning models to understand obstacles and environmental context

Understand and curate real and synthetic datasets to improve our models

Perform latency optimization and deploy models to our robot fleet

Build a deep understanding of Perception gaps and behavioral issues around difficult obstacle types in order to help plan and prioritize our work

Collaborate with Prediction/Planner team to deploy fully autonomous vehicles in environments with difficult and rare obstacles, extreme weather conditions, and complex driving scenario

MS or PhD in Computer Science, Machine Learning, or related technical field with 5+ years of industry experience

Proficiency in Python and some knowledge in C++

Deep Learning expertise

Experience developing multi-sensor fusion algorithms for object detection, panoptic segmentation or object tracking

Familiar with Transformer architecture

Publications in top-tier conferences (CVPR, ICCV, RSS, ICRA)

Experience with autonomous robotics systems

Experience implementing 3D Gaussian Splatting