Software Engineer II - Offboard Python Application

The Virtual Test Ecosystem (VTE) team ensures that our simulation (fully synthetic) and resimulation (replay engine using vehicle logs) workflows run efficiently and reliably at large scale.  We use a mix of open source and cloud provider services to implement a processing framework that’s cloud-agnostic as well as capable of running on-prem.  The results of these simulations is business-critical for us - they’re used in order to allow autonomy developers and testers to do large-scale safety and performance testing of changes prior to in-vehicle testing.  We interact with engineers throughout the onboard and offboard stack in order to ensure smooth end-to-end capabilities.

• →We run vehicle simulations at unprecedented scales in order to ensure we’re releasing a safe product.  You’ll support this via improvements to our sim/resim cloud framework and applications that run on this framework.  In terms of implementation, this involves a lot of Python coding, interacting with open source packages and various AWS/GCP services.  In terms of analysis, we’re constantly looking for bottlenecks that limit scalability or otherwise hinder performance.  You’ll put together benchmarking to identify these spots and associated dashboards to track and summarize the information.  Then armed with that information, you’ll implement solutions to increase efficiency.
• →It’s not enough to have a framework that is functional - it needs to be intuitive and easy to use.  We take our best guesses at this, but things evolve over time based on user interaction - both direct feedback as well as realizing how users are accidentally misusing or misinterpreting the results.  VTE supports autonomy, systems, test, and a variety of other teams across the organization. Having an eye for how the system is being used, what users need, and a willingness to engage with these users on future improvements is critical.  
• →We also can’t build it all, so we want to make the framework well-documented and as self-serve as possible for others to extend it (while being there to answer questions).  For example, when there’s a new portion of the autonomy stack, we want that autonomy team to be able to update resim to add it in themselves so that they can iterate quickly.
• →In order to run logs through resim, we need to first know what logs are interesting.  You’ll contribute to the ecosystem of how we manage storing and searching for these logs efficiently, including how we automate indexing the interesting actors and interactions in a scene and how we determine our dataset coverage.
• →Once we’ve run resim, we want to do something with the updated logs.  Frequently this involves metrics to analyze the AV’s performance; these metrics could range from low-level performance of a particular detector in the stack to if the AV is meeting high-level business objectives.  You’ll both work on the sim/resim cloud framework implementation to make this easy for all developers to add in their metrics and support the metrics implementation themselves as needs arise.

• Bachelor's degree in Computer Engineering, Computer Science, Electrical Engineering, Robotics or a related field and 4+ years of relevant experience (or Master's degree and 2+ years of relevant experience, or PhD)
• Expertise in writing Python code that’s efficient, well-documented, and well-tested
• 2+ years’ experience writing scalable applications that execute in a cloud or HPC environment
• 2+ years’ experience writing software that interacts with AWS and/or GCP services
• Familiarity with NumPy and scientific programming
• Willingness and desire to learn how onboard and offboard components interact with each other and propose solutions to improve how developers and testers work with both systems

• C++ development experience
• Experience with Kubernetes