Machine Learning Engineer (3D Sensor Simulation)
Posted Updated
Description
- The Zoox 3D Sensor Simulation team’s work is at the core of creating in-the-loop simulation and high fidelity synthetic data for training and testing autonomous vehicle AI
- We are looking for a machine learning professional with experience applying ML to sensor data, such as LiDAR, radar, and cameras
- This role lies at the intersection of machine learning and 3D simulation at Zoox, ranging from learned sensor models to neural 3D reconstruction
- By improving the realism of simulated sensors (lidar, radar, and cameras), you’ll enable the Zoox robotics autonomy stack to learn, improve, and enhance the mobility of humans
- Design, train, and validate ML models that improve the realism of simulated lidar, radar, and camera data in autonomous vehicle (AV) simulation pipelines
- Collaborate with Synthetic Data and HIL Sim teams to integrate 3DGS and NeRF-based 3D reconstruction with simulation of all sensor modalities
- Build and curate training datasets from real and simulated sensor data, including GenAI-based data augmentation
- Partner with Sim V&V and Perception engineers to define sensor realism metrics and close the sim-to-real gaps with the greatest impact on autonomy
- Mentor engineers and interns, and establish best practices for training and deploying ML on Zoox sensor data
Benefits
- Paid parental leave
- Affinity groups and sports clubs
- Work from home opportunities
- Health insurance
- Our crew’s health and happiness is our first priority. We offer comprehensive health and mental health support, a wellbeing program, and unlimited and flexible paid time away
- We invest in our crew—and their families—for the long term. That includes generous family planning support, caregiver support, and strong cash compensation with great equity upside
- We look after our crew when they’re in the office too. Our famous food program is a great example, featuring a daily changing menu of local and sustainable dishes
- There’s a busy calendar of social events at Zoox, with more sports teams than you can count. And, of course, playing with robots is an important part of the job description
- 3+ years of experience developing ML models in Python with PyTorch or TensorFlow
- Solid understanding of customizing, tuning, and validating ML training pipelines
- Industry experience applying ML to sensor data (lidar, radar, and/or cameras)
- You do not need to match every listed expectation to apply for this position
- Experience with generative techniques such as diffusion, flow matching, or VAEs
- Experience with 3D reconstruction (3DGS, NeRFs) or differentiable rendering
- Prior experience developing autonomy in AVs or other robotics and computer vision
Skills
Sign in to read and join the discussion.