Skip to content

Zoox

NewBe an early applicant

Machine Learning Engineer (Vision Foundation Models)

Posted Updated

Description

  • The Perception team at Zoox is responsible for how our purpose-built robotaxi understands the world, including what happens inside the cabin
  • In this role, you will design, train, and evaluate vision-based in-cabin perception models that understand passengers, objects, and behaviors inside the vehicle
  • These models support rider safety and the operations that keep each ride running smoothly
  • You will independently own a model area end to end, from data curation and training through evaluation and deployment under real-time and compute constraints, working closely with partners across the company
  • Your work has a direct impact on rider safety and experience as Zoox scales its robotaxi service
  • Design, train, and evaluate vision models that understand passengers, objects, and behaviors inside the vehicle, across detection, pose, and action recognition
  • Independently own a model or feature area end to end: curate data, define labeling guidelines, train and evaluate models, and take them through deployment
  • Set the quality bar for the models you own, using rigorous evaluation and error analysis so they are reliable enough to support live operations
  • Deploy models under real-time and compute constraints shared with the rest of the onboard perception system
  • Partner across product, operations, safety, and vehicle software to turn requirements into model specifications, metrics, and validation plans

Benefits

  • Paid parental leave
  • Affinity groups and sports clubs
  • Work from home opportunities
  • Health insurance
  • Our crew’s health and happiness is our first priority. We offer comprehensive health and mental health support, a wellbeing program, and unlimited and flexible paid time away
  • We invest in our crew—and their families—for the long term. That includes generous family planning support, caregiver support, and strong cash compensation with great equity upside
  • We look after our crew when they’re in the office too. Our famous food program is a great example, featuring a daily changing menu of local and sustainable dishes
  • There’s a busy calendar of social events at Zoox, with more sports teams than you can count. And, of course, playing with robots is an important part of the job description
  • You do not need to match every listed expectation to apply for this position
  • Experience with vision-language models or foundation-model backbones, and with auto-labeling or synthetic data for long-tail and rare classes
  • Strong proficiency in Python and PyTorch for model design, training, and evaluation
  • Deep expertise in computer vision and deep learning for image and video understanding: object detection, pose and action recognition, and fine-grained classification, with hands-on experience with modern architectures (convolutional and vision-transformer detectors, and self-supervised or foundation-model backbones such as DINOv3)
  • MS or PhD in Computer Science, Machine Learning, Computer Vision, or a related field with 6+ years of industry experience (PhD with 3+ years)
  • Track record of owning the full ML lifecycle on real-world data: dataset curation and labeling guidelines, training, metric design (precision, recall, and false-positive rate at an operating point), and error analysis
  • Proficiency in C++ for model integration
  • Experience with in-cabin or occupant monitoring (occupant or driver monitoring systems), ideally including multi-camera or fisheye imagery and low-light conditions
  • Experience deploying deep learning models to real-time, resource-constrained systems (robotics, automotive, or edge devices) with TensorRT / ONNX or similar

Skills

Apply

Apply to Machine Learning Engineer (Vision Foundation Models) at Zoox

Create a free account first, or go straight to the employer.

Free RoleWatch account

  • Get an email when new jobs match your search
  • Save jobs and track every application
  • See how well your CV matches each job

Already have one?

No account needed. Opens the employer's own site in a new tab.

See also

ML / AI jobs by country — openings, pay and top skills →