Senior Staff Machine Learning Engineer (Perception, Simulation Realism)
Posted Updated
Description
- We are looking for a strategic technical leader to drive the ML perception architecture for Sim GroundTruth. This role sits at the critical intersection of cutting-edge perception ML research, foundation models, and massive-scale offline data engineering
- As a Senior Staff Machine Learning Engineer, you will serve as the chief technical authority for our perception models, guiding and mentoring ML engineers to solve the “technical moat” of high-fidelity 3D perception and ML inference at a petabyte scale
- Scalable ML Architecture & Signal Expansion: Architect a modular, extensible ML framework capable of rapidly absorbing a growing list of complex signal requirements. You will lead the transition from specialized models to unified Foundation Model architectures that maintain “Oracle” quality while scaling to hundreds of new semantic categories
- Strategic Ownership & Quality Leadership: Define the multi-year roadmap for signal quality, coverage, and reliability. Your mandate is to ensure our signals don’t just match onboard software—they set the industry benchmark for ground truth accuracy
- ML Scale & Inference Efficiency: Lead the optimization of high-fidelity perception model inference and compute efficiency across massive, petabyte-scale datasets, collaborating with backend infrastructure leads to support rigorous, high-frequency evaluation
- Stakeholder & Ecosystem Growth: Act as the primary interface for “Application Owners” across the company. You will translate complex simulation needs into technical requirements and aggressively grow our customer base to ensure every major software launch is “Oracle-validated.”
- Technical Leadership & Mentorship: Serve as the senior technical leader and mentor for ML perception engineers, championing modeling best practices, architectural rigor, and driving technical execution on mission-critical P0 perception initiatives
Benefits
- Medical, dental, and vision insurance for employees and dependents
- Employee assistance programs focused on mental health
- Personalized workplace adjustments for diverse needs and abilities, including physical, mental, and neurodivergent considerations
- Access to mental health apps
- Onsite wellness centers
- Medical advocacy program for transgender employees
- Counseling services
- Second medical opinion for you and your loved ones
- Support programs including menopause benefit
- Competitive compensation
- Regular bonus and equity performance grant opportunities
- Generous 401(k) and regional retirement plans
- Annual cross-company compensation review and pay equity analysis
- 1-on-1 financial coaching
- Fertility and growing family assistance
- Parental leave and baby bonding leave
- Backup childcare
- Elder care and support
- Survivor income benefit
- Caregiver leave
- Paid time off, including vacation, bereavement, sick leave, parental leave, disability, and holidays
- Jury duty leave
- Military leave
- Hybrid work model with remote work opportunities also available
- Educational reimbursement
- Peer learning and coaching platform
- Donation matching programs
- Employee resource groups
- Volunteer hours
- Internal community groups and local culture clubs
- Inspiring spaces to work, recharge, and collaborate with fellow Waymonauts
- On-site meals and snacks
- Fitness centers, massage programs, and ergonomic support
- On-demand fitness, wellbeing, and cooking classes
- Commuter benefits
- Education: Master’s or PhD in Computer Science, Machine Learning, Robotics, or a related field (PhD preferred)
- ML & Perception Expertise: Deep understanding of Foundation Models (VLMs or MMLMs) and computer vision / perception architectures (e.g., Transformers, 3D detection, scene reconstruction), specifically in the context of post-training, fine-tuning, or inference-time scaling
- Technical Depth: Hands-on experience with an ability to technically lead ICs daily, including deep knowledge of codebases, eval/data pipelines, and model architectures
- Cross-Stakeholder Alignment: Proven track record of navigating complex organizations to gather requirements from diverse customers and aligning them into a unified technical roadmap. You can negotiate Roles & Responsibilities (R&R) across competing priorities
- Proficiency: Expert-level skills in Python, Numpy, and deep learning frameworks (PyTorch or JAX)
- Technical Leadership: Proven track record of senior technical leadership setting technical vision, architecting complex ML systems, and mentoring senior engineers and research scientists
- Systems Engineering: Experience building and scaling distributed systems or data pipelines at a petabyte scale
- Object Detection & AV Perception: Deep expertise in 2D and 3D object detection, multi-modal sensor fusion (camera, LiDAR), tracking, and offboard ground-truth generation for autonomous vehicles
- Software Rigor: Proficiency in C++ and experience with production-grade ML deployment
- Academic Impact: A strong publication record at top-tier conferences (CVPR, ICRA, NeurIPS) or leadership in major open-source projects
Skills
Sign in to read and join the discussion.