Software Engineer (Evals)

• You will own and elevate our mission-critical research platform that directly accelerates SpaceXAI’s frontier work
• The evals team creates and executes instruments for measuring model capabilities and behaviors. These instruments are used to clean datasets, provide feedback for experiments, and track growth throughout training
• The evals team also diagnoses why agents fail and how to make improvements both short and long term. We manage the execution infrastructure, design data sets and grading schemes
• You will design, build, and ship delightful and bulletproof systems that engineers love to use every day. This role values a strong attention to details, first principles reasoning, and great taste

Benefits

• Health and wellness: Comprehensive health insurance including medical, dental, vision, and disability coverage
• Life and family: Life and AD&D insurance and fertility benefits to ensure our team’s well-being and peace of mind
• Flexible vacation: We work hard but avoid burn out. Take time off when you need it
• Visa sponsorship: We support international talent with visa sponsorship to join our team
• 401(k) plan: Retirement savings plan to secure your financial future

• All employees are expected to be hands-on and to contribute directly to the company’s mission. Leadership is given to those who show initiative and consistently deliver excellence
• Work ethic and strong prioritization skills are important. All employees are expected to have strong communication skills. They should be able to concisely and accurately share knowledge with their teammates
• We are open to all levels from new grads to senior engineers
• Software engineering proficiency and 3+ years of experience actively writing code
• A track record of shipping high quality projects and a strong sense of urgency
• Strong attention to detail
• Exceptional product taste - you have a sharp sense for what “good” looks like in outputs, and you can translate fuzzy notions of quality, helpfulness, truthfulness, and safety into concrete, measurable criteria
• Familiarity with AI/ML workflows, annotation tools, or evals
• Previously founded a startup or joined a fast-growing early-stage startup
• Experience creating and maintaining component libraries, design systems, or internal tools