Senior Software Engineer (Evaluation)

• Design and build end-to-end data processing pipelines and toolchains to support large-scale data collection, batch processing, curation, and multi-dimensional evaluation
• Design and implement high-performance backend services and distributed architectures , capable of handling large-scale real-time event processing
• Collaborate across complex business components to lead the design of targeted system-level evaluation metrics, testing frameworks, and advanced simulation environments
• Leverage and improve industry-leading, open-source distributed technologies to continuously advance infrastructure capabilities and processing efficiency
• Drive critical architectural decisions and technology selection, ensuring rigorous standards for security, stability, scalability, and high performance
• Establish and maintain comprehensive system monitoring, fine-grained observability metrics, and automated alerting frameworks to ensure low latency and reliable production operations
• Build and optimize downstream engineering workflows for Large Language Models (LLMs), programmatically steering model reasoning, establishing guardrails, and mitigating hallucinations to ensure reliable outputs

Benefits

• Comprehensive medical, dental, and vision insurance
• Generous PTO and paid holidays
• Daily meals and bi-weekly happy hours
• Equity opportunity
• Retirement plans
• Frequent tech talks

• Pursueing a BS/MS or Ph.D in Computer Science or a related field
• Possessing solid engineering discipline, or demonstrating strong interest and potential in building large-scale systems, with the ability to maximize performance while keeping complexity and cost to a minimum
• Experience in large data set processing and familiarity with real time systems
• Solid experience in a fast-paced and structured engineering environment
• Full stack experience including both front end and back end is preferred
• Strong programming skills in C/C++, Python, and software design
• Statistics analysis experience is preferred
• Strong foundation in mathematics and theoretical computer science, such as linear algebra, calculus, graph theory, computational geometry, combinatorial optimization algorithms, stochastic processes, and complexity analysis