Software Engineer (Evaluation)
Posted Updated
Description
- Design and implement algorithms and evaluation metrics to drive core AI decision-making
- Build scalable data pipelines and toolchains for large-scale data ingestion, batch processing, and evaluation
- Design system-level evaluation metrics, testing frameworks, and simulation environments across business components
- Design and implement high-performance backend services and distributed architectures , capable of handling large-scale real-time event processing
- Establish and maintain comprehensive system monitoring, fine-grained observability metrics, and automated alerting frameworks to ensure low latency and reliable production operations
- Build and optimize downstream engineering workflows for Large Language Models (LLMs), programmatically steering model reasoning, establishing guardrails, and mitigating hallucinations to ensure reliable outputs
Benefits
- Comprehensive medical, dental, and vision insurance
- Generous PTO and paid holidays
- Daily meals and bi-weekly happy hours
- Equity opportunity
- Retirement plans
- Frequent tech talks
- Strong programming skills in C/C++, Python, and software design
- Possessing solid engineering discipline, or demonstrating strong interest and potential in building large-scale systems, with the ability to maximize performance while keeping complexity and cost to a minimum
- BS/MS or Ph.D in Computer Science or a related field
- Strong foundation in mathematics and theoretical computer science, such as linear algebra, calculus, graph theory, computational geometry, combinatorial optimization algorithms, stochastic processes, and complexity analysis