Performance Engineer
Posted Updated
Description
- Running machine learning (ML) algorithms at our scale often requires solving novel systems problems
- As a Performance Engineer, you’ll be responsible for identifying these problems, and then developing systems that optimize the throughput and robustness of our largest distributed systems
- Implement low-latency high-throughput sampling for large language models
- Implement GPU kernels to adapt our models to low-precision inference
- Write a custom load-balancing algorithm to optimize serving efficiency
- Build quantitative models of system performance
- Design and implement a fault-tolerant distributed system running with a complex network topology
- Debug kernel-level network latency spikes in a containerized environment
Benefits
- Comprehensive health, dental, and vision insurance for you and your dependents
- Inclusive fertility benefits via Carrot Fertility
- 22 weeks of paid parental leave
- Flexible paid time off and absence policies
- Mental health support for you and your dependents
- Competitive salary and equity packages
- Optional equity donation matching at a 1:1 ratio, up to 25% of your equity grant
- Retirement plans with competitive matching
- Life and income protection plans
- $500/month flexible wellness and time saver stipend
- Commuter benefits
- Annual education stipend
- Home office stipends
- Relocation support for those moving for Anthropic
- Daily meals and snacks in the office
- Want to learn more about machine learning research
- Have significant software engineering or machine learning experience, particularly at supercomputing scale
- Care about the societal impacts of your work
- Are results-oriented, with a bias towards flexibility and impact
- Pick up slack, even if it goes outside your job description
- Enjoy pair programming (we love to pair!)
- High performance, large-scale ML systems
- GPU/Accelerator programming
- OS internals
- ML framework internals
- Language modeling with transformers
- Strong candidates here will have a track record of solving large-scale systems problems and will be excited to grow to become an expert in ML also
- Applications will be reviewed on a rolling basis
Skills
Sign in to read and join the discussion.