Pre-training Data Infrastructure Engineer
Posted Updated
Description
- Anthropic is at the forefront of AI research, dedicated to developing safe, ethical, and powerful artificial intelligence
- Our mission is to ensure that transformative AI systems are aligned with human interests
- We are seeking a Staff level Engineer to join our Pre-training team, responsible for developing the next generation of large language models
- In this role, you will work at the intersection of cutting-edge research and practical engineering, contributing to the development of safe, steerable, and trustworthy AI systems
- Design and implement data processing infrastructure for large language model training (highly performant, reproducible, traceable)
- Develop and maintain core processing primitives (e.g., tokenization, deduplication, chunking) with a focus on scalability
- Build robust systems for data quality assurance and validation at scale
- Collaborate with research teams to implement novel data processing architectures
- Build and operate end-to-end data pipelines that turn raw web-scale corpora into training-ready datasets
- Sample Projects:
- Designing and implementing distributed computing architecture for web-scale data processing
- Building scalable infrastructure for model training data preparation
- Developing fault-tolerant distributed processing systems
- Implementing new infrastructure components based on research requirements
Benefits
- Comprehensive health, dental, and vision insurance for you and your dependents
- Inclusive fertility benefits via Carrot Fertility
- 22 weeks of paid parental leave
- Flexible paid time off and absence policies
- Mental health support for you and your dependents
- Competitive salary and equity packages
- Optional equity donation matching at a 1:1 ratio, up to 25% of your equity grant
- Retirement plans with competitive matching
- Life and income protection plans
- $500/month flexible wellness and time saver stipend
- Commuter benefits
- Annual education stipend
- Home office stipends
- Relocation support for those moving for Anthropic
- Daily meals and snacks in the office
- Advanced degree in Computer Science or related field
- 5+ YOE outside of internships
- Hands-on experience with distributed computing frameworks, particularly Apache Spark
- Strong software engineering skills with experience building high-throughput fault-tolerant distributed systems
- Background in Data Infrastructure, MLOps, or ML infrastructure
- Strong communication skills and ability to work in a collaborative environment
- Excellent problem-solving skills and attention to detail
- Experience with language model training infrastructure
- Minimum years of experience: Years of experience required will correlate with the internal job level requirements for the position
- Required field of study: A field relevant to the role as demonstrated through coursework, training, or professional experience
- Minimum education: Bachelor’s degree or an equivalent combination of education, training, and/or experience
- We encourage you to apply even if you do not believe you meet every single qualification
- Have significant experience building high-throughput fault-tolerant distributed systems
- Passionate about system reliability and performance
- Expertise with Python and Rust
- Are comfortable working with ambiguous requirements and evolving specifications
- Take ownership of problems and drive solutions independently
- Are excited about contributing to the development of safe and ethical AI systems
- Are eager to learn about machine learning research and its infrastructure requirements
- Can balance technical excellence with practical delivery
Skills
Sign in to read and join the discussion.