Skip to content

Anthropic

Pre-training Data Infrastructure Engineer

Posted Updated

Description

  • Anthropic is at the forefront of AI research, dedicated to developing safe, ethical, and powerful artificial intelligence
  • Our mission is to ensure that transformative AI systems are aligned with human interests
  • We are seeking a Staff level Engineer to join our Pre-training team, responsible for developing the next generation of large language models
  • In this role, you will work at the intersection of cutting-edge research and practical engineering, contributing to the development of safe, steerable, and trustworthy AI systems
  • Design and implement data processing infrastructure for large language model training (highly performant, reproducible, traceable)
  • Develop and maintain core processing primitives (e.g., tokenization, deduplication, chunking) with a focus on scalability
  • Build robust systems for data quality assurance and validation at scale
  • Collaborate with research teams to implement novel data processing architectures
  • Build and operate end-to-end data pipelines that turn raw web-scale corpora into training-ready datasets
  • Sample Projects:
  • Designing and implementing distributed computing architecture for web-scale data processing
  • Building scalable infrastructure for model training data preparation
  • Developing fault-tolerant distributed processing systems
  • Implementing new infrastructure components based on research requirements

Benefits

  • Comprehensive health, dental, and vision insurance for you and your dependents
  • Inclusive fertility benefits via Carrot Fertility
  • 22 weeks of paid parental leave
  • Flexible paid time off and absence policies
  • Mental health support for you and your dependents
  • Competitive salary and equity packages
  • Optional equity donation matching at a 1:1 ratio, up to 25% of your equity grant
  • Retirement plans with competitive matching
  • Life and income protection plans
  • $500/month flexible wellness and time saver stipend
  • Commuter benefits
  • Annual education stipend
  • Home office stipends
  • Relocation support for those moving for Anthropic
  • Daily meals and snacks in the office
  • Advanced degree in Computer Science or related field
  • 5+ YOE outside of internships
  • Hands-on experience with distributed computing frameworks, particularly Apache Spark
  • Strong software engineering skills with experience building high-throughput fault-tolerant distributed systems
  • Background in Data Infrastructure, MLOps, or ML infrastructure
  • Strong communication skills and ability to work in a collaborative environment
  • Excellent problem-solving skills and attention to detail
  • Experience with language model training infrastructure
  • Minimum years of experience: Years of experience required will correlate with the internal job level requirements for the position
  • Required field of study: A field relevant to the role as demonstrated through coursework, training, or professional experience
  • Minimum education: Bachelor’s degree or an equivalent combination of education, training, and/or experience
  • We encourage you to apply even if you do not believe you meet every single qualification
  • Have significant experience building high-throughput fault-tolerant distributed systems
  • Passionate about system reliability and performance
  • Expertise with Python and Rust
  • Are comfortable working with ambiguous requirements and evolving specifications
  • Take ownership of problems and drive solutions independently
  • Are excited about contributing to the development of safe and ethical AI systems
  • Are eager to learn about machine learning research and its infrastructure requirements
  • Can balance technical excellence with practical delivery

Skills

Apply

Apply to Pre-training Data Infrastructure Engineer at Anthropic

Create a free account first, or go straight to the employer.

Free RoleWatch account

  • Get an email when new jobs match your search
  • Save jobs and track every application
  • See how well your CV matches each job

Already have one?

No account needed. Opens the employer's own site in a new tab.

See also

DevOps jobs by country — openings, pay and top skills →