Software Engineer Pretraining Data

You will build and operate systems that transform raw web, code, multimodal, and acquired data into training-ready datasets. Depending on focus, you will develop data-quality models and experiments, platform pipelines and tooling, or web-crawling infrastructure, while improving reliability, observability, and model-training outcomes.

Responsibilities

• Build high-throughput data pipelines with end-to-end traceability
• Train and deploy models to classify, rank, filter, clean, and identify data
• Design and run data-mixture, repeatability, and quality experiments
• Build pipelines, orchestration, and tooling for training-ready datasets
• Create signals for data quality, lineage, freshness, and pipeline health
• Build and scale web crawling systems for discovering, fetching, and parsing documents
• Improve URL seeding, scoring, host scheduling, crawl success, and parsing quality
• Harden crawl infrastructure for availability, recovery, and ingestion lag
• Automate delivery of crawl datasets into data pipelines

Requirements

• Strong infrastructure or data-platform background
• Ability to architect and ship end-to-end systems with high ownership
• Ability to debug complex systems independently
• Strong knowledge of large-scale distributed systems
• Experience working alongside AI agents