Skip to content

Movable Ink

Senior Data Engineer (AI Systems)

Posted Updated

Description

  • The AI Systems team owns the core recommendations engine and ML platform that powers billions of AI-driven marketing decisions daily across some of the world’s largest consumer brands
  • As a Senior Data Engineer, you will own the Spark-based data pipelines and data infrastructure at the heart of this system - building, scaling, and optimizing the data layer that feeds our production ML models
  • You will work alongside ML engineers and scientists in a collaborative environment, contributing data pipelines and products to power our core recommender systems and our DaVinci Personalization product
  • This is an opportunity to work end-to-end on large-scale data systems that touch millions of customers, on a team working at the intersection of data engineering and machine learning
  • This role will be reporting to the Director of Engineering (AI/ML)
  • Build, maintain, and optimize production data pipelines that power AI-driven personalization at scale across content selection, send-time optimization, subject line personalization, and frequency capping
  • Own and scale Spark-based batch pipelines, including cluster configuration, tuning, and performance optimization across GCP Dataproc
  • Build and maintain our ML Data Lake, ensuring data quality, accessibility, and efficient storage
  • Support the data needs of ML Engineers and Scientists for model development, training, and evaluation
  • Identify and resolve performance bottlenecks and scaling limitations in data pipelines and infrastructure
  • Collaborate with distributed systems engineers on the platform’s architectural evolution, ensuring data layer continuity throughout
  • Continuously improve data infrastructure for greater scalability and reliability
  • Release features and data products that deliver measurable and tangible business value

Benefits

  • Generous PTO
  • Global Mental Health and Well-Being Benefits
  • 401K Contribution
  • Employee Resource Groups
  • Volunteer Opportunities
  • Social Events and Activities
  • Flexible Work Opportunities
  • Comprehensive Health Benefits
  • Parental Leave and Support
  • Enjoys working in a fast-paced, goal-driven environment
  • Ability to collaborate with technical partners - you’ll be working closely with ML engineers, scientists, and other teams to determine requirements and make design decisions
  • Strong software development skills in Python (unit testing, git, code review, CI/CD)
  • Deep expertise with Apache Spark, including the PySpark DataFrame API and experience solving challenging scaling problems
  • Experience with data storage formats (we use Parquet, Delta Lake)
  • Experience with advanced query optimization
  • Experience with cloud computing platforms (we use Google Cloud Platform)
  • Experience with large-scale data processing, cluster configuration, optimization, and tuning (we use GCP Dataproc)
  • Experience with event streaming data (we use Kafka)
  • 5+ years of data engineering experience
  • Familiar with Software Development Lifecycle practices, such as continuous integration/continuous delivery and automated deployment (we use Docker, Kubernetes, and GitHub Actions)
  • If you’re excited about the role but don’t meet all of the abovementioned qualifications, we encourage you to apply. Our differences bring a breadth of knowledge and perspectives that makes us collectively stronger

Skills

What Senior Data Engineering jobs ask for — and how much of it you have →
Apply

Apply to Senior Data Engineer (AI Systems) at Movable Ink

Create a free account first, or go straight to the employer.

Free RoleWatch account

  • Get an email when new jobs match your search
  • Save jobs and track every application
  • See how well your CV matches each job

Already have one?

No account needed. Opens the employer's own site in a new tab.

See also

Data Engineering jobs by country — openings, pay and top skills →