Skip to content

Elastic

Lead Data Engineer

Posted Updated

Description

  • We’re looking for a Lead Data Engineer to join our Data Engineering & Architecture team
  • In this role, you’ll help grow a Data Platform that makes it easier for teams across our company to work with data confidently and effectively
  • Your work will directly support our business goals not just by keeping data flowing, but by turning it into something people can actually use and trust
  • This is a great opportunity for someone who enjoys both the technical craft of data engineering and the human side of it: collaborating with partners, sharing knowledge, and helping others get more out of the tools and systems you build together
  • You’ll design, maintain, and improve the pipelines and infrastructure that power our data platform. Day to day, that means working across the full data lifecycle — from ingestion and streaming to transformation and delivery — using tools like Apache Airflow, Spark, Iceberg, Kafka, Flink, and dbt Labs
  • Beyond the technical work, you’ll spend meaningful time with stakeholders to understand what they need and help define how data should flow across systems. That includes co-creating data contracts, writing clear documentation, and guiding teammates on how to get the most out of the platform
  • A few other things you’ll take on:
  • Monitor and refine pipeline performance and refine processes to keep things running smoothly
  • Use Terraform to provision and manage resources on Google Cloud Platform (GCP)
  • Help steward the platform by reviewing code and ensuring good practices and standard processes are followed
  • Process access requests and support compliance with platform policies

Benefits

  • Toast to your health: Fully paid health coverage for you and your family, in many locations.
  • Craft your calendar: Flexible location and schedule for most roles.
  • Create space for you: Distributed by design workforce, plus generous number of vacation days each year.
  • Embrace parenthood: Minimum of 16 weeks of parental leave, plus generous family formation benefits.
  • Give back your time: 40 hours each year to use toward volunteering with organizations and causes you’re passionate about.
  • Amplify your impact: Double your charitable giving — we match donations up to $1500 USD (or local currency equivalent).
  • Proficient in programming languages, particularly Bash, Python, and SQL
  • Experience with Spark, Flink, Kafka, and dbt Labs for data processing and transformation
  • Skilled in using Terraform for infrastructure-as-code deployments
  • Bonus: Proven experience with data security and access controls for SOX Compliant data
  • Knowledge of database systems, including OLAP, OLTP, Document, and Vector databases
  • 8+ years of experience in data engineering or related roles
  • Bonus: Experience and knowledge of the Elastic stack
  • Experience with Apache Airflow for orchestrating data workflows
  • Experience with Google Cloud Platform (GCP) for cloud resource management
  • Understanding of Apache Iceberg for data table formats and data warehouse and lakehouse strategies

Skills

What Lead Data Engineering jobs ask for — and how much of it you have →
Apply

Apply to Lead Data Engineer at Elastic

Create a free account first, or go straight to the employer.

Free RoleWatch account

  • Get an email when new jobs match your search
  • Save jobs and track every application
  • See how well your CV matches each job

Already have one?

No account needed. Opens the employer's own site in a new tab.

See also

Data Engineering jobs by country — openings, pay and top skills →