Lead Data Engineer
Posted Updated
Description
- We’re looking for a Lead Data Engineer to join our Data Engineering & Architecture team
- In this role, you’ll help grow a Data Platform that makes it easier for teams across our company to work with data confidently and effectively
- Your work will directly support our business goals not just by keeping data flowing, but by turning it into something people can actually use and trust
- This is a great opportunity for someone who enjoys both the technical craft of data engineering and the human side of it: collaborating with partners, sharing knowledge, and helping others get more out of the tools and systems you build together
- You’ll design, maintain, and improve the pipelines and infrastructure that power our data platform. Day to day, that means working across the full data lifecycle — from ingestion and streaming to transformation and delivery — using tools like Apache Airflow, Spark, Iceberg, Kafka, Flink, and dbt Labs
- Beyond the technical work, you’ll spend meaningful time with stakeholders to understand what they need and help define how data should flow across systems. That includes co-creating data contracts, writing clear documentation, and guiding teammates on how to get the most out of the platform
- A few other things you’ll take on:
- Monitor and refine pipeline performance and refine processes to keep things running smoothly
- Use Terraform to provision and manage resources on Google Cloud Platform (GCP)
- Help steward the platform by reviewing code and ensuring good practices and standard processes are followed
- Process access requests and support compliance with platform policies
Benefits
- Toast to your health: Fully paid health coverage for you and your family, in many locations.
- Craft your calendar: Flexible location and schedule for most roles.
- Create space for you: Distributed by design workforce, plus generous number of vacation days each year.
- Embrace parenthood: Minimum of 16 weeks of parental leave, plus generous family formation benefits.
- Give back your time: 40 hours each year to use toward volunteering with organizations and causes you’re passionate about.
- Amplify your impact: Double your charitable giving — we match donations up to $1500 USD (or local currency equivalent).
- Proficient in programming languages, particularly Bash, Python, and SQL
- Experience with Spark, Flink, Kafka, and dbt Labs for data processing and transformation
- Skilled in using Terraform for infrastructure-as-code deployments
- Bonus: Proven experience with data security and access controls for SOX Compliant data
- Knowledge of database systems, including OLAP, OLTP, Document, and Vector databases
- 8+ years of experience in data engineering or related roles
- Bonus: Experience and knowledge of the Elastic stack
- Experience with Apache Airflow for orchestrating data workflows
- Experience with Google Cloud Platform (GCP) for cloud resource management
- Understanding of Apache Iceberg for data table formats and data warehouse and lakehouse strategies
Skills
Sign in to read and join the discussion.