Senior Data Engineer
Description
Overview
TripleLift is seeking a Senior Data Engineer to join a small, influential Data Engineering team. This hire will be responsible for expanding and optimizing our data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. The Senior Data Engineer will support our software engineers, product managers, business intelligence analysts and data scientists on data initiatives, and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams, systems and products. The right candidate will be excited by the prospect of optimizing or even re-designing our company’s data architecture to support our next generation of products and data initiatives.
Responsibilities
- Create and maintain optimal data pipeline architecture,
- Explore and assemble large, complex data sets that meet functional / non-functional business requirements.
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
- Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Spark, EMR, Kafka and other big data technologies
- Work with stakeholders across different teams, including product managers, engineers and analysts to assist with data-related technical issues and support their data infrastructure needs.
Education & Requirements
- Bachelor’s degree in Computer Science, a related technical field, or equivalent professional experience.
- Minimum of 5 years of professional software engineering experience, with a strong focus on data and ML processes running in production at scale.
- Experience with optimizing big data and ML pipelines like Spark and Kafka at scale
- Fundamental knowledge of ML and AI operations and processes. Experience in MLFlow, Feast, Ray, and other AI training technologies a plus
- Understanding of a variety of database technologies such as OpenSearch, Druid, Clickhouse, InfluxDB, etc
- Proven track record of cross-functional data modeling
- Strong command of SQL and expertise in one or familiarity with multiple of the following languages: Python, Scala, Java
- Experience in containerization, K8s and ArgoCD is a plus
- Medical, Dental & Vision Plans
- Flexible PTO
- 401k w/ employer match
*Full-time employees are eligible for comprehensive benefits (subject to the terms of applicable plans/policies/agreements, which will be made available to you after commencing employment).
At TripleLift, we believe great work starts with great people. We foster a culture built on collaboration, curiosity, and a shared commitment to making each other better. We move with urgency, challenge convention, and continuously innovate to elevate digital advertising. We value people who bring new perspectives, take ownership, and work together to drive meaningful impact. Learn more about TripleLift and our culture on our LinkedIn Life page.
Please review our Privacy Policy for information about how TripleLift handles personal information.
TripleLift does not accept unsolicited resumes from recruitment search firms. Any resume submitted without a signed agreement in place will become the property of TripleLift, and no fee will be due.
Skills
As published by greenhouse · 14 questions
Basics
First Name, Last Name, Email, Phone, Resume/CV, Cover Letter
Short answers (2)
- LinkedIn Profile URL
- How did you hear about this position?
Pick from a list (12)
- TripleLift is unable to provide employment visa sponsorship now or in the future, including new sponsorships or transfers of existing sponsorships. Applicants must be authorized to work in the United States or Canada and able to maintain work authorization without current or future employer sponsorship. Do you currently have legal US or Canadian work authorization?
- Will you, now or in the future, require the support of TripleLift to maintain that authorization?
- Do you currently reside in New York City or Toronto?
- If you do not currently reside in NYC or Toronto, would you be willing to relocate?
- How many years of professional software or data engineering experience do you have?
- How many years of professional experience do you have building, maintaining, or optimizing data pipelines in a production environment?
- Have you used Apache Spark to build, optimize, or maintain production data pipelines at scale?
- Have you used Apache Kafka in a production environment for data ingestion, streaming, event processing, or data pipelines?
- Which of the following programming languages have you used professionally for data engineering or software engineering? Select all that apply.
- How would you describe your professional SQL experience?
- Which best describes your experience with data pipelines?
- Have you worked with data or ML pipelines running in production at significant scale?