Senior Data Platform Engineer

• We’re looking for innovative and driven people passionate about building the future of Enterprise Intelligence to join our growing team!
• Craft is looking for an experienced and motivated Senior Data Engineer to join our DISCoE team (aka our data platform team), which is the team responsible for defining and implementing standards for data storage in Databricks using a medallion architecture, defining patterns for interacting with our data, using automation methods to track and monitor all data, and creating tools for data operations. All to power our supplier risk management products and services
• The DISCoE team is growing and covering areas of the business that in the past were afterthoughts. DISCoE’s mission is to make our data a first class citizen of the business from sourcing and ingestion to structure and consumption
• Building and optimizing data pipelines (batch and streaming)
• Extracting, analyzing and modeling of rich and diverse datasets
• Designing software that is easily testable and maintainable
• Support in setting data strategies and our vision
• Keep track of emerging technologies and trends in the Data Engineering world, incorporating
• Modern tooling and best practices at Craft
• Work on extendable data processing systems that allows to add and scale pipelines
• Applying machine learning techniques such as anomaly detection, clustering, regression classification, summarization to extract value from our data sets

Benefits

• Unlimited PTO
• Parental Leave
• 99% Benefits Coverage
• 401k plan
• Hybrid Hub Strategy
• Flexible Work Hours

• Databricks & AWS (S3, Batch, Athena, RDS, DynamoDB, Glue, ECS)
• Self-starter, independent, likes to take initiative
• Knowledge of and experience with Amazon Web Services (AWS) and Databricks
• Shows curiosity through asking questions, digging into new technologies, and always trying to grow
• CircleCI, GitHub, Terraform
• Have fundamental knowledge of data engineering techniques: ETL/ELT, batch and streaming, DWH, Data Lakes, distributed processing
• 4+ years of experience with Python
• Experience in developing, maintaining, and ensuring the reliability, scalability, fault tolerance and observability of data pipelines in a production environment
• Kind and empathetic with your teammates and others
• Familiarity with at least some technologies in our current tech stack:
• Python, PySpark, Pandas, SQL (PostgreSQL), Airflow, Docker
• Familiar with infrastructure-as-code approach
• 4+ years of experience in Data Engineering
• Strong problem solving and the ability to communicate ideas effectively
• Don’t meet every requirement? Studies have shown that women, communities of color and historically underrepresented talent are less likely to apply to jobs unless they meet every single qualification. At Craft, we are dedicated to building a diverse, inclusive and authentic workplace, so if you’re excited about this role but your past experience doesn’t align perfectly with every qualification in the job description, we strongly encourage you to apply. You may be just the right candidate for this or other roles!