Senior Data Engineer
Posted Updated
Description
We are looking for a Senior Data Engineer to help drive the evolution of our Azure-based Data Platform and Lakehouse architecture .
This role is focused on Data Products development. The successful candidate will build pipelines in ADF, DAGs in Airflow and work closely with POs to refine business requirements and transform business needs into reliable Data Products in Databricks.
- 6+ years of experience in data engineering
- Python (PySpark)
- SQL (advanced level)
- Hands-on experience with Azure-based Data Platform including: Databricks ,Unity Catalog , Apache Airflow, Azure Data Factory, Reporting and BI tools (Power BI, Tableau or similar)
- Solid understanding of data modelling fundamentals, main architectures and design patterns
- Data Warehouse, Data Lake and Data Lakehouse architectures
- Medallion architecture
- Metadata-driven architecture
- ETL/ELT design patterns
- Understanding of Partitioning, optimization, and performance and batch and streaming pipelines
Skills
Sign in to read and join the discussion.