DevOps Engineer — Azure Databricks
Description
We are looking for a DevOps Engineer with strong Azure and Databricks expertise to join a large-scale data platform project for a leading European energy company.
The role is focused on ensuring the reliable operation, deployment, and continuous improvement of a Databricks-based data quality platform used by multiple German distribution system operators.
What you’ll do
Platform Operations
Ensure stable and reliable operation of the Databricks-based platform.
Monitor data quality measurement runs and platform infrastructure.
Investigate and resolve failed runs as part of 2nd/3rd level support.
Perform root cause analysis and implement sustainable fixes.
Troubleshoot production issues and improve platform reliability.
CI/CD & Deployment
Maintain GitLab repositories and deployment workflows.
Build, maintain, and continuously improve CI/CD pipelines.
Automate deployment and operational processes.
Manage the lifecycle of data quality rules, including staging, release, and decommissioning.
Ensure controlled and reliable rollouts of new rules and platform features.
Azure & Databricks
Work with Azure-based data infrastructure and Databricks.
Support the integration of new data sources, including connectivity, access, and permissions.
Collaborate with data and platform teams on technical integration topics.
Contribute to improving the platform architecture and operational setup.
Documentation & Collaboration
Maintain technical and operational documentation.
Work closely with platform teams, including Data & AI teams.
Provide technical guidance on platform operations and integrations.
Help establish and improve operational processes, support procedures, and deployment standards.
Requirements
3+ years of experience in DevOps / Cloud Engineering.
Strong hands-on experience with Microsoft Azure.
Solid experience with Azure Databricks in production environments.
Strong understanding of CI/CD and deployment automation.
Hands-on experience with GitLab CI/CD or similar tools.
Experience with infrastructure and platform monitoring.
Strong troubleshooting and root cause analysis skills.
Experience supporting production data platforms or data engineering environments.
Good understanding of cloud security, access management, connectivity, and permissions.
Ability to work independently and collaborate with multiple technical teams.
Good technical documentation and communication skills.
English — Upper-Intermediate or higher.
Nice to have
Experience with SQL and data platforms.
Experience with Power BI.
Experience with enterprise data quality platforms.
Experience with Data Governance / Data Management environments.
Experience working with large enterprise organizations.
Knowledge of German is a plus.
What we offer
Fully remote work.
Long-term project with a large European enterprise.
Opportunity to work with Azure Databricks and modern data platform technologies.
Challenging environment focused on building reliable and scalable data operations.
Collaboration with experienced international engineering and data teams.
Hiring Process
Recruiter interview
Technical interview
Final client interview
Work format: Remote
Engagement: B2B / contractor
Location: Remote / EU only