Skip to content

Boardroom Appointments

NewBe an early applicant

Data Engineer

Posted

Description

Key purpose:

As a Senior Data Engineer, you'll have the opportunity to work with our datacenter team on building and maintaining an operational data pipeline. You will be responsible for creating, testing, debugging and documenting infrastructure components as well as managing its performance. You should have experience in writing python code that interacts with databases such as MySQL or Postgres.

Duties and responsibilities:

  • Develops, tests and deploys information extraction, analysis and management solutions
  • Provides direct and responsive support for urgent analytical needs
  • Collaborates with the development team to address issues within the framework of the project requirements
  • Participates in architecture, design, testing and deployment of the applications
  • Uses coding languages, scripting methodologies and sophisticated tools to solve a problem with a custom workflow
  • Performs incremental testing actions on code, processes and deployments to identify ways to streamline execution and minimize errors Installs and maintains Spark, Apache Spark, Erlang, Spark cluster
  • Manages the day to day operations of a Spark environment from provisioning, maintenance and monitoring
  • Use Python for debugging and custom data mining

Qualifications and experience:

  • Bachelors degree in Computer Science or related field required
  • 8 years of experience in a technical role with an emphasis on data and algorithm development and implementation, server-side programming, database administration, web development and design
  • Knowledge of Databricks, SQL and Python preferred
  • 8 years of software development experience with a strong background in databases and data modeling
  • 5 years of experience designing and implementing high performance applications for cloud platforms such as AWS preferred
  • Core capability is on Databricks and Synapse

Skills

Apply

Apply to Data Engineer at Boardroom Appointments

Create a free account first, or go straight to the employer.

Free RoleWatch account

  • Get an email when new jobs match your search
  • Save jobs and track every application
  • See how well your CV matches each job

Already have one?

No account needed. Opens the employer's own site in a new tab.

See also

Data Engineering jobs by country — openings, pay and top skills →