Data Operations Engineer – Linux / SQL/GIT
Description
Industry: Banking
Location: hybrid - 3 days per week form Warsaw, Gdańsk or Gdynia
Rate: 105 pln/h on b2b
Overview
This position is for an operations consultant responsible for ingesting data onto Hadoop using the ARC Ingestion Framework. The ideal candidate will possess experience in an agile environment and proficiency in Linux, SQL, and git. The role requires expertise in preparing and testing configurations for data ingestion as well as maintaining existing data sources in production.
Main Responsibilities
Ingest data onto Hadoop using the ARC Ingestion Framework.
Prepare and test configurations for data ingestion sources.
Maintain and monitor sources already ingested into production.
Collaborate with cross-functional teams.
Ensure high-quality standards in data processing.
Utilize troubleshooting skills to resolve issues.
Document processes and configurations.
Key Requirements
Proficiency in Unix / Linux.
Strong SQL skills.
Experience with git.
Familiarity with Jenkins.
Demonstrated rational thinking and problem-solving abilities.
Strong troubleshooting skills.
Nice to Have
Experience with testing frameworks.
Familiarity with Hadoop.
Knowledge of Robot Framework.
Experience with JIRA, Confluence, and Helix.
Basic understanding of Python.