Data Engineer
Posted Updated
Description
You will collect, process, and transform large-scale data from public blockchains. You will design and operate reliable data pipelines, Data Warehouse and Data Mart structures, and automated data-processing workflows. You will also develop batch and real-time data services, integrate backend systems when needed, and explore new blockchain-data use cases through proofs of concept.
Responsibilities
- Collect and transform data from multiple public blockchains and design Data Warehouse and Data Mart tables.
- Develop and operate data pipelines for reliable large-scale blockchain data processing.
- Process real-time blockchain data using big-data platforms and distributed-processing technologies and build Data Warehouses.
- Design efficient Data Warehouse structures for data analysis and use.
- Automate data-processing and operational processes to build a stable data environment.
- Discover, develop, and operate batch and real-time data services.
- Develop backend functionality and integrate related systems needed to provide data services.
Requirements
- At least 3 years of practical experience as a Data Engineer or in a related field.
- Understanding of data-pipeline architecture and processing flows.
- Ability to design and develop data applications.
- Ability to investigate technology principles and internal architecture in depth.
- Ability to diagnose failures or performance issues using logs, metrics, and execution plans and propose practical solutions across applications and infrastructure.
