Hadoop Big Data Engineer-H

# Bigdata Admin ## Company Overview *Not specified.* ## Job Summary The **Bigdata Admin** is responsible for managing and maintaining big data solutions, specifically leveraging technologies such as Hadoop, HDFS, and various cloud platforms. This role entails ensuring optimal performance of data processing systems and supporting various data analytics projects within the organization. ## Responsibilities - Administer and manage **Hadoop** clusters, ensuring high availability and performance. - Monitor and maintain **HDFS**, **Hive**, and other big data components for optimal functionality. - Collaborate with teams to build **Elastic MapReduce (EMR)** clusters and manage **Spark** jobs. - Implement security protocols, including **Kerberos**, to safeguard data and operations. - Automate deployment processes using tools such as **Terraform**, **Jenkins**, and **GitHub**. - Facilitate data integration using tools such as **Sqoop**, **HBase**, and **Phoenix**, providing necessary support for data retrieval and processing. - Perform debugging and performance tuning of Hadoop jobs. ## Qualifications - **5+ years of experience** with Hadoop technologies (Hive, PySpark, etc.). - Strong programming experience in languages such as **Python**, **Java**, and **Scala**. - Good SQL expertise. - Experience of working on **Azure Cloud** (Azure SQL DB, ADLS Gen2, Azure Data Factory, etc.). - Good communication skills. - Ability to work independently in an **Agile Software Development Life Cycle (SDLC)** process. - Educational qualifications in Computer Science or related fields (BTech, BSc, etc.) are preferred. ## Preferred Skills - Experience with **Databricks**. - Familiarity with working with **NoSQL** databases. ## Experience - Minimum of **3-5 years** of experience in big data administration and related technologies. - Proven experience in managing Hadoop and cloud-based services. ## Environment *Not specified.* ## Salary *Not specified.* ## Growth Opportunities *Not specified.* ## Benefits *Not specified.*