Big Data Engineer

# Big Data PySpark Developer ## Job Summary We are seeking a **Big Data PySpark Developer** with a minimum of **5 years of experience** to effectively manage and analyze large datasets using PySpark across **Pan India**. The candidate will play a crucial role in implementing big data solutions that help transform raw data into actionable insights, directly contributing to the organization’s goals. ## Responsibilities - Develop and execute data processing solutions using PySpark. - Collaborate with data engineers and analysts to optimize data pipelines and workflows. - Design, implement, and maintain large-scale data processing systems. - Troubleshoot and resolve issues related to data processing and software performance. - Ensure data quality and availability through effective monitoring and maintenance. - Prepare and present analytical reports to stakeholders, aiding in decision-making processes. ## Qualifications - Strong experience with **Big Data technologies**, specifically **PySpark**. - Proficient in **SQL** and familiarity with data warehousing concepts. - Knowledge of **Hadoop ecosystem** components such as HDFS, MapReduce, and Spark. - Understanding of data modeling and ETL best practices. - Ability to work in a fast-paced, agile environment. - Strong problem-solving and analytical skills. - Excellent communication and teamwork abilities. - Bachelor’s degree in Computer Science, Information Technology, or related field. ## Preferred Skills - Experience with cloud platforms like **AWS** or **Azure**. - Familiarity with machine learning libraries and frameworks. - Knowledge of scripting languages such as **Python** or **Scala**. - Previous experience in data visualization tools like **Tableau** or **Power BI**. ## Experience - Minimum of **5 years** of relevant experience in Big Data technologies with a strong focus on PySpark.