Data Engineer

# Data Engineer ## Company Overview *Company Overview details are not specified.* ## Job Summary The Data Engineer will be responsible for designing, building, and maintaining robust data pipelines and architectures. The role aims to facilitate the transformation and utilization of data to meet the organization’s analytical needs. ## Responsibilities - Develop and maintain scalable data models and ETL pipelines utilizing **PySpark** and **SQL**. - Optimize and troubleshoot existing data structures and workflows for performance improvements. - Collaborate with data scientists and analysts to understand data requirements and deliver solutions that meet those needs. - Ensure data quality and integrity throughout the data lifecycle. - Document data processes and workflows to maintain clarity and communication within the team. ## Qualifications - **Experience:** Minimum of 8 years in data engineering or related field. - **Technical Skills:** - Proficient in **PySpark** and **Apache Spark**. - Strong knowledge of **SQL** for interaction with databases. - Familiarity with data warehouse concepts and architectures. - Experience in cloud data solutions (e.g., AWS, Azure, Google Cloud). - **Soft Skills:** - Excellent problem-solving abilities. - Strong communication skills for effective collaboration with cross-functional teams. - **Educational Qualifications:** Relevant degree in Computer Science, Engineering, or a related field is preferred. ## Preferred Skills - Familiarity with machine learning concepts and tools. - Experience with data visualization tools. - Knowledge of programming languages like Python or Java. ## Experience A minimum of **8 years** of relevant experience in data engineering or related roles. ## Environment This position is **remote**, allowing for flexibility in work location. ## Salary The estimated budget for this position is **1.3 Lakh Per Month + GST**. ## Growth Opportunities *Growth opportunities within the company are not specified.* ## Benefits *Benefits offered by the company are not specified.* *Note: Candidates will need to provide documents such as Aadhar, PAN, educational documents, experience letters from previous companies, and LinkedIn ID after the first technical round.*