Data Platform ProdOps Engineer
Posted Updated
Description
# Data Engineer - Production Operations
## Company Overview
*Information regarding the company overview is not provided.*
## Job Summary
The Data Engineer - Production Operations role focuses on developing and maintaining various streaming jobs and services. The position plays a critical role in ensuring efficient data flow and processing, contributing to the overall effectiveness of data operations within the organization.
## Responsibilities
- Develop and maintain data streaming jobs using frameworks such as Apache Kafka and Apache Flink.
- Collaborate with cross-functional teams to understand and fulfill data-related requirements.
- Implement and manage big data solutions to support organizational data needs.
- Optimize existing data pipelines for performance and reliability.
- Troubleshoot and resolve issues in streaming services and data infrastructure.
- Ensure documentation of data architecture and compliance with best practices.
## Qualifications
- Proficient in at least one or two programming languages, such as **Python**, **Java**, or **Scala**.
- Strong understanding of streaming technologies, particularly **Apache Kafka** and **Apache Flink**.
- Familiarity with big data technologies and frameworks.
- Educational qualifications: Bachelor’s or Master’s degree in Computer Science, Data Science, or a related field.
- Knowledge of data warehousing, ETL processes, and data modeling concepts.
- Problem-solving skills and ability to work with large datasets.
- Experience with cloud platforms (e.g., AWS, Google Cloud) is a plus.
## Preferred Skills
- Experience with containerization technologies (Docker, Kubernetes).
- Familiarity with machine learning frameworks and data science methodologies.
- Knowledge of real-time data processing and analytics.
## Experience
- Minimum of 3 to 5 years of relevant experience in data engineering or a related field.
## Environment
*Details regarding the work setting or location are not provided.*
## Salary
- Estimated salary for 3 years of experience is around **15 LPA** (Lakhs Per Annum).
- Estimated salary for 5 years of experience is around **20 LPA** (Lakhs Per Annum).
## Growth Opportunities
*Potential career advancement opportunities within the company are not specified.*
## Benefits
*Information about offered benefits is not provided.*
