Senior AWS Data Engineer
Posted Updated
Description
# Senior AWS Data Engineer
##
## Job Summary
We are seeking a highly skilled and experienced **Senior AWS Data Engineer** to join our remote team and lead the design, development, and optimization of scalable data infrastructure and pipelines. This role requires a deep understanding of data warehousing, ETL/ELT processes, cloud-native tools, and big data technologies, with a primary focus on **Amazon Web Services (AWS)**.
## Responsibilities
- **Lead the design** and implementation of scalable, high-performance data architectures to support analytics and reporting.
- **Develop and manage** robust ETL/ELT pipelines using AWS services such as **AWS Glue**, **Database Migration Service (DMS)**, **Amazon Redshift**, **Amazon S3**, and **AWS Lambda**.
- **Orchestrate workflows** using Apache Airflow and ensure timely data delivery and transformation.
- **Collaborate with stakeholders** to define data requirements, data models, and performance metrics.
- **Apply data warehousing best practices** and optimize queries, data models, and storage strategies for performance and cost-efficiency.
- **Ensure data quality** and integrity through thorough testing, validation, and monitoring.
- **Write clean, efficient code** using **Python**, **PySpark**, and **SQL** to process and analyze large datasets.
- **Implement infrastructure-as-code practices** using **Terraform**, and manage **Continuous Integration/Continuous Deployment (CI/CD)** pipelines for data engineering workflows.
- **Work closely with cross-functional teams** to support data-driven decision-making and application development.
## Qualifications
- Extensive experience in **data engineering** with a focus on AWS services.
- Proficiency in **ETL/ELT** processes and technologies.
- Strong knowledge of **data warehousing concepts** and best practices.
- Experience with big data technologies and cloud-native tools.
- Proficiency in programming languages such as **Python**, **PySpark**, and **SQL**.
- Familiarity with **Apache Airflow** for workflow orchestration.
- Knowledge of **Terraform** for infrastructure management.
- Excellent problem-solving and analytical skills.
- Effective communication skills to collaborate with various stakeholders.
## Preferred Skills
- Certifications in **AWS** or related data engineering fields would be advantageous.
- Experience with additional AWS services like **Redshift Spectrum**, **Amazon Athena**, or **Amazon EMR**.
- Familiarity with **data governance** and compliance standards.
## Experience
- A minimum of **5 years of experience** in data engineering or related field, with significant experience in AWS.
##
