AWS Data Engineer

# AWS Data Engineer ## Company Overview *Information not provided.* ## Job Summary The AWS Data Engineer will be responsible for designing and implementing data processing solutions using AWS and other cloud technologies. This role focuses on real-time data processing and will contribute to the organization’s data initiatives by enabling data accessibility and analytics capabilities at scale. ## Responsibilities - Design, develop, and maintain data pipelines and architectures for processing large datasets in real-time using Kafka and AWS. - Implement and manage data integration processes with Kafka Streams, Kafka Connect, and Schema Registry. - Collaborate with cross-functional teams to gather data requirements and ensure data quality and integrity. - Utilize Azure Databricks for data processing and analytics, ensuring best practices are followed. - Optimize data storage solutions using SQL and NoSQL databases while applying effective data modeling techniques. - Lead and mentor team members in data engineering projects and contribute to stakeholder communication and project management. ## Qualifications - **Experience**: 4+ years in data engineering with a strong proficiency in Python and Kafka. - **Technical Skills**: - Expertise in Kafka Streams, Kafka Connect, and Schema Registry for real-time data processing. - Strong knowledge of cloud platforms, with preference for Azure, and some experience with AWS or GCP. - Proficiency in SQL and NoSQL databases, with solid data modeling skills for big data applications. - Familiarity with containerization technologies such as Docker and Kubernetes as well as CI/CD pipelines. - **Soft Skills**: - Strong analytical and problem-solving skills. - Excellent communication and stakeholder management abilities. ## Preferred Skills - Experience working with healthcare data (EHR, claims, HL7, FHIR, etc.) is a plus. - Knowledge of Pyspark is good to have but not mandatory. ## Experience - Minimum of 8 years of experience as a data engineer, including specific experience with Python and Kafka. ## Environment - This role is fully remote, offering flexibility in work location. ## Salary *Information not provided.* ## Growth Opportunities *Information not provided.* ## Benefits *Information not provided.*