Senior/Staff Engineer, Data Platform Development
Posted Updated
Description
You will design and develop internal Data Platform components, including a Data Governance center, data integration tools, job scheduling, and approval workflows. You will build and maintain scalable, highly available backend services and integrate with data warehouse, metadata, and job orchestration systems such as Airflow, Flink, and Spark. You will develop governance features like data lineage, data quality, and access control, write clean code and documentation, and support deployment, monitoring, and troubleshooting.
Responsibilities
- Design and develop internal Data Platform components, including Data Governance center, Data Integration tools, job scheduling, and approval workflows
- Build and maintain scalable backend services with high availability
- Integrate with Data Warehouse, metadata, and job orchestration systems (e.g., Airflow, Flink, Spark)
- Develop Data Governance features such as data lineage, data quality, and access control
- Write clean, maintainable code and technical documentation
- Support system deployment, monitoring, and troubleshooting
Requirements
- At least 6 years of experience in a Software Engineering or Data Engineering related field
- Proficient in Java, Spring Boot, MyBatis/JPA, and RESTful API design
- Solid experience with databases (MySQL, PostgreSQL) and distributed systems (Redis, Kafka)
- Experience in data platforms, metadata, or workflow systems is a strong plus
- Familiar with AWS or Alibaba cloud environments
- Strong problem-solving skills and ability to take ownership of system modules
- Good to have: prior experience in Data Platform development or Data Governance systems
Benefits
- L&D programs and education subsidy
- Team building programs and company events
- Wellness and meal allowances
- Comprehensive healthcare schemes for employees and dependants
Skills
Sign in to read and join the discussion.