Senior Software Engineer (Big Data & Java)
Posted Updated
Description
- Identify, prioritize and execute tasks in the software development life cycle
- Work with business to iterate over software requirements
- Develop tools and applications by producing clean, efficient code
- Automate tasks through appropriate tools and scripting
- Analyze and debug systems
- Perform validation and verification testing in a test-driven manner
- Review the work of others, and invite others to review your work
- Collaborate with internal teams and vendors to fix and improve products
- Ensure software is up-to-date with latest technologies
- Work with distributed computing systems like Apache Hudi and Trino for big data processing
- Familiarity with Hadoop, Spark, Databricks or other distributed computing systems
- Experience with distributed computing tools like Apache Hudi, Spark, Kafka, Flink, Beam, Trino, DataBricks and other big data technologies
- Self-starter with the ability to deliver with minimal supervision
- Proficient in GIT
- Analytical mind with problem-solving aptitude
- Knowledge of distributed computing principles and how they apply to large-scale data processing
- Bein okay with the uncomfortable feeling that comes from learning new things
- Experience with distributed storage systems like ADLS, HDFS, S3, DLT etc
- Experience using system and performance monitoring tools (e.g. New Relic, DataDog)
- Team player
- Solid experience writing RESTful API endpoints
- Understanding of data partitioning and sharding techniques
- Knowledge of relational databases (e.g. Microsoft SQL Server, MySQL)
- Proven experience as a great Engineer
- Absolutely love TDD and have working knowledge of it
- Experience in writing clean code that performs well at scale using languages such as Python, Java etc
- Excellent organization, critical-thinking and personal leadership skills
- BSc/BA in Computer Science or a related degree
- Experience with distributed computing
- Experience writing code/scripts in Python
- Experience with Ansible
- Experience with Spring Boot
- Experience with Jenkins CI/CD pipeline
- Nice to have React, Selenium automation and cloud experience
- Experience with Docker, Kubernetes and Istio
- Linux and IP networking knowledge
- Experience with AWS/Azure cloud services or equivalent
- Experience with SAML, OAuth and OpenID Connect
- Experience working on a SaaS product
- Experience with Service Oriented Architecture
- Knowledge of scripting languages such as Python, Bash or Groovy
- On-call experience with production grade systems
- Generative AI Code Assistants - Use of Generative AI Code Assistants (e.g. Github Copilot) and knowledge of latest Generative AI Model capabilities would be an asset
- Has mentored others in a professional setting
Skills
- AI
- Ansible
- API
- Automation
- AWS
- Azure
- Bash
- Big Data
- CI/CD
- Cloud
- Databricks
- Datadog
- Distributed Computing
- Docker
- Flink
- Generative AI
- Git
- GitHub
- Github Copilot
- Groovy
- Hadoop
- Istio
- Java
- Jenkins
- Kafka
- Kubernetes
- Linux
- MySQL
- Networking
- New Relic
- OAuth
- OpenID
- Python
- RDBMS
- React
- REST
- S3
- SaaS
- SAML
- Selenium
- Spark
- Spring
- SQL
- SQL Server
- TDD
- Trino