Principal Data Engineer
Posted Updated
Description
- Recorded Future combats cyber security threats by delivering actionable intelligence from our various Digital Risk Protection data streams. We are looking for a Principal Data Engineer to drive improvements in the Digital Risk Protection department
- Identify, scope, and own technical solutions necessary to achieve data convergence across Digital Risk Protection systems and data streams
- Mentor direct reports to bring out the best in all members of the team
- Work with the Malicious Sites, Identity, and Surface Web teams to align, analyze, and ingest digital risk data streams into Digital Risk Protection systems and the Intelligence Graph
- Develop, productize, monitor, and maintain DRP-focused data pipelines to analyze and ingest data at scale
- Build tools and APIs to facilitate access to data and analytics developed from Digital Risk Protection systems and the Intelligence Graph
- Analyze and explain patterns in digital risk data to drive business-critical decisions
- Create technical project plans and drive the successful execution of DRP initiatives, with input from our Product team and other developers on your team
Benefits
- Competitive compensation
- Retirement plans
- Great health benefits for employees and their families
- Company paid life and income protection
- Structured professional development and career advancement programs
- Generous paid time off
- Parental leave
- Wellness programs
- Hybrid work and flexible schedules
- Architecting and delivering production-grade applications and ETL/ELT pipelines
- Leadership experience
- 5+ years of Python programming
- Efficient & accurate problem solving skills, including the ability to debug both software and data
- Excellent written & verbal communication when collaborating with colleagues across various locations and timezones, designing technical approaches, and writing documentation
- Bachelor’s/Master’s degree in Computer Science, Mathematics, Statistics, Engineering, or equivalent experience
- Applying statistical techniques to draw accurate, impactful conclusions
- Message buses (e.g. Kafka, RabbitMQ), MongoDB, graph databases like AWS Neptune/Neo4j, cloud computing tools, and ElasticSearch
- AI approaches and productizing flagship LLM output
- 3+ years of experience with
- Developing REST APIs with Python frameworks (e.g. Flask, Django, FastAPI)
- Ability to present information to stakeholders with varying levels of technical expertise
- Experience engaging with technical leaders across geographies and divisions/companies
- Excellent attention to detail & ability to work independently while delivering high-quality results
- Proven success in architecting, leading, and delivering high-impact projects
- Eagerness to continue learning and teaching new skills to team members, in order to raise the bar across the team
- Preferred experience with orchestration tools such as Argo CD, Kubernetes, Prefect
Skills
Sign in to read and join the discussion.