Staff Engineer (Data Infrastructure Services)
Posted Updated
Description
- The Data Platforms Team serves as the experts on data ingestion, data flow and retrieval for CoreWeave
- This team is responsible for the development of use cases, discovery of innovative solutions, automation and operations of our data platform infrastructure
- We are seeking a Staff engineer with specialization in data platforms and stream processing who can help us fulfill the goal of our multi-regional datastore strategy and establish communication models for our data flow
- This individual will work with a team of 6-8 mixed skill engineers and have the opportunity to work on a full range of rewarding challenges that come with building in a communicative, supportive, and high-performing environment
- Drive technical decision-making to accelerate delivery, mentor engineers, and grow team capability
- Champion event-driven architecture adoption and build consensus across the organization
- Identify and develop applications for the organization’s data. This involves understanding business needs and creating solutions that leverage data effectively
- Design and implement the platform to deliver data to teams with a focus on providing managed solutions
- Develop a stream processing architecture and solve for scalability and reliability
- Improve the performance, security, reliability, and scalability of our data platforms, and related services and participate in the teams on-call rotation
- Establish guidelines, guard rails for data access and storage for stakeholder teams
- Ensure compliance with standards for data protection regulation
- Grow, change, invest in your teammates, be invested-in, share your ideas, listen to others, be curious, have fun, and, above all, be yourself
- You’re excited to have the opportunity to contribute to a Kubernetes operator in order to manage data systems
- You’re familiar with distributed NewSQL datastores such as CockroachDB, TiDB, YDB, Yugabyte and/or stream processing tools such as NATS or Kafka
- You have 15+ years of experience in a software or infrastructure engineering industry
- Wondering if you’re a good fit? We believe in investing in our people, and value candidates who can bring their own diversified experiences to our teams – even if you aren’t a 100% skill or experience match. Here are some qualities we’ve found compatible with our team. If a portion of this resonates with you, we’d love to talk
- You have experience with designing and operating these systems at scale
- You’re familiar with Kubernetes and have interest or experience with using it for event-driven and/or stateful orchestration
- You can transform problems in elastic solutions, decompose them into achievable tasks, and socialize both to your teammates
- You know your way around a Linux distro, shell scripting, and the Linux storage and networking stacks
- You understand data consistency and concurrency models, can clearly define data models and establish guidelines around data management
- You have production level proficiency in Go or Python and you’re interested in contributing to open source
Skills
Sign in to read and join the discussion.