Skip to content

CoreWeave

Software Engineer (Inference AI/ML)

Posted Updated

Description

  • Join the Inference team to ship production features that improve latency, reliability, and cost for model serving on our GPU platform. As an IC1, you’ll implement well-scoped changes, learn our operational practices, and grow quickly with mentorship from experienced engineers
  • Implement well-scoped features and fixes in Python/Go/C++ for model-serving services (e.g., Triton, vLLM, TensorRT-LLM, Ray Serve)
  • Write tests, code comments, and short design docs; participate in code reviews
  • Add basic metrics and dashboards; assist with alarms and runbooks
  • Follow on-call runbooks and learn incident response in a guided rotation
  • Contribute to performance experiments (e.g., request batching, concurrency, caching) with guidance
  • Foundations in data structures, algorithms, and networked services
  • BS/MS in CS, EE, or related field, or equivalent practical experience
  • Exposure to containers and Kubernetes (coursework or projects welcome)
  • Experience with Python or Go (C++ a plus) and Linux fundamentals; Git/CI basics
  • Curiosity about GPU inference concepts (micro-batching, KV cache, streaming)
  • Coursework/research with PyTorch or TensorFlow; simple CUDA projects a plus
  • Internship or project that deployed a microservice or ML inference demo
  • Familiarity with Grafana/Prometheus/OpenTelemetry or similar tooling

Skills

What Intern ML / AI jobs ask for — and how much of it you have →
Apply

Apply to Software Engineer (Inference AI/ML) at CoreWeave

Create a free account first, or go straight to the employer.

Free RoleWatch account

  • Get an email when new jobs match your search
  • Save jobs and track every application
  • See how well your CV matches each job

Already have one?

No account needed. Opens the employer's own site in a new tab.

See also

ML / AI jobs by country — openings, pay and top skills →