Skip to content

Cohere

NewBe an early applicant

Software Engineer (ML Ops)

Posted Updated

Description

  • Internal Infrastructure builds the infrastructure and tools used to train, evaluate, and serve Cohere’s foundation models. You will work with AI researchers and ML engineers on stability, scalability, and observability. The work accelerates the models behind Cohere’s platform, North
  • You will own the developer platform researchers use to write, build, and debug training code: developer environments, container images, CI, and training instrumentation. The role includes a compensated 24x7 on-call rotation
  • Run secure developer environments that stay controlled and accelerate developer velocity as the research organization scales
  • Own container image build and CI/CD tooling
  • Instrument training code and build self-service tooling so researchers can see why a run failed and debug it themselves
  • Set infrastructure best practices through AI enablement, documentation, and office hours
  • Troubleshoot production failures and performance problems, and leave the system easier to operate than you found it
  • Build automation, infrastructure-as-code, and observability so the platform stays maintainable
  • We hire at more than one level. We set level based on the scope you’ve owned and how independently you drive work

Benefits

  • Six weeks’ paid vacation
  • Equity / stock options
  • RRSP, 401(k), and Pension Scheme contributions
  • Coverage for 100% of your insurance premiums across health, dental, vision, and travel
  • Additional coverage for accessing mental health providers/services
  • Six months of fully paid parental leave, including adoption and surrogacy
  • Financial support for egg freezing and IVF in Canada and the UK
  • A monthly fitness and wellness allowance
  • Globally dispersed company that supports a remote work culture
  • A $2,000 annual education benefit for professional development
  • A weekly stipend for meals when working remotely and catered lunch when working from one of our global offices
  • A monthly arts and culture allowance
  • A monthly quality time allowance
  • Have enough Linux and Kubernetes experience to debug production systems. Experience operating a GPU cluster is a plus
  • Have written software in Python or Go, and prefer extending a solid open-source project to rebuilding it
  • Make ML engineers or researchers faster without making the platform fragile
  • Have worked with researchers, ML engineers, or another team whose goals were not identical to yours
  • Run a developer platform in production, such as CI, image builds, developer environments, or internal tooling that many engineers depend on
  • If this does not line up exactly with your experience, we still encourage you to apply
  • Have found a bottleneck, proposed a fix, and driven it in a fast-moving environment

Skills

Apply

Apply to Software Engineer (ML Ops) at Cohere

Create a free account first, or go straight to the employer.

Free RoleWatch account

  • Get an email when new jobs match your search
  • Save jobs and track every application
  • See how well your CV matches each job

Already have one?

No account needed. Opens the employer's own site in a new tab.

See also

DevOps jobs by country — openings, pay and top skills →