Skip to content

Spectro Cloud

NewBe an early applicant

Senior Software Engineer

Posted Updated

Description

  • As a software engineer at Spectro Cloud, you will succeed by embracing adaptability, tackling complex challenges, and navigating dynamic environments with confidence
  • You can break down intricate problems into manageable steps, deliver value iteratively, and explain your work clearly to the people who depend on it
  • You take ownership of outcomes and see work through to production
  • Build and operate AI inference services in production, with engines such as vLLM, SGLang, or TensorRT-LLM
  • Bring new models into service, from first test to full rollout
  • Improve throughput, response time, and memory use across the stack
  • Find the root cause of performance and reliability issues, then fix them
  • Design benchmarks and release criteria for every model we ship
  • Set reliability targets and meet them in production
  • Scale inference across many GPUs and nodes
  • Run inference on modern GPU platforms, including the latest accelerators
  • Automate deployment and operations on Kubernetes
  • Write runbooks, tuning guides, and clear technical documentation
  • Experience with monitoring and observability tools
  • Experience improving the performance, reliability, and efficiency of production systems
  • Familiarity with AI-assisted development tools
  • Experience with distributed systems and multi-GPU workloads
  • Golang for backend services and APIs
  • Comfort in Linux environments and with common command line tools
  • Experience with model optimization, quantization, and acceleration
  • GPU scheduling in Kubernetes
  • Kubernetes certification such as CKA or CKAD
  • A working understanding of inference engines, including batching, caching, and memory management
  • Experience with cloud-native applications on AWS, Azure, or GCP
  • Hands-on experience running AI or LLM inference in production, with an engine such as vLLM or TensorRT-LLM
  • Strong Python and hands-on PyTorch
  • Understanding of high-speed networking and interconnects
  • Experience with automated testing
  • Clear written communication in English
  • Experience with modern GPU platforms, drivers, and monitoring tools
  • Working knowledge of Kubernetes
  • Experience designing benchmarks and release criteria
  • Bachelor’s degree in Computer Science or a related field
  • 4+ years of software development experience, or 2+ years with a Master’s degree
  • Our interview process for Engineering roles typically comprises three to four stages:
  • Initial screening interview
  • One or two technical interviews, including hands-on coding assessments
  • Final round to assess team fit and engage in detailed discussions
  • The majority of our interviews are conducted via Zoom. We recommend having a laptop with a reliable internet connection, and if possible, a functional camera for a more engaging experience

Skills

What Senior Software Engineering jobs ask for — and how much of it you have →
Apply

Apply to Senior Software Engineer at Spectro Cloud

Create a free account first, or go straight to the employer.

Free RoleWatch account

  • Get an email when new jobs match your search
  • Save jobs and track every application
  • See how well your CV matches each job

Already have one?

No account needed. Opens the employer's own site in a new tab.

See also

Software Engineering jobs by country — openings, pay and top skills →