Senior Software Engineer
Posted Updated
Description
- As a software engineer at Spectro Cloud, you will succeed by embracing adaptability, tackling complex challenges, and navigating dynamic environments with confidence
- You can break down intricate problems into manageable steps, deliver value iteratively, and explain your work clearly to the people who depend on it
- You take ownership of outcomes and see work through to production
- Build and operate AI inference services in production, with engines such as vLLM, SGLang, or TensorRT-LLM
- Bring new models into service, from first test to full rollout
- Improve throughput, response time, and memory use across the stack
- Find the root cause of performance and reliability issues, then fix them
- Design benchmarks and release criteria for every model we ship
- Set reliability targets and meet them in production
- Scale inference across many GPUs and nodes
- Run inference on modern GPU platforms, including the latest accelerators
- Automate deployment and operations on Kubernetes
- Write runbooks, tuning guides, and clear technical documentation
- Experience with monitoring and observability tools
- Experience improving the performance, reliability, and efficiency of production systems
- Familiarity with AI-assisted development tools
- Experience with distributed systems and multi-GPU workloads
- Golang for backend services and APIs
- Comfort in Linux environments and with common command line tools
- Experience with model optimization, quantization, and acceleration
- GPU scheduling in Kubernetes
- Kubernetes certification such as CKA or CKAD
- A working understanding of inference engines, including batching, caching, and memory management
- Experience with cloud-native applications on AWS, Azure, or GCP
- Hands-on experience running AI or LLM inference in production, with an engine such as vLLM or TensorRT-LLM
- Strong Python and hands-on PyTorch
- Understanding of high-speed networking and interconnects
- Experience with automated testing
- Clear written communication in English
- Experience with modern GPU platforms, drivers, and monitoring tools
- Working knowledge of Kubernetes
- Experience designing benchmarks and release criteria
- Bachelor’s degree in Computer Science or a related field
- 4+ years of software development experience, or 2+ years with a Master’s degree
- Our interview process for Engineering roles typically comprises three to four stages:
- Initial screening interview
- One or two technical interviews, including hands-on coding assessments
- Final round to assess team fit and engage in detailed discussions
- The majority of our interviews are conducted via Zoom. We recommend having a laptop with a reliable internet connection, and if possible, a functional camera for a more engaging experience
Skills
Sign in to read and join the discussion.