Skip to content

Multiverse Computing

NewBe an early applicant

Senior LLM Engineer

Posted Updated

Description

  • We are looking for a Senior LLM Engineer to join our Research team. You will work across the full model lifecycle: data, distributed training, post-training, compression, evaluation and efficient inference
  • Our past work includes compressing and healing open-weight models, post-training with SFT, RL and distillation, multimodal training, knowledge editing, and building our own family of models
  • Priorities change quickly in research, so we value strong fundamentals over narrow specialisation. When it makes sense, we publish papers and release models and code
  • Train and post-train LLMs and multimodal models on multi-node GPU clusters using SFT, preference optimisation, RL (e.g. GRPO), and on-policy and offline distillation
  • Design compression techniques (quantization, pruning, quantization-aware training, quantum-inspired tensor-network methods) and healing recipes that recover the quality of compressed models
  • Build RL environments, reward functions and verifiers for reasoning, coding and agentic tasks, and extend RL methods to world models and Physical AI
  • Research and prototype post-transformer and hybrid architectures (state-space models, linear attention, MoE), from small-scale ablations to scaling recipes
  • Build data pipelines for curation, filtering, deduplication and large-scale synthetic data generation
  • Design rigorous ablations and evaluations on current benchmark suites (reasoning, coding, long-context, instruction following, agentic) as well as internal evals
  • Port and optimise models for inference on various accelerators and edge chips, profiling latency, memory and throughput
  • Write up experiments and results as internal reports and, where relevant, papers and open-source releases
  • Review code, mentor teammates, and follow and bring in the latest research
  • Senior: 4+ years of hands-on experience training or post-training transformer models
  • Solid mathematical foundations in linear algebra, optimisation and probability, and an understanding of training dynamics
  • Experience with distributed training (FSDP, DeepSpeed or Megatron-LM; data, tensor, pipeline and expert parallelism) on multi-node clusters with Slurm/K8s
  • Good understanding of GPU fundamentals: memory hierarchy, mixed precision, profiling, throughput
  • Hands-on post-training experience: SFT, DPO, and at least one RL method (PPO, GRPO or similar)
  • Strong PyTorch. You are comfortable working below library level: model code, custom losses, parallelism configuration
  • Master’s or PhD in Computer Science, AI, Mathematics, Physics or a related field, or equivalent industry experience
  • Rigorous experimental practice: ablation design, reproducibility, experiment tracking, noise-aware evaluation
  • Strong debugging and communication skills. Fluent English
  • We don’t expect anyone to have all of these. Our research covers many areas and nobody on the team is an expert in all of them. If you have deep experience in some and none in others, we still want to hear from you
  • Multimodal model training (vision-language, audio)
  • Experience with the NVIDIA stack (Megatron-LM, Megatron Bridge, NeMo RL, NeMo Gym, NeMo Curator) or similar frameworks (verl, TRL, OpenRLHF)
  • RL infrastructure: rollout engines (vLLM, SGLang), asynchronous RL, reward model and verifier design, agentic environments
  • Post-transformer architectures: SSMs/Mamba, linear attention, hybrid models, diffusion LMs
  • Physical AI: vision-language-action models, world models (e.g. JEPA-style or video world models), robotics simulation
  • Model compression: post-training quantization and QAT (GPTQ, AWQ, FP8/FP4), pruning, distillation, low-rank or tensor-network methods
  • Inference on alternative hardware: ExecuTorch, llama.cpp, ONNX Runtime, OpenVINO, vendor NPU SDKs, custom kernels (Triton, CUDA)
  • Large-scale data processing and synthetic data generation
  • Evaluation tooling (lm-evaluation-harness, lighteval, NeMo Evaluator) and familiarity with Artificial Analysis
  • Publications at top venues (NeurIPS, ICML, ICLR, ACL, etc.), notable open-source contributions, or models released on Hugging Face
  • Fluency in Spanish

Skills

What Senior AI Engineering jobs ask for — and how much of it you have →
Apply

Apply to Senior LLM Engineer at Multiverse Computing

Create a free account first, or go straight to the employer.

Free RoleWatch account

  • Get an email when new jobs match your search
  • Save jobs and track every application
  • See how well your CV matches each job

Already have one?

No account needed. Opens the employer's own site in a new tab.

See also

AI Engineering jobs by country — openings, pay and top skills →