Skip to content

Cresta

Senior Machine Learning Engineer

Posted Updated

Description

  • Machine Learning Engineers at Cresta work across several high-impact AI initiatives. Final team placement is determined based on experience, strengths, and business needs
  • Current focus areas include:
  • Agentic Assist: Lead and build next-generation agentic AI systems that augment contact center agents in real time
  • This track requires strong pre-LLM ML foundations, deep expertise in LLMs and modern prompting techniques, a rapid prototyping mindset, and a proven ability to translate cutting-edge research into scalable, production-grade systems
  • Agent & System Quality: Design evaluation frameworks and improve the reliability, robustness, and performance of LLM-powered agents
  • This includes diagnosing and mitigating failure modes such as hallucinations, retrieval errors, tool misuse, context drift, prompt brittleness, and multi-step reasoning breakdowns, while defining measurable quality metrics (e.g., accuracy, faithfulness, task completion, latency, and cost) for complex, non-deterministic systems
  • Insights: Architect and scale LLM and retrieval-augmented generation pipelines that ground models in enterprise data. This track focuses on building high-performance ML systems that process complex data, extract structured insights, and deliver real-time, actionable intelligence at scale
  • You’ll lead the design and development of Cresta’s next-generation AI Agents and Agentic Assist systems, defining system architecture and core modeling approaches
  • Architect intelligent, multi-step agent workflows that combine real-time guidance, knowledge retrieval, reasoning, summarization, and automated actions into cohesive production systems
  • Design, deploy, and optimize LLM-powered systems, including Retrieval-Augmented Generation (RAG) pipelines, multi-agent orchestration, and domain-adapted models
  • Improve reasoning, planning, and tool-use capabilities in real-world AI applications
  • Develop evaluation strategies for complex, non-deterministic systems, including offline benchmarking, online experimentation, and LLM-as-a-judge methodologies
  • Diagnose and mitigate real-world failure modes such as hallucinations, retrieval errors, tool misuse, prompt brittleness, and multi-step reasoning breakdowns
  • Define and measure quality metrics (e.g., accuracy, faithfulness, task completion, latency, cost, robustness) to improve system reliability and performance
  • Optimize AI systems for scalability, latency, security, and cost efficiency in production environments
  • Collaborate cross-functionally with product, frontend, and backend teams to integrate AI capabilities seamlessly into Cresta’s platform
  • Mentor engineers, contribute to technical strategy, and help shape the roadmap for Cresta’s AI systems

Benefits

  • Weekly lunch & learn
  • Work with an A+ team of ex-Founders, world leading scientists, and nationally competitive athletes
  • Mentorship - A world class mentorship board advises and mentors our team-members to capture the opportunity ahead of us
  • Strong knowledge of modern ML frameworks and tools (e.g., PyTorch, TensorFlow, Hugging Face) and distributed/cloud-based infrastructure
  • Proven experience designing and deploying Retrieval-Augmented Generation (RAG) systems in enterprise environments
  • Experience building and evaluating complex agentic or multi-step LLM workflows
  • Strong expertise in NLP, Generative AI, transformer architectures, embeddings, and retrieval systems
  • Strong technical leadership skills, with the ability to influence cross-functional decisions and raise the engineering bar
  • Bachelor’s degree in Computer Science, Mathematics, or a related field; Master’s or Ph.D. preferred
  • Demonstrated ability to optimize real-time ML systems for performance, scalability, and reliability
  • 5–8+ years of industry experience building and deploying machine learning systems in production, including significant experience working with LLMs

Skills

What Senior ML / AI jobs ask for — and how much of it you have →
Apply

Apply to Senior Machine Learning Engineer at Cresta

Create a free account first, or go straight to the employer.

Free RoleWatch account

  • Get an email when new jobs match your search
  • Save jobs and track every application
  • See how well your CV matches each job

Already have one?

No account needed. Opens the employer's own site in a new tab.

See also

ML / AI jobs by country — openings, pay and top skills →