Senior Software Engineer (AI Agent & Experience Team)
Posted Updated
Description
- The AI Agent & Experience team is Toast’s internal platform team for AI. We build the infrastructure, governance, and developer tooling that makes AI a reliable, scalable force multiplier across the entire product development lifecycle. Our products include the LLM Proxy, AI Key Management, Observability pipelines, the Claude Plugin Marketplace, and autonomous agents that participate directly in the software development lifecycle
- As a Senior Software Engineer on this team, you’ll be hands-on building the systems that other Toast engineers depend on every day: the LLM proxy, agentic workflows, and the plugin marketplace that brings AI-native development practices to teams across the company
- Design, build, and ship features across AI platform infrastructure, including the LLM proxy, AI key management, and observability pipelines
- Develop and extend autonomous agents that participate in the SDLC, such as the AI Review GitHub App and Developer Platform MCP integrations
- Build on and contribute to the internal plugin marketplace, developing plugins that encode Toast’s architectural standards and quality practices into AI assistant behavior
- Implement MCP (Model Context Protocol) services and service templates that make it faster and easier for teams across Toast to build AI-powered workflows
- Write high-quality, well-tested code and participate in design and code reviews
- Collaborate with engineers, product managers, and platform teams to understand developer needs and translate them into reliable platform solutions
- Contribute to the team’s adoption of agentic development practices and tooling
- Leverage cutting edge AI tools to enhance your development workflow, improve velocity, and help pioneer new approaches to building - contributing to a culture of innovation and productivity across the team
Benefits
- Peer and company recognition programs
- Unlimited Vacation
- Sabbatical opportunity after five years
- Professional Development Reimbursement Program
- Commitment to Employee Wellness through resources such as a quarterly Wellness Stipend
- Various peer and company recognition programs
- 401(k) and matching
- Medical, Dental, & Vision Coverage
- Mental Health Benefits
- Subsidized backup childcare
- Working knowledge of prompt engineering and how LLM behavior responds to context and instructions
- Strong customer empathy and a drive to make developers’ lives better through reliable, well-designed platform solutions
- Strong foundation in Java, Kotlin, or another object-oriented language
- Demonstrated experience building, deploying, or operating LLM-powered agents or AI-assisted developer tooling
- Bachelor’s Degree with relevant experience of 5+ years in designing and implementing scalable backend services
- Familiarity with AI coding assistants (e.g., Claude Code, Cursor, GitHub Copilot) and an interest in extending them through custom plugins, skills, or hooks
- Experience with distributed systems, REST APIs, and cloud-native infrastructure
- Experience with MCP (Model Context Protocol), tool use patterns, or similar agentic integration frameworks
- Familiarity with A2A (Agent-to-Agent) protocols and multi-agent orchestration patterns
- Experience with machine learning concepts, model evaluation, or ML infrastructure
- Experience building developer experience platforms, internal tooling, or API gateways
- Familiarity with observability tooling for AI/LLM systems (e.g., Langfuse, DataDog)
