Skip to content

Together AI

Senior Software Engineer (Observability)

Posted Updated

Description

  • The AI Infrastructure team at Together AI is at the forefront of building and scaling the foundational systems that power our generative AI platform. The storage and observability team is crucial for designing, implementing, and maintaining robust distributed storage solutions, ensuring seamless data access and management. They are also responsible for developing comprehensive observability platforms, providing critical insights into system performance and GPU utilization, and proactively identifying and resolving issues
  • Identify, design, and develop foundational backend services that power Together’s cloud platform
  • Analyze and improve the robustness and scalability of existing distributed systems, APIs, databases, and infrastructure
  • Partner with product teams to understand functional requirements and deliver solutions that meet business needs
  • Write clear, well-tested, and maintainable software and IaC for both new and existing systems
  • Conduct design and code reviews, create developer documentation, and develop testing strategies for robustness and fault tolerance
  • Participate in an on-call rotation to address critical incidents when necessary

Benefits

  • Competitive health insurance plans
  • Pre-tax flexible spending accounts
  • Income protection & retirement
  • Dental and vision insurance
  • Mental health support and services
  • 401(k) plan
  • STD & LTD insurance
  • AD&D insurance
  • Life insurance
  • Team-driven celebrations and events
  • Monthly team lunches
  • Flexible time off policy
  • Monthly commuting stipend + pre-tax bene
  • Experience designing, analyzing and improving efficiency, scalability, and stability of various system resources
  • Demonstrated experience with building and operating high-performance and/or globally distributed microservice architectures across one or more cloud providers (AWS, Azure, GCP)
  • Excellent communication skills – able to write clear design docs and work effectively with both technical and non-technical team members
  • 5+ years of demonstrated experience in building large scale, fault tolerant, distributed systems and API microservices
  • Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more

Skills

What Senior Software Engineering jobs ask for — and how much of it you have →
Apply

Apply to Senior Software Engineer (Observability) at Together AI

Create a free account first, or go straight to the employer.

Free RoleWatch account

  • Get an email when new jobs match your search
  • Save jobs and track every application
  • See how well your CV matches each job

Already have one?

No account needed. Opens the employer's own site in a new tab.

See also

Software Engineering jobs by country — openings, pay and top skills →