# Senior Software Engineer - Together Cloud Platform at Together AI > United States · Senior · Software engineering · open. Source: https://alderhq.app/jobs/greenhouse%3Atogetherai%3A4753072007 (read 2026-11-04). ## Facts (observed) - Company: [Together AI](https://alderhq.app/companies/together-ai) - Location text: San Francisco; San Francisco - Where it can be done from (inferred): United States (evidence: "Location: San Francisco; San Francisco") - Posted: 2025-06-04 (518 days ago) - First seen by alder: 2026-11-02 · last verified: 2026-11-04 - Reposted: 0 times · edited: 1 times - Apply on the employer's site: https://job-boards.greenhouse.io/togetherai/jobs/4753072007 - Skills listed (inferred): Go, PostgreSQL, Kafka, AWS, GCP, Azure, Kubernetes, Docker, Airflow, LLMs, Distributed systems ## Pay and sponsorship - Posted pay: $160k–$230k per year (from the description) - Market band for similar posted roles (SF Bay Area, n 901): p25 $183k, median $205k, p75 $229k ## Description (the employer's text) ### About the Role Together AI is building the AI Acceleration Cloud, an end-to-end platform for the full generative AI lifecycle, combining the fastest LLM inference engine with state-of-the-art AI cloud infrastructure. As a Senior Backend Engineer, you will play a key role in building the next generation AI cloud platform – a highly available, global, blazing-fast cloud infrastructure that virtualizes cutting-edge ML hardware (GB200s/GB300s, BlueField DPUs) and enables state-of-the-art ML practitioners with self-serve AI cloud services, such as on-demand + managed Kubernetes and Slurm clusters. This platform serves both our internal StaaS products (inference, fine-tuning) and our external cloud customers, spanning dozens of data centers across the world. Some of what you’ll work on: - Work on a distributed GPU scheduling system for the on-demand clusters product, Instant Clusters. - Build out a global management plane for managing our data center compute, networking, and storage. - Design and build new customer-facing cloud platform services, delivering killer enterprise AI cloud features. ### Responsibilities - Identify, design, and develop foundational backend services that power Together’s cloud platform - Analyze and improve the robustness and scalability of existing distributed systems, APIs, databases, and infrastructure - Partner with product teams to understand functional requirements and deliver solutions that meet business needs - Write clear, well-tested, and maintainable software and IaC for both new and existing systems - Conduct design and code reviews, create developer documentation, and develop testing strategies for robustness and fault tolerance - Participate in an on-call rotation to address critical incidents when necessary ### Requirements - 5+ years of demonstrated experience in building large scale, fault tolerant, distributed systems and API microservices - Experience designing, analyzing and improving efficiency, scalability, and stability of various system resources - Excellent communication skills – able to write clear design docs and work effectively with both technical and non-technical team members - Demonstrated experience with building and operating high-performance and/or globally distributed microservice architectures across one or more cloud providers (AWS, Azure, GCP) - Strong systems knowledge across compute, networking, and storage, including concurrency, memory management, performant I/O, and scale - Experience developing against and managing a relational database, such as PostgreSQL - Expert-level programmer in one or more of programming language (Golang preferred) - Proficiency in version control practices and integrating IaC with CI/CD pipelines. - Experience with Kubernetes and containers preferred - Experience building and operating data infrastructure (Kinesis, Airflow, Kafka, etc) a plus - Bachelor’s or Master’s degree in Computer Science, Computer Engineering, or a related technical field, or equivalent practical experience ### About Together AI Together AI, the AI Native Cloud, is purpose-built for AI engineers. AI application developers get high-performance inference that scales reliably, fine-tuning and reinforcement learning for creating frontier-level specialized models, and pre-training at massive scale for fully custom intelligence, all around a marketplace of leading open models that teams can run, adapt, and own. Trusted by Cursor, Decagon, ElevenLabs, Salesforce, and Zoom, Together serves 400+ trillion tokens a month. ### Compensation We offer competitive compensation, startup equity, health insurance, and other benefits, as well as flexibility in terms of remote work. The US base salary range for this full-time position is: $160,000 - $230,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge. ### Application Policy Please read each role carefully and apply to the position best suited to you. Candidates are limited to 6 applications within a 90-day period, and applications beyond that limit will be automatically rejected. You may apply to additional roles 90 days after your last application. --- Data: alder (https://alderhq.app). Cite https://alderhq.app/jobs/greenhouse%3Atogetherai%3A4753072007 and the date you read it. Observed facts come from the employer's own listing; location reach, level, family and skills are inferences.