Software Engineer - Storage & Observability (Early Career)

<h3><span style="font-family: helvetica, arial, sans-serif;"><strong>About the Role</strong></span></h3> <p><span style="font-family: helvetica, arial, sans-serif;">Together AI is building the <strong>AI Acceleration Cloud</strong>, an end-to-end platform for the full generative AI lifecycle. Our AI Infrastructure team is at the forefront of scaling the foundational systems that power this platform. We are looking for an Early Career Software Engineer to join our <strong>Storage and Observability team</strong>, where you will help design and maintain robust distributed storage solutions and develop comprehensive observability platforms.</span></p> <p><span style="font-family: helvetica, arial, sans-serif;">In this role, you will work on the systems that provide critical insights into GPU utilization and system performance, ensuring seamless data access for the world's largest AI training and inference workloads.</span></p> <h3><span style="font-family: helvetica, arial, sans-serif;"><strong>Responsibilities</strong></span></h3> <ul> <li style="font-family: helvetica, arial, sans-serif;"><span style="font-family: helvetica, arial, sans-serif;">Build and deploy scalable observability tools (metrics, logs, traces) using the latest state of the art open source distributed telemetry, log search and tracing systems</span></li> <li style="font-family: helvetica, arial, sans-serif;"><span style="font-family: helvetica, arial, sans-serif;">Develop and implement infrastructure-as-code for stack deployment using Terraform, Ansible, and Helm</span></li> <li style="font-family: helvetica, arial, sans-serif;"><span style="font-family: helvetica, arial, sans-serif;">Write clean, production-grade code in <strong>Go or Python</strong> to create custom K8S operators, tools and automation</span></li> <li style="font-family: helvetica, arial, sans-serif;"><span style="font-family: helvetica, arial, sans-serif;">Support the operation of high-performance distributed storage systems (such as <strong>Ceph, Weka/Vast</strong>) and Kubernetes-native storage operators</span></li> <li style="font-family: helvetica, arial, sans-serif;"><span style="font-family: helvetica, arial, sans-serif;">Optimize storage systems for GPU clusters (10-50 GB/s per-node throughput) and scale storage infrastructure to support thousands of nodes</span></li> <li style="font-family: helvetica, arial, sans-serif;"><span style="font-family: helvetica, arial, sans-serif;">Partner with senior engineers to enhance distributed tracing and optimize data paths for AI workloads</span></li> </ul> <h3><span style="font-family: helvetica, arial, sans-serif;"><strong>Minimum Qualifications</strong></span></h3> <ul> <li style="font-family: helvetica, arial, sans-serif;"><span style="font-family: helvetica, arial, sans-serif;"><strong>Experience:</strong> 1–3 years of professional experience in Software Engineering or Cloud Operations with hyper scalers</span></li> <li style="font-family: helvetica, arial, sans-serif;"><span style="font-family: helvetica, arial, sans-serif;"><strong>Cloud &amp; Containers:</strong> Solid understanding of Docker and Kubernetes orchestration, as well as experience with cloud platforms like AWS, GCP, or Azure</span></li> <li style="font-family: helvetica, arial, sans-serif;"><span style="font-family: helvetica, arial, sans-serif;"><strong>Tooling:</strong> Familiarity with infrastructure-as-code (Terraform or Helm) and version control (Git)</span></li> <li style="font-family: helvetica, arial, sans-serif;"><span style="font-family: helvetica, arial, sans-serif;"><strong>Observability Fundamentals:</strong> Experience using Prometheus and Grafana for system monitoring</span></li> <li style="font-family: helvetica, arial, sans-serif;"><span style="font-family: helvetica, arial, sans-serif;"><strong>Storage Systems: </strong>Experience with distributed storage systems, like WekaFS, Vast, Ceph, MinIO, GPFS, Luster etc</span></li> <li style="font-family: helvetica, arial, sans-serif;"><span style="font-family: helvetica, arial, sans-serif;"><strong>Problem Solving:</strong> Strong debugging skills and a passion for automation and operational excellence</span></li> </ul> <h3><span style="font-family: helvetica, arial, sans-serif;"><strong>Preferred Qualifications&nbsp;</strong></span></h3> <ul> <li style="font-family: helvetica, arial, sans-serif;"><span style="font-family: helvetica, arial, sans-serif;">Experience monitoring AI/ML infrastructure, GPU clusters, and custom metrics for model performance and training pipelines</span></li> <li style="font-family: helvetica, arial, sans-serif;"><span style="font-family: helvetica, arial, sans-serif;">Background in high-frequency, low-latency systems monitoring, chaos engineering, and reliability testing</span></li> <li style="font-family: helvetica, arial, sans-serif;"><span style="font-family: helvetica, arial, sans-serif;">Contributions to open-source projects, preferably in the space of observability or storage</span></li> <li style="font-family: helvetica, arial, sans-serif;"><span style="font-family: helvetica, arial, sans-serif;">Familiarity with security monitoring and compliance frameworks</span></li> </ul> <h3><span style="font-family: helvetica, arial, sans-serif;"><strong>About Together AI</strong></span></h3> <p><span style="font-family: helvetica, arial, sans-serif;">Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers in our journey in building the next generation AI infrastructure.</span></p> <h3><span style="font-family: helvetica, arial, sans-serif;"><strong>Compensation</strong></span></h3> <p><span style="font-family: helvetica, arial, sans-serif;">We offer competitive compensation, startup equity, health insurance, and other benefits, as well as flexibility in terms of remote work. The US base salary range for this full-time position is: $165,000 - $200,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.</span></p> <h3><span style="font-family: helvetica, arial, sans-serif;"><strong>Equal Opportunity</strong></span></h3> <p><span style="font-family: helvetica, arial, sans-serif;">Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.</span></p> <p><span style="font-family: helvetica, arial, sans-serif;">Please see our privacy policy at<a href="https://www.together.ai/privacy"> https://www.together.ai/privacy</a>&nbsp;&nbsp;</span></p>