Rust Jobs for Rustaceans

About the Role
Together AI is seeking a Rust Systems Engineer to join our Inference Engine team, focusing on optimizing and enhancing the performance of our AI inference systems. If you are passionate about developing high-performance systems, we want to hear from you. This position offers the chance to collaborate closely with AI researchers and engineers to create cutting-edge AI solutions. Join us in shaping the future at Together AI!

Requirements

• Demonstrated proficiency in Rust programming language and ecosystem
• Strong experience with Rust frameworks namely axum, tokio, jemalloc, serde, rayon, and/or crossbeam
• Deep understanding of concurrent programming and multiprocessing patterns
• Experience developing and optimizing orchestration and scheduling algorithms
• Knowledge of distributed systems principles and design
• Experience interfacing Rust services with RPC components
• Ability to optimize systems for performance, reliability, and resource efficiency
• Solid understanding of memory management and performance profiling.

Preferred Requirements

• Experience with one or more ML inference frameworks (HuggingFace TGI, NVIDIA Dynamo, Candle, Pixi, uv, llguidance)
• Background in designing and implementing high-throughput, low-latency systems
• Knowledge of disaggregated serving architectures and continuous batching algorithms for ML workloads
• Familiarity with ML/AI inference systems and performance optimization techniques
• Experience with system benchmarking and performance analysis

About Together AI
Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society. Together, we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI. Our team has been behind technological advancements such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers and engineers in our journey to build the next-generation AI infrastructure.