Senior Software Engineer

Working at AtlassianAtlassians can choose where they work whether in an office, from home, or a combination of the two. That way, Atlassians have more control over supporting their family, personal goals, and other priorities. We can hire people in any country where we have a legal entity.About the Central AI OrgOur organization is dedicated to driving AI innovation across all Atlassian products and platforms. We aim to deliver seamless AI experiences while establishing a robust Atlassian AI infrastructure for the future. Our purpose is to:Develop horizontal AI capabilities and infrastructure that can be leveraged across all products.Establish a centralized Search, Q&A, and Conversational AI system that integrates seamlessly with all Atlassian products.Explore integrating Atlassian products with AI solutions beyond the Atlassian ecosystem.About the AI & ML Platform TeamOur team's goal is to build the foundations to democratize AI and Machine Learning for Atlassian's teams, customers, and ecosystem. We aim to build productive, reliable tools that empower Atlassian teams to harness AI. These tools will facilitate the development, deployment, measurement, and operation of AI & ML models and experiences.About This RoleAs a Senior ML System Engineer on the AI & ML Platform's Inference team, you will design and optimize large-scale model serving systems end-to-end. You will own everything from distributed infrastructure (global KV cache, continuous batching, load balancing, auto-scaling) to deep low-level optimizations (GPU kernels, quantization, speculative decoding).In this role, you are expected to:Architect and implement scalable distributed infrastructure for model serving (load balancing, auto-scaling, batch scheduling, global KV cache).Optimize latency and throughput of model inference under real production workloads.Build reliable, high-concurrency serving systems that serve billions of requests reliablyBenchmark, fine-tune, and accelerate inferen