Principal Software Engineer - Inference Cloud

Company: Akamai Technologies
Location: Elkins Park
Posted on: February 1, 2026

Job Description:

The Akamai Inference Cloud team is part of Akamais Cloud Technology Group. We design, implement, deploy and operate AI platforms that enable customers to run inference models and developers to create AI applications with unmatched performance, compliance, and economics. As a Principal Software Engineer, you will serve as a technical leader and architect for our globally distributed AI inference platform. You will drive critical technical decisions, establish architectural patterns, and guide the team in building a platform that delivers OpenAI-compatible endpoints while orchestrating inference workloads across regions at massive scale. As a Principal Software Engineer, you will be responsible for: • Providing thought leadership, drive architectural decisions, and mentor engineers while delivering hands-on technical contributions • Architecting and designing the core infrastructure of Akamai Inference Cloud, ensuring it is performant, compliant, economical, and explainable • Providing thought leadership on AI inference optimization, model serving architectures, and establishing technical standards for the platform • Making critical technical decisions on frameworks, tools, and approaches for AI workload deployment and global traffic orchestration • Contributing hands-on to critical path development, code reviews, and architectural implementations • Collaborating with cross-functional teams to define technical requirements and elevate team capabilities Do what you love To be successful in this role you will: • Have 12 years of relevant experience and a Bachelors degree or its equivalent • Have a deep expertise in AI inference optimization, model serving, and LLM deployment at scale • Provide thought leadership on AI inference optimization, model serving architectures, and establishing technical standards for the platform • Show expert-level proficiency with cloud-native technologies, Kubernetes, distributed systems, and architecting services at global scale with strict SLOs • Possess solid opinions and proven experience building AI platforms developers love, including API design and cost optimization for compute-intensive workloads • Demonstrate excellent technical leadership with ability to mentor engineers, influence architectural decisions, and communicate effectively across teams • Have experience with building platforms for AI application developers (RAG, agents, fine-tuning workflow) • Possess working knowledge of AI safety and practices, MLOps practices and AI model lifecycle management Work in a way that works for you FlexBase, Akamais Global Flexible Working Program, is based on the principles that are helping us create the best workplace in the world. When our colleagues said that flexible working was important to them, we listened. We also know flexible working is important to many of the incredible people considering joining Akamai. FlexBase, gives 95% of employees the choice to work from their home, their office, or both (in the country advertised). This permanent workplace flexibility program is consistent and fair globally, to help us find incredible talent, virtually anywhere. We are happy to discuss working options for this role and encourage you to speak with your recruiter in more detail when you apply.

Keywords: Akamai Technologies, Mount Vernon , Principal Software Engineer - Inference Cloud, IT / Software / Systems , Elkins Park, New York