Principal Software Engineer, AI Platforms

Role overview

Principal Software Engineer, AI Platforms at Arm

We are hiring a Principal Software Engineer for Arm's AI Platforms team in Bangalore.

We are looking for an exemplary practitioner whose code, technical decisions, and approach to difficult problems set the standard for the team.

Responsibilities

• You will help shape technical direction, build production software, and establish the engineering practices of a growing team.
• You will combine systems engineering depth with hands-on expertise in agentic AI across the software development lifecycle (SDLC), helping engineers embrace new methods and assess their effect on delivery and quality.
• Write critical code, review implementations, and rapid prototyping to test uncertain assumptions before committing to a design.
• Build and use agentic AI workflows across the SDLC.
• Help recruit staff and senior engineers, and develop their judgment through shared technical work.

Required qualifications

• Required skills and experience 12+ years building distributed software, cloud platforms, or production infrastructure, or equivalent experience demonstrated through the scope and impact of your work.
• However, your application and interview responses must reflect your own thinking, experience, and abilities.

Preferred qualifications and skills

• Preferred skills and experience Experience with AI inference infrastructure or model serving, including how workload and hardware choices affect latency, throughput, and resource use.

Employment details

• Within that framework, we empower groups/teams to determine their own hybrid working patterns, depending on the work and the team’s needs.
• Location: Bangalore [India]

Application details

• Discover how the 10x mindset shapes life at Arm: https://careers.arm.com/10x-mindset Use of AI in Your Application At Arm, we embrace the benefits AI can bring, including in recruitment.
• You may use AI to support your preparation, such as improving the clarity of written responses, practicing interview questions, or learning more about our industry.
• Recruitment Adjustments and Accommodations At Arm, we want to build extraordinary teams.
• Please email us about anything we can do to accommodate you during the recruitment process.
• Details of what this means for each role will be shared upon application.

About the employer

• Partner with Arm teams in the US and UK on architecture and shared interfaces.
• Our 10x Mindset At Arm, we believe progress happens when people are empowered to think bigger and push beyond what seems possible.
• If you plan to use AI-supported or assistive technologies as part of a reasonable adjustment, please contact accommodations@arm.com so we can support you.
• If you need an adjustment or an accommodation during the recruitment process, please email accommodations@arm.com .
• To note, by sending us the requested information, you consent to its use by Arm to arrange for appropriate accommodations.
• Hybrid Working Arm’s approach to hybrid working is designed to create a working environment that supports both high performance and personal wellbeing.
• Equal Opportunities Arm is an equal opportunity employer, committed to providing an environment of mutual respect where equal opportunities are available to all applicants and colleagues.
• We are a diverse organization of dedicated and innovative individuals, and don’t discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.

Additional role details

• Working with the Director of Engineering and technical leaders across Arm, you will take responsibility for significant platform capabilities and remain closely involved in their implementation.
• Responsibilities Define technical direction with engineering leadership.
• Assess platform needs, explore design options, and turn decisions into software the team can deliver and operate.
• Design and implement distributed platform services.
• Shape the engineering culture through daily practice.
• Help the team deliver frequent changes with clear ownership, useful design and code reviews, and verification appropriate to the software being built.
• Give agents useful project context, connect them to development tools, and establish feedback through tests and code review.
• Measure their effect on delivery speed and software quality.
• Keep current with developments in software engineering, AI development tools, and cloud systems.
• Evaluate promising approaches through hands-on experiments and adopt them when the results justify the change.
• Resolve difficult design and production problems involving concurrency, data consistency, performance, and failure recovery.
• Use what you learn to improve the architecture and the team's engineering practices.
• Support engineers in taking ownership of complete capabilities and working through unfamiliar problems.
• Make technical decisions understandable and establish clear ownership across teams.
• Strong programming skills in Go, C++, Rust, Python, or a comparable language.
• Experience designing service interfaces, working with concurrency and persistent data, and debugging complex failures.
• Experience building and operating software on Kubernetes and Linux, with an understanding of workload lifecycle, networking, resource management, and failure recovery.
• Hands-on expertise with agentic AI tools and harnesses for the SDLC.
• Experience configuring and extending workflows, assessing generated code, and verifying changes through automated checks and engineering review.
• A record of technical leadership grounded in your own engineering work, including mentoring experienced engineers, explaining design choices, and improving how a team develops software.
• Knowledge of inference performance and resource-efficiency considerations.
• Familiarity with frameworks such as PyTorch, Ray, vLLM, SGLang, TensorRT-LLM, or Dynamo or experience qualifying accelerators and tuning distributed workloads.
• Kubernetes controllers or operators, deployment systems, or software that manages releases across different compute environments.
• Developer productivity tools, build and test infrastructure for large scale distributed systems.
• Distributed tracing, observability, diagnostics, or data processing systems used to understand production behavior.
• In Return: We provide an opportunity to learn about the latest Arm architecture features, working closely with a highly skilled engineering team on ground-breaking technology!
• Our 10x mindset is about curiosity, ambition and creating impact that will be used by millions.
• We learn fast, prioritise collaboration and turn bold ideas into real technology.
• We look for people who are inspired by this way of working and want to grow in an environment where bold ideas are welcomed.
• We want to understand your authentic perspective, creativity, and approach to problem solving.
• As such, you may not use AI to complete assigned tasks as part of any assessments.
• All accommodation or adjustment requests will be treated with confidentiality, and information concerning these requests will only be disclosed as necessary to provide the accommodation.
• Although this is not an exhaustive list, examples of support include breaks between interviews, having documents read aloud, or office accessibility.
• We believe in bringing people together face to face to enable us to work at pace, whilst recognizing the value of flexibility.
• In some cases, the flexibility we can offer is limited by local legal, regulatory, tax, or other considerations, and where this is the case, we will collaborate with you to find the best solution.
• Please talk to us to find out more about what this could look like for you.