Sr. Product Manager, AI Infrastructure

Business Unit Cloud & Smart Industries Group (CSIG) is responsible for promoting the company's cloud and industry Internet strategy. CSIG explores the interactions between users and industries to create innovative solutions for smart industries via technological advancements such as cloud, AI, and network security. While driving the digitalization of retail, medical, education, transportation and other industries, CSIG helps companies serve users in smarter ways, building a new ecosystem of intelligent industries that connect users and businesses.

What the Role Entails

Product Strategy & Roadmap: Own the full lifecycle management of AI infrastructure platforms (including large-scale clusters, distributed systems, lifecycle management toolchains, and model service gateways); develop 3-5 year strategies and annual roadmaps that align business goals with technical excellence, balancing performance, cost, usability, and reliability.

Requirement Synthesis: Deeply analyze the core pain points of internal ML teams, data scientists, and enterprise clients; translate technical requirements into clear PRDs and technical specifications, leading products from 0→1 incubation to 1→N scaled iterations.

Cross-functional Collaboration: Partner with hardware architecture, heterogeneous systems, software engineering, algorithms, and SRE teams to drive product R&D and operations; resolve critical technical trade-offs during the development process.

Metric Framework: Establish a core performance indicator system (e.g., throughput, latency, compute resource utilization, cost efficiency, and developer satisfaction); leverage data to drive continuous product optimization.

Technical Foresight: Track cutting-edge advancements in AI Infrastructure (such as compiler optimization, cloud-native architectures, and large-scale model training/inference techniques) and industry trends to build differentiated competitive advantages.

GTM & Commercialization: Collaborate with GTM and sales teams to articulate product value propositions, technical whitepapers, and POC solutions to drive commercial success and client acquisition.

Who We Look For

Education: Master’s degree or higher in Computer Science, Electronic Engineering, Mathematics, or a related STEM field.

Professional Experience: Extensive experience in product management, with a focused track record in AI Infrastructure, cloud computing, distributed systems, or developer platforms.

Technical Proficiency: Familiar with the end-to-end model development lifecycle; understanding of compilation optimization, high-performance inference engines, and distributed training optimization techniques; product design experience in these areas is a strong plus.

Communication & Leadership: Exceptional cross-team communication and "influence without authority"; ability to drive project execution in ambiguous, fast-paced environments.

Preferred Qualifications: Experience in major cloud service providers or leading AI companies; active contributions to relevant open-source technical communities.

Location State(s)

US-California-Palo Alto

The expected base pay range for this position in the location(s) listed above is $113,900.00 to $213,800.00 per year. Actual pay may vary depending on job-related knowledge, skills, and experience. Employees hired for this position may be eligible for a sign on payment, relocation package, and restricted stock units, which will be evaluated on a case-by-case basis. Subject to the terms and conditions of the plans in effect, hired applicants are also eligible for medical, dental, vision, life and disability benefits, and participation in the Company’s 401(k) plan. The Employee is also eligible for up to 15 to 25 days of vacation per year (depending on the employee’s tenure), up to 13 days of holidays throughout the calendar year, and up to 10 days of paid sick leave per year. Your benefits may be adjusted to reflect your location, employment status, duration of employment with the company, and position level. Benefits may also be pro-rated for those who start working during the calendar year.