Senior Product Manager, AI Infrastructure

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Product Manager, AI Infrastructure based in United States.

This role sits at the core of defining and shaping next-generation AI infrastructure for large-scale workloads across GPU-driven environments.
You will work closely with enterprise customers to deeply understand their AI training and inference needs at scale.
The position requires translating complex infrastructure requirements into clear product direction and engineering priorities.
You will collaborate across engineering, networking, storage, and operations teams to deliver high-performance cloud solutions.
The environment is highly technical, fast-moving, and centered on solving real-world AI infrastructure challenges.
You will help build scalable offerings that extend beyond individual customers into repeatable platform capabilities.
This is a high-impact opportunity to influence the future of AI infrastructure used globally.

Accountabilities:

Own discovery and definition of customer needs for AI infrastructure, including GPU compute, inference, training workloads, storage, networking, and orchestration systems
Work directly with strategic enterprise customers to understand deployment requirements, performance expectations, and success criteria
Translate customer and market needs into detailed product requirements, technical specifications, and roadmap priorities
Partner with engineering, infrastructure, networking, storage, and operations teams to design and deliver scalable solutions
Drive alignment between customer expectations, product strategy, architecture decisions, and execution plans
Define requirements across distributed systems, cluster orchestration environments, and high-performance computing infrastructure

Requirements:

5+ years of experience in technical product management within infrastructure, cloud computing, or AI/ML platforms
Strong understanding of GPU compute systems, distributed storage, and high-performance networking technologies such as InfiniBand or RoCE
Experience working directly with enterprise or strategic customers on infrastructure design and requirements gathering
Solid knowledge of AI/ML workloads including training, fine-tuning, and inference at scale
Familiarity with orchestration frameworks such as Kubernetes and Slurm in production environments
Proven ability to collaborate with engineering teams on complex distributed infrastructure products
Excellent communication skills with the ability to engage both technical and executive stakeholders
Bachelor’s degree in Computer Science, Engineering, or related technical field (advanced degree preferred)

Benefits:

Competitive compensation package: 130,000 to 165,000 USD depending on experience and location
100% employer-paid medical, dental, and vision insurance
401(k) with 100% match up to 4% and immediate vesting
Annual professional development reimbursement of 2,500 USD
Paid holidays, PTO accrual with rollover, and extended leave benefits including sabbaticals
Remote work support stipend and annual internet reimbursement
Wellness perks including gym reimbursement and subscription access to wellness platforms
Long-term employee recognition programs including anniversary bonuses and additional PTO over tenure

How Jobgether works:

We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team.

We appreciate your interest and wish you the best!

Why Apply Through Jobgether?

Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.

#LI-CL1

Senior Product Manager, AI Infrastructure

USA Remote Jobs