Technical Product Manager – AI Compute Platform

Remote from
Europe, Netherlands
Annual salary
Undisclosed
Salary information is not provided for this position. Check our Salary Directory to estimate the average compensation for similar roles.
Employment type
Full Time,
Job posted
Apply before
22 Jul 2026
Experience level
Midweight
Views / Applies
59 / 8

About Nebius

Nebius is the AI cloud company, delivering a unified platform that spans the complete AI journey from data and model training and tuning to production runtime and deployment.

Actively Hiring
Verified job posting
This job post has been manually reviewed for authenticity and compliance.

AI Summary

Nebius is building a full-stack AI cloud platform for the AI economy. They are hiring multiple Technical Product Managers to own key slices of the platform end-to-end, from strategy to delivery. The role requires deep technical expertise to engage engineering leaders as peers and comfort to talk directly to customers. The platform spans hardware launches, cluster lifecycle, reliability, customer experience, GPU services, managed runtime, and integrations. It's a high-impact role for those who want to shape the future of AI cloud infrastructure.

Role DNA

Job Complexity
Easy Hard
Pace & Pressure
Relaxed Fast-paced
Autonomy Level
Guided Full Ownership
Communication Load
Independent Highly Collaborative
AI Insight The role demands deep technical knowledge of AI infrastructure, hardware, and cloud platforms, plus strong product and cross-team leadership. It's challenging but manageable for experienced PMs.

Salary Analysis

Median Highly Competitive
$200,000
US Market
$150k – 250k
0 $275k
AI Insight The offered salary is not specified, but for a Technical Product Manager in AI compute infrastructure, the market range in the US is typically $150k–$250k base, with total compensation often exceeding $300k including equity. Based on the level of responsibility, a competitive offer would likely be in the upper end of this range.

Key Skills

Product Management AI/ML Infrastructure Cloud Computing GPU Computing Kubernetes Data Center Customer Discovery API Design Technical Leadership Platform Engineering

Dear Hiring Team,

I am excited to apply for the Technical Product Manager - AI Compute Platform role at Nebius. With a background in cloud infrastructure and AI/ML workloads, I have the technical depth to engage engineering leaders as peers and the product instincts to drive customer-centric roadmaps. I've previously managed products involving GPU clusters, Kubernetes, and large-scale distributed systems, which directly aligns with the platform's needs.

I thrive in fast-paced, high-autonomy environments and have a track record of turning customer pain into product commitments. I am particularly drawn to Nebius's engineering-focused culture and mission to build the best AI cloud. I look forward to bringing my experience to your team.

Sincerely,
[Your Name]

Can you describe a time when you had to manage a complex product launch involving multiple engineering teams?
At my previous company, I led the launch of a new GPU cluster service. I coordinated with hardware, network, and software teams, defined milestones, and held daily stand-ups. Despite delays in hardware delivery, we successfully launched on time by prioritizing features and communicating transparently with customers.
How do you approach prioritizing features in a platform that serves both internal and external customers?
I use a framework combining business value, customer impact, and technical feasibility. I engage directly with customers through interviews and usage data, and work with engineering to understand dependencies. For platform products, I also consider developer experience and long-term architectural health.
What experience do you have with AI/ML workloads and infrastructure?
I have worked on products that support training and inference at scale, including optimizing GPU utilization, managing NCCL topologies, and integrating with frameworks like PyTorch. I also have hands-on experience with Kubernetes and Slurm for workload orchestration.
How do you measure success for a platform product?
Beyond adoption and revenue, I focus on customer satisfaction metrics such as time-to-first inference, reliability (e.g., mean time to recover), and platform utilization. I also track developer friction through feedback and feature requests.
Describe a situation where you had to influence without authority to drive cross-team execution.
I led a cross-team initiative to improve cluster autohealing. I built a compelling case with data on MTTR and customer impact, secured buy-in from engineering leads by aligning with their goals, and facilitated regular syncs. The result was a 30% reduction in downtime.

About Nebius:

Nebius is leading a new era in cloud infrastructure for the global AI economy. We are building a full-stack AI cloud platform that supports developers and enterprises from data and model training through to production deployment, without the cost and complexity of building large in-house AI/ML infrastructure.

Built by engineers, for engineers. From large-scale GPU orchestration to inference optimization, we own the hard problems across compute, storage, networking and applied AI.

Listed on Nasdaq (NBIS) and headquartered in Amsterdam, we have a global footprint with R&D hubs across Europe, the UK, North America and Israel. Our team of 1,500+ includes hundreds of engineers with deep expertise across hardware, software and AI R&D.

The role
Our customers build the frontier of AI on top of Nebius — training state-of-the-art models, running production inference at scale, shipping the research and products that define where the field is going next.
We are building the AI cloud that the people building the frontier of AI choose deliberately — not on price, not on raw capacity, but on how it works to use it day to day. To do that, we are growing the AI Compute Platform product team and hiring multiple Technical Product Managers across the full surface of the platform.
Your scope will be defined by what you bring. We will match your technical strengths, customer experience, and product instincts to the area of the platform where you can have the most impact. The platform is broad — and at our scale, every slice is mission-critical.
If you want to help build the best AI cloud in the world — and you have the technical depth to engage engineering leaders as a peer (not as a translator) and the comfort to talk to customers directly — this team is for you.
The platform you’ll help build:
  • Hardware platforms & launch — bringing new GPU and CPU platforms (GB300, Vera Rubin, ARM/Grace, future generations) to production with full launch readiness across the stack.
  • Cluster lifecycle & fleet operations — new region launches, 100,000+ GPU cluster bring-up, platform sharding and allocation architecture, release engineering, host-lifecycle automation, operational efficiency.
  • Reliability & Mission Control — autohealing, health checks, SLA, fault-tolerant training, MTTR reduction, customer trust at scale, observability as a product.
  • Customer experience & developer surface — Compute APIs, console, CLI, IMDS and in-VM signals, self-service workflows, notifications, customer-facing observability, unified UX across the product line.
  • GPU & InfiniBand foundational services — drivers, firmware, NCCL, IB/RoCE, NVLink topology, the foundational layer everything else builds on.
  • Managed runtime platforms — Soperator (Slurm-on-Kubernetes) and MK8S (Managed Kubernetes for AI workloads), powering training and inference for frontier labs.
  • Platform integrations & emerging workloads — Token Factory integration, RL and agentic workload infrastructure, capacity sharing, new business surfaces as they emerge.
  • Cross-platform program & delivery — NVIDIA partnership programs, major-maintenance orchestration, cross-stream releases.
You will own one of the slices of this platform end-to-end — from strategy and roadmap through delivery, adoption, and measurable outcomes.
Your responsibilities will include (regardless of which slice you own):
  • Own end-to-end product responsibility for your area — strategy, roadmap, discovery, delivery, adoption, measurable customer and platform outcomes.
  • Design and own the platform contracts customers depend on — APIs, semantics, system events, customer-facing surfaces, operational behavior — at hyperscaler quality.
  • Drive cross-team execution across platform engineering, networking, storage, Soperator/MK8S, observability, IAM, billing, capacity planning, support, and product design.
  • Turn customer pain into product commitments through structured discovery — interviews, usage analytics, support patterns, incident postmortems. Close the loop so the same class of failure or friction does not recur.
  • Engage engineering as a technical peer — debate API design, reason about system trade-offs, judge the quality of platform internals, and push back when the design is wrong.
  • Define and own success metrics — what you ship is measured by what changed for the customer or the platform, not by the size of the spec.
  • Be the product voice that customer-facing teams (Support, CX, TAMs) escalate to when a system behavior, API contract, or operational pattern needs a product decision, not a workaround.
We expect you to have:
  • 6+ years in Product Management, Platform PM, Infrastructure PM, or SRE / Engineering Lead with strong product instincts.
  • Strong technical foundation and cloud-infrastructure depth — comfort reasoning about API semantics, control-plane vs data-plane behavior, system events and lifecycle, multi-tenant operational realities. You can engage engineering leaders as a peer, not as a translator.
  • Experience with cloud, GPU, or HPC infrastructure — either building one or operating one at meaningful scale (thousands of nodes, multi-region, multi-tenant).
  • Track record of shipping technically complex platform products with measurable customer or platform impact — quantitative results, not aspirational bullets.
  • Strong analytical skills: comfort defining and instrumenting product metrics, working with telemetry, building data-informed roadmaps.
  • Experience leading discovery-heavy work — structured customer interviews, usage analytics, support-ticket analysis — and turning insights into shipped product.
  • Strong communication and ability to align engineering, SRE, customer-facing teams, and exec stakeholders.
  • High ownership, bias to ship, comfort with messy operational reality, and the instinct to push back on engineering when the customer experience or platform quality would suffer.
It will be an added bonus if you have (these are not all required — different strengths fit different slices of the platform):
Customer-facing experience and lived-it perspective:
  • Direct PM experience with frontier AI customers — ML platform teams, MLOps engineers, training and inference at scale.
  • Familiarity with Kubernetes, Slurm, or HPC environments from the user side, and ML training workflows.
  • Hands-on experience with ML training and inference workflows — especially distributed training at scale (multi-node, multi-GPU; comfort with checkpointing, NCCL, fault-tolerant training, debugging large training jobs).
  • Experience as a customer of AI cloud infrastructure at large scale — especially as part of an internal ML platform team that built and operated infrastructure for ML engineers inside your own company. If you have lived through what frustrates customers about clouds, you will know exactly what we are trying to fix.
Hardware, GPU, and HPC depth:
  • Direct experience with NVIDIA reference architectures (NVL72, SuperPOD, MGX, DGX) and the NVIDIA stack (drivers, CUDA, NCCL, DCGM).
  • Familiarity with InfiniBand / RoCE fabrics, firmware lifecycle, topology-aware scheduling.
  • Hands-on with GPU clusters or HPC fabrics at thousands-of-nodes scale.
Cluster and fleet operations:
  • Background in Kubernetes lifecycle (CAPI, cluster upgrades, node-pool management) or Slurm at scale.
  • Experience launching new cloud regions or data-center bring-ups end-to-end.
  • Background in release engineering, change management, or major-maintenance orchestration in production environments.
Customer experience and developer surface:
  • Exposure to console / CLI / API design at hyperscaler quality — AWS, GCP, Azure depth on consistency, versioning, idempotency, error semantics, deprecation policy.
  • Background in observability product — Grafana, Datadog, Honeycomb, New Relic.
  • Knowledge of customer trust artefacts — status pages, RCA workflows, audit logs, SLA reporting, maintenance notifications.
  • Familiarity with developer-experience product patterns — Stripe, Cloudflare, Vercel, Supabase, Render.
Reliability and operational outcomes:
  • Background in SRE, reliability engineering, or fault-tolerant systems for paying customers.
  • Familiarity with reliability metrics that matter: Goodput, MFU, MTTR, MTBF.
  • Experience with autohealing systems and graceful failure semantics.
Emerging workloads and integrations:
  • Familiarity with RL / agentic / inference workload patterns — vLLM, SGLang, Ray, Token Factory-style serving, sandbox technologies (Firecracker, gVisor, Kata).
  • Experience with multi-product cloud integrations — capacity sharing, billing models, cross-product packaging.
  • Background in pricing strategy for infrastructure products (reserved / on-demand / preemptible tiers, two-part pricing).

About Nebius

Nebius AI is an AI cloud platform with one of the largest GPU capacities in Europe. Launched in November 2023, the Nebius AI platform provides high-end, training-optimized infrastructure for AI practitioners. As an NVIDIA preferred cloud service provider, Nebius AI offers a variety of NVIDIA GPUs for training and inference, as well as a set of tools for efficient multi-node training. 

Nebius AI owns a data center in Finland, built from the ground up by the company’s R&D team and showcasing our commitment to sustainability. The data center is home to ISEG, the most powerful commercially available supercomputer in Europe and the 16th most powerful globally (Top 500 list, November 2023).

Nebius’s headquarters are in Amsterdam, Netherlands, with teams working out of R&D hubs across Europe and the Middle East. 

Nebius AI is built with the talent of more than 500 highly skilled engineers with a proven track record in developing sophisticated cloud and ML solutions and designing cutting-edge hardware. This allows all the layers of the Nebius AI cloud – from hardware to UI – to be built in-house, distictly differentiating Nebius AI from the majority of specialized clouds: Nebius customers get a true hyperscaler-cloud experience tailored for AI practitioners. We’re growing and expanding our products every day. 

If you’re up to the challenge and are excited about AI and ML as much as we are, join us!

Benefits & Perks:

  • Competitive compensation
  • Career growth and learning opportunities
  • Flexibility and ownership
  • Collaborative and innovative culture
  • Opportunity to work on impactful AI projects
  • International environment and talented teams

What’s it like to work at Nebius:

Fast moving – Bold thinking – Constant growth – Meaningful impact – Trust and real ownership – Opportunity to shape the future of AI 

Equal Opportunity Statement:

Nebius is an equal opportunity employer. We are committed to fostering an inclusive and diverse workplace and to providing equal employment opportunities in all aspects of employment. We do not discriminate on the basis of race, color, religion, sex (including pregnancy), national origin, ancestry, age, disability, genetic information, marital status, veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by applicable law.

Applicants must be authorized to work in the country in which they apply and will be required to provide proof of employment eligibility as a condition of hire. 

If you need accommodations during the application process, please let us know.

Apply now >

This job listing has been manually reviewed by the Jobicy Trust & Safety Team for compliance with our posting guidelines, including verification of the company's legitimacy, accuracy of job details, clarity of remote work policy, and absence of misleading or fraudulent content.

How to apply

Did you apply? Let us know, and we’ll help you track your application.

See a few more

Similar Product & Operations remote jobs

Job Search Safety Tips

Here are some tips to help you search and apply for jobs safely:
Watch out for suspicious jobs Don't apply for jobs that offer high pay for little work or offer to hire you without an interview. Read more ›
Check the employer's profile Make sure you're applying for a trustworthy job by visiting the employer's profile and learning more about them. Read more ›
Protect your information Don't share personal details like your bank account or government-issued ID on suspicious websites or messengers. Read more ›
Report jobs that feel unsafe If you see a job that seems misleading, inappropriate or discriminatory, report it for going against our policies and we'll review it.

Share this job

Jobicy+ Subscription

Jobicy

617 professionals pay to access exclusive and experimental features on Jobicy

Free

USD $0/month

For people just getting started

  • • Unlimited applies and searches
  • • Access on web and mobile apps
  • • Weekly job alerts and digest
  • • Access to additional tools like Bookmarks, Applications, and more

Plus

USD $8/month

Everything in Free, and:

  • • Ad-free experience
  • • Daily job alerts and digest
  • • Personal career consultant
  • • AI-powered job advice
Go to account ›