[All remote jobs](https://jobicy.com/jobs.md)[![Nebius logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2026/06/d90c0566-221.webp)](https://jobicy.com/company/nebius.md)[Nebius](https://jobicy.com/company/nebius.md)

# Principal Manager, ML Solutions Architecture – Token Factory

AI Summary Nebius is hiring a Principal Manager to lead its EU ML Solutions Architecture team for the Token Factory serverless LLM platform. The role manages approximately eight customer-facing Solutions Architects and owns PoC delivery, post-sales technical support, staffing, quality review, documentation, and operational metrics. It requires deep practical knowledge of LLM inference, fine-tuning, benchmarking, and frameworks such as vLLM, SGLang, and TensorRT-LLM. The manager will partner with engineering, research, pre-sales, account management, and business leadership to improve delivery reliability and platform feasibility. This is a remote role for candidates located in EU countries.[Apply for this job](#job-application)[View company](https://jobicy.com/company/nebius.md)ShareRemote from[Europe](https://jobicy.com/job-region/europe.md)SalaryUndisclosedDepartment[Product & Operations](https://jobicy.com/categories/management.md)EmploymentFull TimeExperienceSeniorPublished21 Nov 2026Apply before21 Dec 2026Listing views40Application actions4Application toolkit

## Make your next move.

Prepare your resume, explore your fit, and draft a cover letter for this opportunity.

Opportunity details

## About this role.

About [Nebius](https://jobicy.com/company/nebius.md):

Nebius is leading a new era in cloud infrastructure for the global AI economy. We are building a full-stack AI cloud platform that supports developers and enterprises from data and model training through to production deployment, without the cost and complexity of building large in-house AI/ML infrastructure.

Built by engineers, for engineers. From large-scale GPU orchestration to inference optimization, we own the hard problems across compute, storage, networking and applied AI.

Listed on Nasdaq (NBIS) and headquartered in Amsterdam, we have a global footprint with R&D hubs across Europe, the UK, North America and Israel. Our team of 1,500+ includes hundreds of engineers with deep expertise across hardware, software and AI R&D.

### The role

This position sits within Nebius Token Factory, our serverless platform for running and customizing open-source LLMs in production. Token Factory allows for serverless inference and fine-tuning backed by in-house optimizations like custom speculative decoding, quantization, cache-aware routing and dedicated endpoints. Customers come to us to move from prototype to scaled production without the cost and complexity of building and tuning their own inference stack.

Our Solutions Architects own the technical delivery of customer engagements: deploying open-source models, tuning the serving stack, benchmarking against the customer’s success criteria, and carrying the technical relationship through to production. Sales Engineers qualify and scope the opportunity; SAs execute it. Technical Account Managers take it from production onward.

We’re looking for a Principal Manager, ML Solutions Architecture to lead our EU regional SA teams. Your scope is PoC delivery and post-sales technical support: the people who do it, the standard they do it to, and the operating cadence that keeps it predictable. You will report to the Head of Solutions Architecture and partner with a peer manager in the other region.

We expect you to push people when they need pushing, make the uncomfortable call when deliverables don’t land even though the effort was real, and take ownership of the documentation work: implement and monitor the following of the guidelines, ticket hygiene, and making sure the team actually uses all three.

You’re welcome to work remotely from any EU country.

Your responsibilities will include:

Lead the team

* Manage a team of 8 Solutions Architects, with continued growth planned: 1:1s, goal setting, performance reviews, promotion cases, and individual growth plans
* Build an accurate picture of each SA’s strengths, gaps, and preferences, and allocate accounts and engagements against both expertise and interest
* Run the cadence that surfaces blockers early, then take them to the development, product, and business teams that can clear them, and stay on them until they do
* Hold people to outcomes: distinguish effort from delivered results, say so plainly when the two diverge, and reflect it in ratings and compensation decisions
* Onboard new joiners through to their first independently delivered engagement
* Coach SAs into stronger engineers and stronger communicators, and make deliberate calls about who is ready for more scope

Own delivery

* Be accountable for your team’s delivery outcomes: time from PoC kick-off to first optimized dedicated endpoint, success-criteria hit rate, and the quality of the technical relationship after the customer goes to production
* Review technical work before it reaches the customer: benchmarking methodology, serving configurations, results, closure documents; catch the wrong conclusion drawn from a metrics artifact before a customer sees it
* Ensure staffing and escalation coverage across accounts and timezones, including post-sales request load that does not respect sprint boundaries
* Call infeasibility early and with evidence, rather than letting the team burn iterations against requirements the platform cannot meet today

Own the operating system of the team

* Maintain and extend the team’s documentation: responsibilities, runbooks, guides, onboarding, definitions of done, engagement closure templates. Keep it accurate and reachable; link, don’t copy
* Get it used, not just written: documentation nobody reads is a cost, not an asset
* Keep the ticket tracker the system of record, so PoC and production status is readable without asking anyone
* Instrument the work: define and report the metrics that show whether delivery is getting faster and more reliable over time

Work across teams

* Development and research teams: convert recurring customer pain into prioritized platform work, and represent the customer’s technical reality in roadmap discussions
* Pre-sales: hold the scoping-to-execution boundary: push back on under-scoped engagements, and feed feasibility signal back upstream
* Account management: make production handoffs uneventful, and keep post-sales technical requests moving
* Business and leadership: give a straight read on account health, technical feasibility, and capacity needs

We expect you to have:

* 3+ years managing technical teams, including performance management and difficult conversations
* Experience managing a customer-facing team. Running a team whose work is visible to customers, on customer timelines, with customer escalations.
* Strong ML knowledge: LLM architectures, fine-tuning approaches (SFT/LoRA, RL-based), evaluation design, and a working command of inference internals — quantization, KV-cache management, batching, routing, speculative decoding — and of the frameworks the team works in (vLLM, SGLang, TensorRT-LLM)
* Enough technical judgment to review someone else’s benchmark and find the flaw in the methodology, not just in the conclusion
* Python strong enough to read and review your team’s code
* Excellent communication skills, with the ability to clearly explain technical concepts to diverse audiences, from engineers to executives, including in front of enterprise customers under pressure
* Genuine tolerance for operational work: documentation, process design, reporting, and the follow-through that makes them stick
* Comfort operating with ambiguity across distributed teams and timezones, and a bias toward writing things down

It would be an added bonus if you have:

* References from both former managers and former direct reports
* Experience scaling a team through rapid growth (5 → 15+) without losing delivery quality
* Prior experience in a customer-facing technical function at a cloud, inference, or AI infrastructure provider
* Experience defining process and documentation for a team that had none
* Hands-on background running LLMs in production and debugging inference workloads at the framework level
* Work with multimodal AI models (vision-language, speech)
* Proficiency with DevOps tooling (Docker, Kubernetes) and infrastructure-as-code

Preferred technical stack:

* Programming languages: Python
* ML frameworks and libraries: vLLM, TensorRT-LLM, SGLang, Transformers, OpenAI/Anthropic SDKs
* MLOps and DevOps tools: Kubernetes (K8s), Docker, Git
* Cloud platforms: AWS (SageMaker, Bedrock), GCP (Vertex AI), Azure (Azure ML)

Benefits & Perks:

* Competitive compensation
* Career growth and learning opportunities
* Flexibility and ownership
* Collaborative and innovative culture
* Opportunity to work on impactful AI projects
* International environment and talented teams

What’s it like to work at Nebius:

Fast moving – Bold thinking – Constant growth – Meaningful impact – Trust and real ownership – Opportunity to shape the future of AI

Equal Opportunity Statement:

Nebius is an equal opportunity employer. We are committed to fostering an inclusive and diverse workplace and to providing equal employment opportunities in all aspects of employment. We do not discriminate on the basis of race, color, religion, sex (including pregnancy), national origin, ancestry, age, disability, genetic information, marital status, veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by applicable law.

Applicants must be authorized to work in the country in which they apply and will be required to provide proof of employment eligibility as a condition of hire.

If you need accommodations during the application process, please let us know.

Show more

[Apply now >](https://jobicy.com/jobs/163638-principal-manager-ml-solutions-architecture-token-factory.md)

>  Annual salary information is not provided for this position. Explore salary ranges for similar roles in our [Salary Directory ›](https://jobicy.com/salaries.md)

This job listing has been manually reviewed by the Jobicy Trust & Safety Team for compliance with our posting guidelines, including verification of the company's legitimacy, accuracy of job details, clarity of remote work policy, and absence of misleading or fraudulent content.

## Role DNA

A quick view of the complexity, pace, ownership and collaboration implied by the job description.

### Job Complexity

5/5EasyHard

### Pace & Pressure

5/5RelaxedFast-paced

### Autonomy Level

5/5GuidedFull ownership

### Communication Load

5/5IndependentCollaborative

AI insightThis is a senior people-management and technical-delivery role requiring expert LLM infrastructure judgment, customer-facing escalation management, and cross-functional operational ownership. The leader is accountable for both team performance and complex production outcomes under customer timelines.

## Salary analysis

Estimated compensation compared with the broader US market for similar roles.

Estimated job median (per year)Market rate$210,000US market range (per year)$170k–$260k0$286k

AI insightThe yearly pay period is inferred from the job context; it was not explicitly stated by the employer. No employer base salary is disclosed. The annual compensation figures are estimated USD market ranges for a principal-level ML solutions architecture manager with people leadership and production LLM infrastructure expertise; yearly cadence is inferred from the full-time senior professional role.

## Core skills

Skills and capabilities most closely associated with this opportunity.

[People Management](https://jobicy.com/jobs?search_keywords=People%20Management.md)[Solutions Architecture](https://jobicy.com/jobs?search_keywords=Solutions%20Architecture.md)[LLM Inference](https://jobicy.com/jobs?search_keywords=LLM%20Inference.md)[Machine Learning](https://jobicy.com/jobs?search_keywords=Machine%20Learning.md)[Fine-Tuning](https://jobicy.com/jobs?search_keywords=Fine-Tuning.md)[Benchmarking](https://jobicy.com/jobs?search_keywords=Benchmarking.md)[Python](https://jobicy.com/jobs?search_keywords=Python.md)[vLLM](https://jobicy.com/jobs?search_keywords=vLLM.md)[TensorRT-LLM](https://jobicy.com/jobs?search_keywords=TensorRT-LLM.md)[SGLang](https://jobicy.com/jobs?search_keywords=SGLang.md)[Kubernetes](https://jobicy.com/jobs?search_keywords=Kubernetes.md)[Docker](https://jobicy.com/jobs?search_keywords=Docker.md)[Technical Delivery](https://jobicy.com/jobs?search_keywords=Technical%20Delivery.md)[Customer Success](https://jobicy.com/jobs?search_keywords=Customer%20Success.md)[Operational Excellence](https://jobicy.com/jobs?search_keywords=Operational%20Excellence.md)
*

![Upload CV](data:image/svg+xml;base64,PHN2ZyB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciIHdpZHRoPSI2NSIgaGVpZ2h0PSI2NSIgZmlsbD0ibm9uZSIgeG1sbnM6dj0iaHR0cHM6Ly92ZWN0YS5pby9uYW5vIj48ZyBjbGlwLXBhdGg9InVybCgjQSkiPjxwYXRoIGQ9Ik0wIDBINjVWNjVIMFYwWiIgZmlsbD0iIzAyOWFlYiIvPjxnIGZpbGw9IiNmZmYiIHN0cm9rZT0iI2ZmZiIgc3Ryb2tlLXdpZHRoPSIyIj48cGF0aCBkPSJNMzMuMDQ5IDE1LjQ1NGExLjQzIDEuNDMgMCAwIDAtMi4wOTcgMGwtNy41NzkgOC4xNDdhMS4zOCAxLjM4IDAgMCAwIC4wOSAxLjk3MyAxLjQ0IDEuNDQgMCAwIDAgMi4wMDgtLjA4OGw1LjEwOS01LjQ5MnYyMC42MWExLjQxIDEuNDEgMCAwIDAgMS40MjEgMS4zOTdjLjc4NSAwIDEuNDIxLS42MjUgMS40MjEtMS4zOTd2LTIwLjYxbDUuMTA5IDUuNDkyYTEuNDQgMS40NCAwIDAgMCAyLjAwOC4wODggMS4zOCAxLjM4IDAgMCAwIC4wOS0xLjk3M2wtNy41NzktOC4xNDZ6TTE2Ljc2OSAzOC40YzAtLjc3My0uNjItMS40LTEuMzg1LTEuNFMxNCAzNy42MjcgMTQgMzguNHYuMTAybC4yMTUgNi4yMjljLjIyMyAxLjY4LjcwMSAzLjA5NSAxLjgxMyA0LjIxOHMyLjUxIDEuNjA3IDQuMTcyIDEuODMzYzEuNi4yMTggMy42MzYuMjE4IDYuMTYuMjE4aDExLjI4bDYuMTYtLjIxOGMxLjY2Mi0uMjI2IDMuMDYxLS43MDkgNC4xNzItMS44MzNzMS41ODktMi41MzggMS44MTMtNC4yMThDNTAgNDMuMTEzIDUwIDQxLjA1NSA1MCAzOC41MDNWMzguNGMwLS43NzMtLjYyLTEuNC0xLjM4NS0xLjRzLTEuMzg1LjYyNy0xLjM4NSAxLjRsLS4xOSA1Ljk1OGMtLjE4MiAxLjM3LS41MTUgMi4wOTUtMS4wMjYgMi42MTJzLTEuMjI4Ljg1My0yLjU4MyAxLjAzOGMtMS4zOTUuMTktMy4yNDMuMTkzLTUuODkzLjE5M0gyNi40NjJjLTIuNjUgMC00LjQ5OC0uMDAzLTUuODkzLS4xOTMtMS4zNTUtLjE4NC0yLjA3Mi0uNTIxLTIuNTgzLTEuMDM4cy0uODQ0LTEuMjQyLTEuMDI2LTIuNjEyYy0uMTg3LTEuNDEtLjE5MS0zLjI3OS0uMTkxLTUuOTU4eiIvPjwvZz48L2c+PGRlZnM+PGNsaXBQYXRoIGlkPSJBIj48cGF0aCBmaWxsPSIjZmZmIiBkPSJNMCAwaDY1djY1SDB6Ii8+PC9jbGlwUGF0aD48L2RlZnM+PC9zdmc+)

### Upload your resume now

To unlock remote work opportunities and be discovered by global employers.

Next step

## Apply now.

Follow the employer’s application method and review Jobicy’s safety guidance before sharing personal information.

Keep exploring

## Related remote jobs.

*
![Vonage logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/06/1bac058d-221.jpg)
Vonage Nov 21  New

### [Identity and Numbering Analyst – Network API Registration](https://jobicy.com/jobs/163678-identity-and-numbering-analyst-network-api-registration.md)

Join Vonage and help us innovate cloud communications for businesses worldwide! Vonage Communications APIs Vonage helps businesses connect with their customers, employees and partners through communications APIs. Network APIs expose…

*
![NerdWallet logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2026/11/ce9564777294-221.webp)
NerdWallet Nov 21  New

### [Staff Data Product Manager (Machine Learning) – Canada](https://jobicy.com/jobs/163669-staff-data-product-manager-machine-learning-canada.md)

NerdWallet’s mission is to provide clarity for all of life’s financial decisions. Machine learning is how we get there at scale. It helps us understand our consumers, personalize their experiences,…

*
![NerdWallet logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2026/11/ce9564777294-221.webp)
NerdWallet Nov 21  New

### [Staff Data Product Manager (Machine Learning)](https://jobicy.com/jobs/163666-staff-data-product-manager-machine-learning.md)

NerdWallet’s mission is to provide clarity for all of life’s financial decisions. Machine learning is how we get there at scale. It helps us understand our consumers, personalize their experiences,…

*
![6sense logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/08/b5ec98b2-221.png)
6sense Nov 21  New

### [Sr. Product Manager](https://jobicy.com/jobs/163664-sr-product-manager-2.md)

Our Mission: 6sense‘s mission is to multiply what matters: growth, retention, and efficiency. We envision a future where companies, teams and people reach their full potential. Our People: People are…

*
![Teamworks logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2026/11/de7f1534a7c5-221.webp)
Teamworks Nov 21  New

### [Senior Technical Product Manager, AI](https://jobicy.com/jobs/163663-senior-technical-product-manager-ai.md)

We’re hiring a Senior Product Manager, AI Platform to own and scale Ask Teamworks and the shared platform behind AI experiences across our product suite. Teamworks builds the operating system…

*
![Teamworks logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2026/11/de7f1534a7c5-221.webp)
Teamworks Nov 21  New

### [Product Management MBA Intern](https://jobicy.com/jobs/163659-product-management-mba-intern.md)

Teamworks is hiring a Product Management MBA Intern to support the product lifecycle from customer discovery through launch and deliver work the team can use. Our product team is growing,…

*
![The Flex logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/06/5b85d3fa-221.jpeg)
The Flex Nov 21  New

### [The Flex Algeria: Founder’s Associate](https://jobicy.com/jobs/163643-the-flex-algeria-founders-associate.md)

Build your career back home. French salary, Algerian life. Meet the founder: watch this 60-second video About The Flex Our mission: make renting an apartment as easy as buying something…

*
![Mozilla logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2020/10/mozilla.jpg)
Mozilla Nov 21  New

### [VP, Mozilla Studio](https://jobicy.com/jobs/163636-vp-mozilla-studio-2.md)

This is a globally remote position. We have existing employment in Canada, Germany, the UK, and the US. We will consider other candidates on a case-by-case basis. Mozilla Foundation is…

*
![Quince logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/06/b33b4553-221.png)
Quince Nov 21  New

### [Materials Sourcing Manager, Wool](https://jobicy.com/jobs/156251-materials-sourcing-manager-wool.md)

ABOUT QUINCE Quince is a destination for builders, creators, innovators, and operators who want to come together and challenge the status quo. Our mission is simple: make really high quality…

*
![Caylent logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/06/9ed8d81b-221.jpg)
Caylent Nov 21  New

### [Operations Analyst](https://jobicy.com/jobs/156243-operations-analyst.md)

Caylent is an AI-first cloud services company that helps organizations turn ambitious ideas into meaningful business impact. As an AWS Premier Tier Services Partner and a charter member of Anthropic’s…

[Browse all jobs](https://jobicy.com/jobs.md)