[All remote jobs](https://jobicy.com/jobs.md)[![Nebius logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2026/06/d90c0566-221.webp)](https://jobicy.com/company/nebius.md)[Nebius](https://jobicy.com/company/nebius.md)

# ML Infrastructure Engineer

AI Summary Nebius is hiring an ML Infrastructure Engineer to benchmark and optimize GPU platforms for AI training and inference workloads. The role covers system- and kernel-level GPU profiling, performance analysis, cluster acceptance testing, and scalability experiments across hardware and interconnect configurations. It requires deep knowledge of large-model performance techniques, modern ML frameworks, CUDA/NCCL, and GPU software stacks. The engineer will build internal performance tooling and dashboards while working independently with hardware and development teams. Remote options are explicitly listed for Europe and the United States.[Apply for this job](#job-application)[View company](https://jobicy.com/company/nebius.md)ShareRemote from[USA](https://jobicy.com/job-region/usa.md), [Europe](https://jobicy.com/job-region/europe.md)SalaryUndisclosedDepartment[DevOps & Infrastructure](https://jobicy.com/categories/admin.md)EmploymentFull TimeExperienceSeniorPublished21 Nov 2026Apply before21 Dec 2026Listing views72Application actions4Application toolkit

## Make your next move.

Prepare your resume, explore your fit, and draft a cover letter for this opportunity.

Opportunity details

## About this role.

About [Nebius](https://jobicy.com/company/nebius.md):

Nebius is leading a new era in cloud infrastructure for the global AI economy. We are building a full-stack AI cloud platform that supports developers and enterprises from data and model training through to production deployment, without the cost and complexity of building large in-house AI/ML infrastructure.

Built by engineers, for engineers. From large-scale GPU orchestration to inference optimization, we own the hard problems across compute, storage, networking and applied AI.

Listed on Nasdaq (NBIS) and headquartered in Amsterdam, we have a global footprint with R&D hubs across Europe, the UK, North America and Israel. Our team of 1,500+ includes hundreds of engineers with deep expertise across hardware, software and AI R&D.

The role

We are seeking a highly skilled ML/AI Engineer to join our team to lead and support benchmarking of GPU platforms benchmarking of GPU platforms for machine learning and AI workloads. You will play a critical role in evaluating the performance of GPU-based hardware for various deep learning and AI frameworks, enabling data-driven decisions for platform optimisation and next-generation hardware development.

Your responsibilities will include:

* Work closely with hardware, development teams to profile and analyse GPU performance at the system and kernel level.
* Evaluate and compare GPU performance across different platforms, architectures, and software stacks (e.g.,CUDA, ROCm).
* Debug and optimise ML workloads to run efficiently on GPU hardware, identifying and resolving performance bottlenecks.
* Perform acceptance testing acceptance testing for new GPU clusters, ensuring hardware and software meet performance, stability, and compatibility requirements for AI workloads.
* Perform experiments across diverse GPU system configurations to assess the impact of varying interconnect strategies and system-level optimisations on performance and scalability.
* Develop tools and dashboards to visualise performance metrics visualise performance metrics, bottlenecks, and trends.
* Contribute to internal tooling, frameworks, and best practices

We expect you to have:

* A profound understanding of theoretical foundations of machine learning
* Deep understanding of performance aspects of large neural networks training and inference (data/tensor/context/expert parallelism, offloading, custom kernels, hardware features, attention optimisations, dynamic batching etc.)
* Deep experience with modern deep learning frameworks (PyTorch, JAX, Megatron-LM, Tensort-LLM)
* Good understanding of the GPU stack: CUDA,NCCL, drivers, and relevant libraries
* Familiarity with containerized environments (e.g., Docker, Kubernetes).
* Strong communication and ability to work independently

Ways to stand out from the crowd:

* Familiarity with modern LLM inference frameworks (vLLM, SGLang, TensorRT)
* Experience in Python and performance profiling tools (e.g., Nsight, nvprof, perf).
* Familiarity with cloud ML platforms like AWS, GCP, Azure ML
* Contributions to open-source ML benchmarking tools

Benefits & Perks:

* Competitive compensation
* Career growth and learning opportunities
* Flexibility and ownership
* Collaborative and innovative culture
* Opportunity to work on impactful AI projects
* International environment and talented teams

What’s it like to work at Nebius:

Fast moving – Bold thinking – Constant growth – Meaningful impact – Trust and real ownership – Opportunity to shape the future of AI

Equal Opportunity Statement:

Nebius is an equal opportunity employer. We are committed to fostering an inclusive and diverse workplace and to providing equal employment opportunities in all aspects of employment. We do not discriminate on the basis of race, color, religion, sex (including pregnancy), national origin, ancestry, age, disability, genetic information, marital status, veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by applicable law.

Applicants must be authorized to work in the country in which they apply and will be required to provide proof of employment eligibility as a condition of hire.

If you need accommodations during the application process, please let us know.

Show more

[Apply now >](https://jobicy.com/jobs/163637-ml-infrastructure-engineer-2.md)

>  Annual salary information is not provided for this position. Explore salary ranges for similar roles in our [Salary Directory ›](https://jobicy.com/salaries.md)

This job listing has been manually reviewed by the Jobicy Trust & Safety Team for compliance with our posting guidelines, including verification of the company's legitimacy, accuracy of job details, clarity of remote work policy, and absence of misleading or fraudulent content.

## Role DNA

A quick view of the complexity, pace, ownership and collaboration implied by the job description.

### Job Complexity

5/5EasyHard

### Pace & Pressure

4/5RelaxedFast-paced

### Autonomy Level

5/5GuidedFull ownership

### Communication Load

4/5IndependentCollaborative

AI insightThis is a highly specialized infrastructure role requiring advanced ML systems knowledge, GPU performance expertise, and low-level profiling skills. The work spans hardware, distributed training and inference, software stacks, and platform validation.

## Salary analysis

Estimated compensation compared with the broader US market for similar roles.

Estimated job median (per year)Market rate$190,000US market range (per year)$150k–$240k0$264k

AI insightThe yearly pay period is inferred from the job context; it was not explicitly stated by the employer. No employer salary was disclosed. The yearly cadence and USD market estimate are inferred from the senior, full-time ML infrastructure scope and the listed US remote hiring option.

## Core skills

Skills and capabilities most closely associated with this opportunity.

[GPU performance benchmarking](https://jobicy.com/jobs?search_keywords=GPU%20performance%20benchmarking.md)[Machine learning infrastructure](https://jobicy.com/jobs?search_keywords=Machine%20learning%20infrastructure.md)[CUDA](https://jobicy.com/jobs?search_keywords=CUDA.md)[NCCL](https://jobicy.com/jobs?search_keywords=NCCL.md)[PyTorch](https://jobicy.com/jobs?search_keywords=PyTorch.md)[JAX](https://jobicy.com/jobs?search_keywords=JAX.md)[Megatron-LM](https://jobicy.com/jobs?search_keywords=Megatron-LM.md)[TensorRT-LLM](https://jobicy.com/jobs?search_keywords=TensorRT-LLM.md)[LLM inference optimization](https://jobicy.com/jobs?search_keywords=LLM%20inference%20optimization.md)[Distributed training](https://jobicy.com/jobs?search_keywords=Distributed%20training.md)[GPU profiling](https://jobicy.com/jobs?search_keywords=GPU%20profiling.md)[Nsight](https://jobicy.com/jobs?search_keywords=Nsight.md)[Docker](https://jobicy.com/jobs?search_keywords=Docker.md)[Kubernetes](https://jobicy.com/jobs?search_keywords=Kubernetes.md)[Python](https://jobicy.com/jobs?search_keywords=Python.md)
*

![Upload CV](data:image/svg+xml;base64,PHN2ZyB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciIHdpZHRoPSI2NSIgaGVpZ2h0PSI2NSIgZmlsbD0ibm9uZSIgeG1sbnM6dj0iaHR0cHM6Ly92ZWN0YS5pby9uYW5vIj48ZyBjbGlwLXBhdGg9InVybCgjQSkiPjxwYXRoIGQ9Ik0wIDBINjVWNjVIMFYwWiIgZmlsbD0iIzAyOWFlYiIvPjxnIGZpbGw9IiNmZmYiIHN0cm9rZT0iI2ZmZiIgc3Ryb2tlLXdpZHRoPSIyIj48cGF0aCBkPSJNMzMuMDQ5IDE1LjQ1NGExLjQzIDEuNDMgMCAwIDAtMi4wOTcgMGwtNy41NzkgOC4xNDdhMS4zOCAxLjM4IDAgMCAwIC4wOSAxLjk3MyAxLjQ0IDEuNDQgMCAwIDAgMi4wMDgtLjA4OGw1LjEwOS01LjQ5MnYyMC42MWExLjQxIDEuNDEgMCAwIDAgMS40MjEgMS4zOTdjLjc4NSAwIDEuNDIxLS42MjUgMS40MjEtMS4zOTd2LTIwLjYxbDUuMTA5IDUuNDkyYTEuNDQgMS40NCAwIDAgMCAyLjAwOC4wODggMS4zOCAxLjM4IDAgMCAwIC4wOS0xLjk3M2wtNy41NzktOC4xNDZ6TTE2Ljc2OSAzOC40YzAtLjc3My0uNjItMS40LTEuMzg1LTEuNFMxNCAzNy42MjcgMTQgMzguNHYuMTAybC4yMTUgNi4yMjljLjIyMyAxLjY4LjcwMSAzLjA5NSAxLjgxMyA0LjIxOHMyLjUxIDEuNjA3IDQuMTcyIDEuODMzYzEuNi4yMTggMy42MzYuMjE4IDYuMTYuMjE4aDExLjI4bDYuMTYtLjIxOGMxLjY2Mi0uMjI2IDMuMDYxLS43MDkgNC4xNzItMS44MzNzMS41ODktMi41MzggMS44MTMtNC4yMThDNTAgNDMuMTEzIDUwIDQxLjA1NSA1MCAzOC41MDNWMzguNGMwLS43NzMtLjYyLTEuNC0xLjM4NS0xLjRzLTEuMzg1LjYyNy0xLjM4NSAxLjRsLS4xOSA1Ljk1OGMtLjE4MiAxLjM3LS41MTUgMi4wOTUtMS4wMjYgMi42MTJzLTEuMjI4Ljg1My0yLjU4MyAxLjAzOGMtMS4zOTUuMTktMy4yNDMuMTkzLTUuODkzLjE5M0gyNi40NjJjLTIuNjUgMC00LjQ5OC0uMDAzLTUuODkzLS4xOTMtMS4zNTUtLjE4NC0yLjA3Mi0uNTIxLTIuNTgzLTEuMDM4cy0uODQ0LTEuMjQyLTEuMDI2LTIuNjEyYy0uMTg3LTEuNDEtLjE5MS0zLjI3OS0uMTkxLTUuOTU4eiIvPjwvZz48L2c+PGRlZnM+PGNsaXBQYXRoIGlkPSJBIj48cGF0aCBmaWxsPSIjZmZmIiBkPSJNMCAwaDY1djY1SDB6Ii8+PC9jbGlwUGF0aD48L2RlZnM+PC9zdmc+)

### Upload your resume now

To unlock remote work opportunities and be discovered by global employers.

Next step

## Apply now.

Follow the employer’s application method and review Jobicy’s safety guidance before sharing personal information.

Keep exploring

## Related remote jobs.

*
![Dropbox logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2020/09/WRILS-200923071227-398427.jpg)
Dropbox Nov 21  New

### [Infrastructure Software Engineer, Orchestration](https://jobicy.com/jobs/163709-infrastructure-software-engineer-orchestration.md)

Role Description As an Infrastructure Software Engineer on Dropbox’s Orchestration team, you’ll build and operate the platforms that help engineering teams run services reliably, efficiently, and at scale. The team…

*
![Grafana Labs logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2021/11/42a3c42246467ec231dd876e92b63452.jpeg)
Grafana Labs Nov 21  New

### [Engineering Manager – Grafana Infrastructure (Remote, Ireland)](https://jobicy.com/jobs/163682-engineering-manager-grafana-infrastructure-remote-ireland.md)

Grafana Labs is the company behind Grafana Cloud, the fully managed observability platform trusted by more than 10,000 organizations to ensure reliability, resolve incidents faster, and optimize telemetry at scale….

*
![BetterHelp logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/06/0b48fde8-221.jpeg)
BetterHelp Nov 21  New

### [Staff ML/AI Platform Engineer](https://jobicy.com/jobs/163642-staff-ml-ai-platform-engineer.md)

Who are we and why should you join us? BetterHelp is on a mission to remove the traditional barriers to therapy and make mental health care more accessible to everyone….

*
![Nebius logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2026/06/d90c0566-221.webp)
Nebius Nov 21  New

### [Senior System Engineer (Virtual Private Cloud Team)](https://jobicy.com/jobs/163639-senior-system-engineer-virtual-private-cloud-team-2.md)

About Nebius: Nebius is leading a new era in cloud infrastructure for the global AI economy. We are building a full-stack AI cloud platform that supports developers and enterprises from…

*
![Amplitude logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/06/bda3af21-221.jpg)
Amplitude Nov 21  New

### [Partner Solutions Architect – AWS](https://jobicy.com/jobs/156254-partner-solutions-architect-aws.md)

Amplitude is the leading AI analytics platform, helping over 5,200 customers—including Atlassian, Burger King, NBCUniversal, and Square—build better products and digital experiences. With powerful AI Agents embedded across our platform,…

*
![Carrot logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2021/07/005d05de29487ec44cd07bd9d757d4e1.png)
Carrot Nov 21  New

### [Sr. IT Systems Engineer](https://jobicy.com/jobs/156214-sr-it-systems-engineer-2.md)

About Carrot: Carrot is the leading global fertility and family care platform, built on intelligent care orchestration: the right clinical guidance, at the right moment, in the context of each…

*
![PerfectServe logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2022/04/7e6f5669fc8c9ea0aa484ce7c3058599.jpg)
PerfectServe Nov 21  New

### [Senior Platform Engineer – US Remote](https://jobicy.com/jobs/156231-senior-platform-engineer-us-remote.md)

What is PerfectServe? PerfectServe is a leading provider of clinical communication and physician scheduling solutions in the health IT space. The company was founded in 1997 and has grown steadily…

*
![Astronomer logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2022/08/7a77cfb5b26b29196d5ed8cd14a3103a.jpg)
Astronomer Nov 21  New

### [Staff Software Engineer, Platform Infrastructure](https://jobicy.com/jobs/156184-staff-software-engineer-platform-infrastructure.md)

Astronomer empowers data teams to bring mission-critical software, analytics, and AI to life and is the company behind Astro, the industry-leading unified DataOps platform powered by Apache Airflow®. Astro accelerates…

*
![Astronomer logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2022/08/7a77cfb5b26b29196d5ed8cd14a3103a.jpg)
Astronomer Nov 21  New

### [Senior Software Engineer, Platform](https://jobicy.com/jobs/156187-senior-software-engineer-platform-3.md)

Astronomer empowers data teams to bring mission-critical software, analytics, and AI to life and is the company behind Astro, the industry-leading unified DataOps platform powered by Apache Airflow®. Astro accelerates…

*
![Canonical logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/06/b4d068a9-221-1.png)
Canonical Nov 21  New

### [Devices & IOT Field Engineering Manager (Americas)](https://jobicy.com/jobs/151016-devices-iot-field-engineering-manager-americas-2.md)

Canonical is a leading provider of open source software and operating systems to the global enterprise and technology markets. Our platform, Ubuntu, is very widely used in breakthrough enterprise initiatives…

[Browse all jobs](https://jobicy.com/jobs.md)