Suggested rewrite: Led a cross-functional initiative that improved [business outcome] by [measurable result], demonstrating experience relevant to this role...
Senior ML Engineer (Agentic Search)
Review the role, location requirements, compensation details, and application process before deciding whether this opportunity fits your next career move.
- Remote from
- Europe
- Salary
- Undisclosed
- Department
- Data Science & Analytics
- Employment
- Full Time
- Experience
- Senior
- Published
- Apply before
- 26 Nov 2026
- Listing views
- 31
- Application actions
- 1
Make your next move.
Prepare your resume, explore your fit, and draft a cover letter for this opportunity.
The role, at a glance.
Nebius is seeking a senior machine learning engineer to build production-grade agentic search systems for retrieval, reranking, indexing, and content understanding. The role combines applied deep learning with ML platform engineering, including training-data generation, evaluation, orchestration, GPU scheduling, and low-latency inference. The engineer will partner closely with software teams to optimize relevance, latency, quality, and cost for a 24x7 web-scale service. Strong Python plus Go or C++, production ML deployment experience, and expertise in transformers, embeddings, and rigorous model evaluation are required.
Role DNA
A quick view of the complexity, pace, ownership and collaboration implied by the job description.
Pace & Pressure
5/5Autonomy Level
5/5Communication Load
4/5Salary analysis
Estimated compensation compared with the broader US market for similar roles.
Core skills
Skills and capabilities most closely associated with this opportunity.
Sample interview questions
I would begin with offline evaluation using representative, time-split query-document data and metrics such as NDCG, MRR, Recall@K, latency, and calibration. I would segment results by query type, freshness, language, and tail queries, then validate promising candidates through a guarded online A/B test with reliability and cost metrics.
I balance relevance gains against p95 and p99 latency, throughput, GPU utilization, and cost. Typical levers include model distillation, batching, quantization, compilation, caching, candidate-set sizing, and a multi-stage retrieval architecture that reserves expensive reranking for the most valuable candidates.
I would create versioned pipelines for data ingestion, labeling or weak-supervision generation, quality validation, training, offline evaluation, model registration, and controlled deployment. The pipeline should track data and model lineage, detect distribution shifts, enforce metric gates, and support rollback when online quality or system health degrades.
I would combine retrieval metrics with task-level measures, such as answer grounding, source coverage, factuality, freshness, successful task completion, and user follow-up rate. Operational metrics including latency, availability, crawl-to-index delay, and cost per successful task are also essential because model quality alone is insufficient in production.
I would quantify the incremental quality improvement alongside GPU, storage, latency, and operational costs, then propose alternatives such as selective routing, smaller models, caching, or staged reranking. I aim to make the decision transparent through experiments and dashboards so the team can choose the best product-level trade-off.
About this role.
About Nebius:
Nebius is leading a new era in cloud infrastructure for the global AI economy. We are building a full-stack AI cloud platform that supports developers and enterprises from data and model training through to production deployment, without the cost and complexity of building large in-house AI/ML infrastructure.
Built by engineers, for engineers. From large-scale GPU orchestration to inference optimization, we own the hard problems across compute, storage, networking and applied AI.
Listed on Nasdaq (NBIS) and headquartered in Amsterdam, we have a global footprint with R&D hubs across Europe, the UK, North America and Israel. Our team of 1,500+ includes hundreds of engineers with deep expertise across hardware, software and AI R&D.
We are seeking a Senior ML Engineer to join a fast-growing team building an agent-native search platform for AI systems, the emerging web access layer for AI. Our focus is agentic search, where AI systems plan, retrieve and refine rather than just return results.
You will develop and deploy machine learning models that power retrieval, ranking, and indexing at scale, helping AI systems access fresh, reliable information in real time.
This is a high-impact role working on a production system used 24×7, operating at the scale of web search.
Your responsibilities:
Train and deploy ML models for retrieval, reranking, and search relevance, such as embedding models and cross-encoders, in production
Develop models supporting crawling, data selection, and content understanding
Build and maintain the data, training and evaluation pipelines behind our models: training-data generation, evaluation sets and retraining
Contribute to and improve our ML platform: training and orchestration workflows (Kubernetes, GPU scheduling, experiment tracking, model lifecycle) and inference optimisation for low-latency serving
Work closely with engineering to integrate and deploy ML models in production services, balancing latency, quality and cost
Apply the latest architectural advances and training procedures for retrieval and LLM-integrated systems
Must-haves:
5+ years of experience in software engineering or applied machine learning
Strong programming skills in Python and at least one of Go or C++
Proven experience deploying ML models in production systems
Solid understanding of machine learning and modern deep learning, including transformers and embeddings
Experience building data or ML pipelines and working with workflow orchestration
Ability to define meaningful model metrics and evaluate models rigorously
Product-oriented mindset with a focus on impact and iteration
Nice-to-haves:
Hands-on experience with retrieval, ranking, or recommendation
Experience with Kubernetes, distributed training or GPU scheduling, or inference optimisation (batching, quantisation, compilation)
Contributions to open-source projects, technical publications, or conference talks
Strong results on public benchmarks or leaderboards (e.g. MTEB, BEIR) or models released on Hugging Face
Benefits & Perks:
- Competitive compensation
- Career growth and learning opportunities
- Flexibility and ownership
- Collaborative and innovative culture
- Opportunity to work on impactful AI projects
- International environment and talented teams
What’s it like to work at Nebius:
Fast moving – Bold thinking – Constant growth – Meaningful impact – Trust and real ownership – Opportunity to shape the future of AI
Equal Opportunity Statement:
Nebius is an equal opportunity employer. We are committed to fostering an inclusive and diverse workplace and to providing equal employment opportunities in all aspects of employment. We do not discriminate on the basis of race, color, religion, sex (including pregnancy), national origin, ancestry, age, disability, genetic information, marital status, veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by applicable law.
Applicants must be authorized to work in the country in which they apply and will be required to provide proof of employment eligibility as a condition of hire.
If you need accommodations during the application process, please let us know.
Annual salary information is not provided for this position. Explore salary ranges for similar roles in our Salary Directory ›
This job listing has been manually reviewed by the Jobicy Trust & Safety Team for compliance with our posting guidelines, including verification of the company's legitimacy, accuracy of job details, clarity of remote work policy, and absence of misleading or fraudulent content.
Apply now.
Follow the employer’s application method and review Jobicy’s safety guidance before sharing personal information.
Continue on the employer website
Protect your personal information and never pay to secure an interview or job offer. .
