Principal Machine Learning Engineer

Remote from
USA flag
USA
Salary, yearly, USD
205,000 - 230,000
Employment type
Full Time,
Job posted
Apply before
5 Jul 2026
Experience level
Senior
Views / Applies
14 / 4

About iHerb

On a mission to make health and wellness accessible to all.

Verified job posting
This job post has been manually reviewed for authenticity and compliance.

AI Summary

This Principal Machine Learning Engineer role at iHerb involves designing and scaling machine learning systems to impact millions of users, collaborating with data scientists and software developers. The position requires building robust ML infrastructure, adopting best practices, and developing horizontal solutions to accelerate model deployment. Key responsibilities include partnering with the Data Platform team, participating in design and code reviews, and researching new technologies. The ideal candidate has strong coding skills in Java, C#, or Python, experience with big data technologies like Spark and Kafka, and familiarity with Docker, Kubernetes, and cloud platforms. This is a senior-level position requiring at least two years of applied ML experience, offering competitive compensation and the opportunity to work on challenging problems.

Role DNA

Job Complexity
Easy Hard
Pace & Pressure
Relaxed Fast-paced
Autonomy Level
Guided Full Ownership
Communication Load
Independent Highly Collaborative
AI Insight This is a Principal-level role requiring deep expertise in machine learning engineering, software development, and cross-functional collaboration, making it highly challenging and demanding.

Salary Analysis

Median Market Rate
USD217,500
US Market
USD150k – USD300k
0 USD330k
AI Insight The offered salary range of $205,000-$230,000 is well above the national average for Machine Learning Engineers and aligns with Principal-level compensation. It is competitive with top tech companies, reflecting the seniority and impact of the role.

Key Skills

Machine Learning Python Apache Spark Kafka Docker Kubernetes AWS Google Cloud CI/CD Software Engineering

Dear Hiring Manager,

I am writing to express my strong interest in the Principal Machine Learning Engineer position at iHerb. With over 5 years of experience building scalable ML systems and leading cross-functional teams, I am excited about the opportunity to drive innovation and enhance customer experiences through machine intelligence.

In my previous role at XYZ Corp, I designed and deployed ML pipelines using Spark and Kafka, reducing model deployment time by 40%. I have extensive experience with cloud platforms like AWS and GCP, containerization with Docker and Kubernetes, and implementing CI/CD practices. I am adept at collaborating with data scientists and software engineers to turn business problems into production-ready solutions.

I am particularly drawn to iHerb's mission of simplifying customer experiences and automating core processes. I am confident that my technical expertise and leadership skills would make a significant impact on your platform.

Thank you for considering my application. I look forward to the possibility of discussing how I can contribute to iHerb's success.

Sincerely,
[Your Name]

Describe an experience where you designed and built a scalable machine learning infrastructure from scratch.
At my previous company, I led the design of a ML platform that automated model training and deployment. We used Kubernetes for orchestration, Spark for data processing, and implemented a feature store for reusability. The system reduced model deployment time from weeks to days and scaled to handle millions of predictions per day.
How do you ensure the reliability and performance of ML models in production?
I implement robust monitoring and alerting for model metrics like accuracy and latency. I use automated retraining pipelines and shadow testing to validate new models before full rollout. Additionally, I rely on A/B testing and gradual canary deployments to mitigate risks.
Walk me through a time you collaborated with data scientists to solve a business problem using ML. What was your role?
I worked closely with data scientists to build a recommendation system for an e-commerce platform. I provided guidance on feature engineering, optimized the data pipeline using Spark, and implemented a scalable serving infrastructure with low latency. The collaboration resulted in a 15% increase in click-through rates.
What is your experience with big data technologies? Give an example of a project where you processed large volumes of data.
I used Spark to process over 10TB of customer behavior data daily. I designed ETL pipelines that ingested data from Kafka, transformed it using Spark SQL, and stored it in a data lake on AWS S3. The processed data was used to train real-time fraud detection models.
How do you stay updated with the latest trends in machine learning engineering?
I regularly read research papers and blogs from top companies, attend ML conferences like NeurIPS and KubeCon, and participate in open-source projects. I also experiment with new tools and frameworks in personal projects to evaluate their potential.

Job Summary: 

The Machine Learning Engineer will tackle challenging problems and create scalable machine learning systems and platforms that make an impact on millions of users. This role will work closely with business partners to provide machine intelligence driven solutions and products to simplify and enhance the customer experience and to automate core business processes. The Machine Learning Engineer will partner closely with Data Scientists, Applied Scientists, and Software Developers to ensure predictive models make business impact.

Job Expectations: 

  • Partner with the Data Platform team in a two-way exchange of best practices

  • Adopt common patterns and build effective abstractions across different machine learning pipelines that simplify existing machine learning processes and accelerate the modelling process from the business problem’s inception to deploying a model solution into production

  • Develop horizontal solutions to robustly scale the team’s machine learning models and processes

  • Build software with Object-oriented Design Patterns and Analysis (OOA and OOD) with an eye toward reducing technical debt and maintaining services at high availability

  • Participate in requirements reviews, design reviews, and code reviews

  • Research and prototype new technologies to support the rapid growth of the business

  • Interact cross-functionally with a wide variety of technical teams and work closely with data and applied scientists to identify opportunities to improve on iHerb’s platform

The duties and responsibilities described above may provide only a partial description of this position. This is not an exhaustive list of all aspects of the job. Other duties and responsibilities not outlined in this document may be added as necessary or desirable, with or without notice.

Knowledge, Skills and Abilities:

Required:

  • Strong coding experience (e.g. Java, C#, Python)

  • Experience with gathering data from multiple sources using big data technologies (Spark, Hadoop, BigQuery, Athena, etc.)

  • Experience building machine learning infrastructure following robust software engineering practices

  • Knowledge of modern software development tools, systems, and practices (design patterns, CI/CD, git, unit testing, smoke testing, integration testing, job schedulers, cloud technologies like AWS Lambdas and Google functions, etc.)

  • Exposure to all aspects of the software development life-cycle

  • Experience with messaging technologies (Kafka, Google Pub/Sub, Kinesis, RabbitMQ, etc.)

  • Experience with Docker and Kubernetes

  • High degree of accuracy and attention to detail

  • Excellent organization skills and ability to multitask

Equipment Knowledge: 

  • Experience with Microsoft Office Suite (Word, Excel, PowerPoint)

  • Experience with Google Business Suite (Gmail, Drive, Docs, Sheets, Forms) preferred

Experience Requirements:

Generally requires a minimum of two (2) years relevant experience in applied machine learning or machine learning systems/infrastructure, and one (1) year of relevant work experience in machine learning engineering or related fields. (e.g., as a Machine Learning Engineer, ML Ops engineer, or related position).

Education Requirements:

Bachelor’s Degree in Computer Science, Electrical Engineering, or related field required, Masters Degree preferred.

Judgment/Reasoning Ability: Able to identify, troubleshoot and resolve problems quickly using sound judgment, poise and diplomacy. Ability to use judgment and reasoning skills, and determine when to escalate issues, as required, in a timely manner.

Physical Demands: The physical demands described here are representative of those that must be met by a Team Member to successfully perform the essential functions of this job. While performing the duties of this job, the Team Member is regularly required to talk and hear. The Team Member is frequently required to sit, walk, climb stairs, use hands and fingers, bend, stoop and reach with hands and arms. Reaching above shoulder heights, below the waist or lifting as required to file documents or store materials throughout the work day. The Team Member may occasionally lift or move office products and supplies up to 25 pounds. Proper lifting techniques required. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.

Work Environment: The noise in the work environment is usually moderate. Other factors are:

  • Hectic, fast-paced with multi-level distractions

  • Professional, yet casual work environment

  • Office / Warehouse environment

  • Ability to work extended hours as required

#LI-JC1

The anticipated pay scale for this position can be found below, however the pay range applicable to you may vary by geographic location based on where the job is located or where you work. The final pay offered to a successful candidate will be dependent on several factors that may include but are not limited to the type and years of experience within the job, the type of years and experience within the industry, education, etc. iHerb, LLC is a multi-state employer and this pay scale may not reflect positions that work in other states or locations.
Employees (and their families) that meet eligibility criteria as outlined in applicable plan documents are eligible to participate in our medical, dental, vision, and basic life insurance programs and may enroll in our company’s 401(k) plan. Employees will also be eligible for Time Off and Paid Sick Leave pursuant to the company’s policies. Employees will enjoy paid holidays throughout the calendar year. Eligibility requirements for these benefits will be controlled by applicable plan documents.

Hired applicant may be awarded Restrict Stock Units and receive annual bonuses pursuant to eligibility and performance criteria defined in the respective plan documents and policies.
 

For more information on iHerb benefits, visit us at iHerbBenefits.com.

Anticipated Pay Scale:
$205,000—$230,000 USD

Staffing Agency Submission Notice
iHerb does not accept unsolicited 3rd party (“Agency”) candidates. If you are an Agency, please send any requests to be considered as a supplier in our Vendor Management System to [email protected]. Do not contact iHerb employees directly. If requested to work on a role, any Agency candidates would be presented through the internal recruiting organization.

About iHerb
iHerb is on a mission to make health and wellness accessible to all. We offer Earth’s best-curated selection of health and wellness products, at the best possible value, delivered with the most convenient experience.
We’re the world’s largest eCommerce platform dedicated to vitamins, minerals, and supplements, and other health and wellness products. For more than 25 years, we’ve been making it simple for people all over the world to purchase the highest quality products. From supplements to skincare to grocery items, we ship over 50,000 products, from over 1,800 brands direct to our customers in 180+ countries.
Our vision is to become the #1 destination for health and wellness across the world.
With a passion for wellness and a mind for innovative solutions, iHerb team members share a vision for a healthier world that drives them each day. Our 5 Shared Values unite our global team:

Focus on the Customer · Empower Our People · Be Entrepreneurial & Pivot Quickly ·
Embrace Diversity & Inclusion · Strive for Simplicity

iHerb Benefits
At iHerb, we are dedicated to offering programs designed to help our employees and their families stay healthy, live well, and plan for their financial future. Built on a strong foundation, our programs provide options and upgrades with flexibility, protection, and security in mind. For the comprehensive benefits list, visit www.iHerbBenefits.com. For our international team members, you may be eligible for benefits depending on the country where you are employed. The Talent Acquisition Partner/local HR representative will go over the benefits you are eligible for. 

iHerb is an Equal Opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability or veteran status. iHerb provides equal employment opportunities to all applicants for employment and prohibits discrimination and harassment.

Apply now >

This job listing has been manually reviewed by the Jobicy Trust & Safety Team for compliance with our posting guidelines, including verification of the company's legitimacy, accuracy of job details, clarity of remote work policy, and absence of misleading or fraudulent content.

How to apply

Did you apply? Let us know, and we’ll help you track your application.

See a few more

Similar Software Engineering remote jobs

Job Search Safety Tips

Here are some tips to help you search and apply for jobs safely:
Watch out for suspicious jobs Don't apply for jobs that offer high pay for little work or offer to hire you without an interview. Read more ›
Check the employer's profile Make sure you're applying for a trustworthy job by visiting the employer's profile and learning more about them. Read more ›
Protect your information Don't share personal details like your bank account or government-issued ID on suspicious websites or messengers. Read more ›
Report jobs that feel unsafe If you see a job that seems misleading, inappropriate or discriminatory, report it for going against our policies and we'll review it.

Share this job

Jobicy+ Subscription

Jobicy

614 professionals pay to access exclusive and experimental features on Jobicy

Free

USD $0/month

For people just getting started

  • • Unlimited applies and searches
  • • Access on web and mobile apps
  • • Weekly job alerts
  • • Access to additional tools like Bookmarks, Applications, and more

Plus

USD $8/month

Everything in Free, and:

  • • Ad-free experience
  • • Daily job alerts
  • • Personal career consultant
  • • AI-powered job advice
Go to account ›