# Sr. Software Engineer II – AI Remote from[USA](https://jobicy.com/job-region/usa.md)Salary, yearly, USD 187,000 - 235,000Department [Software Engineering](https://jobicy.com/categories/engineering.md) Employment type Full Time, Job posted21 Jun 2026Apply before21 Jul 2026Experience level Midweight Views / Applies 1190 / 88 [About company](https://jobicy.com/company/iherb.md) * Share About [iHerb](https://jobicy.com/company/iherb.md) On a mission to make health and wellness accessible to all. [Health, Wellness & Fitness](https://jobicy.com/company-category/health-wellness-fitness.md) * 1996 Actively Hiring Verified job posting This job post has been [manually reviewed](https://jobicy.com/tools/help-center/employee/how-does-jobicy-verify-the-legitimacy-of-remote-job-listings.md) for authenticity and compliance. ### AI Summary This Sr. Software Engineer II - AI role at iHerb focuses on building GenAI-powered product experiences and the shared AI platform infrastructure. Responsibilities include designing RAG pipelines, LLM-driven personalization, conversational agents, agentic workflow systems, and establishing eval frameworks and MLOps practices. The ideal candidate is fully autonomous, proficient in Python, experienced with production LLM applications, and comfortable across the full stack. They will lead technical decisions, mentor junior engineers, and own systems end-to-end including observability and on-call. ### Role DNA Job Complexity Easy Hard Pace & Pressure Relaxed Fast-paced Autonomy Level Guided Full Ownership Communication Load Independent Highly Collaborative AI Insight The role demands deep technical expertise in AI, full-stack awareness, and production ownership, as well as mentoring and coordination with multiple teams, making it challenging but not at the most extreme level. ### Salary Analysis Median Highly Competitive USD211,000US Market USD150k – 250k 0 USD275k AI Insight The offered salary range of $187,000 - $235,000 is competitive, falling within the market median for senior AI engineering roles. The median of $211,000 aligns well with industry standards for a Sr. Software Engineer II with AI specialization. ### Core Skills Required [GenAI](https://jobicy.com/jobs?search_keywords=GenAI.md) [RAG](https://jobicy.com/jobs?search_keywords=RAG.md) [LLM](https://jobicy.com/jobs?search_keywords=LLM.md) [Python](https://jobicy.com/jobs?search_keywords=Python.md) [MLOps](https://jobicy.com/jobs?search_keywords=MLOps.md) [Production Engineering](https://jobicy.com/jobs?search_keywords=Production+Engineering.md) [Software Engineering](https://jobicy.com/jobs?search_keywords=Software+Engineering.md) [AI Platform](https://jobicy.com/jobs?search_keywords=AI+Platform.md) [Agentic Workflow](https://jobicy.com/jobs?search_keywords=Agentic+Workflow.md) [Machine Learning](https://jobicy.com/jobs?search_keywords=Machine+Learning.md) ### Cover Letter Sample I am writing to express my strong interest in the Sr. Software Engineer II - AI position at iHerb. With extensive experience in building and deploying production-grade GenAI systems, including RAG pipelines and LLM-driven personalization, I am excited about the opportunity to contribute to your innovative AI platform. In my previous role, I led the development of agentic workflow systems and implemented robust eval frameworks, ensuring high-quality and repeatable AI features. I am fully autonomous, comfortable across the full stack, and passionate about mentoring junior engineers to elevate team capabilities. I am particularly drawn to iHerb's focus on health and wellness and the chance to build AI solutions that directly enhance customer experiences. I look forward to the possibility of discussing how my technical leadership and AI expertise can drive impact at iHerb. Copy ### Sample Interview Questions Describe your experience designing and deploying a RAG pipeline in production. What challenges did you face and how did you overcome them?I built a RAG pipeline for a customer support chatbot using LangChain and Pinecone. Challenges included context window management and retrieval latency. I optimized by chunking documents strategically and implementing caching for frequent queries, achieving sub-second response times.How do you evaluate the quality of an LLM-powered feature? Walk us through your framework.I use a structured eval framework with metrics like answer relevance, faithfulness, and answer completeness. For example, I create a golden dataset of question-answer pairs, run the system against it, and compute scores. I also incorporate human evaluation and A/B testing to validate against production metrics.Explain your approach to ensuring observability and reliability of AI systems in production.I implement monitoring for latency, cost, quality drift, and error rates using tools like Prometheus and Grafana. I set up alerts for anomalies and maintain dashboards for real-time insights. Additionally, I design for graceful degradation, such as fallback models or cached responses, to maintain uptime.How do you stay current with the rapidly evolving AI landscape and incorporate new techniques into your work?I regularly read research papers, attend conferences, and experiment with new models and frameworks in sandbox environments. For a recent project, I migrated from a traditional LLM to a more efficient model after evaluating performance gains, reducing costs by 30% while maintaining quality.Describe a time you mentored a junior engineer or led a technical initiative. What was the outcome?I led a team of three junior engineers to build an internal analytics agent using LangChain. I provided code reviews, pair programming sessions, and architectural guidance. The project was delivered on time, and two team members gained proficiency in LLM development, later contributing to other AI features. Job Summary: The Sr. Software Engineer II – AI will lead the build of GenAI-powered product experiences and the shared AI platform infrastructure that powers them. This includes RAG pipelines over the iHerb catalog and customer reviews, LLM-driven personalization, a conversational Wellness Agent, agentic workflow systems, and the evals and MLOps layer that makes AI features production-grade and repeatable. Specializations within this track include: RAG and personalization, agent framework and tool use, evals and guardrails, and LLM application development for internal business functions such as marketing automation and BI agents. Job Expectations: * Design, build, and operate production AI features: RAG pipelines, LLM-driven recommendations, conversational agents, or agentic workflow automation. * Build the shared AI platform layer: retrieval infrastructure, eval frameworks, model monitoring, guardrails, and observability. * Write LLM applications and integrations with marketing platforms, BI tools, or customer-facing product surfaces. * Evaluate model and feature quality using structured eval frameworks; iterate on prompts, retrieval strategies, and model selection using data. * Use AI-driven SDLC tooling such as Claude Code as a daily practice for both AI and non-AI code. * Coordinate with the Personalization team to align GenAI product features with existing ML personalization signals. * Document AI system design decisions, evaluation results, and operational lessons in the shared knowledge base. * Own the observability of AI systems you build: latency, cost, quality drift, and error rates; participate in on-call rotation and respond to production incidents. The duties and responsibilities described above may provide only a partial description of this position. This is not an exhaustive list of all aspects of the job. Other duties and responsibilities not outlined in this document may be added as necessary or desirable, with or without notice. Knowledge, Skills and Abilities: Required: * AI-driven SDLC : hands-on experience shipping production code with AI-assisted development tools such as Claude Code, GitHub Copilot, or Cursor. The bar is not awareness; it is daily use in delivering real software. * Full-stack awareness: comfortable contributing across layers of the stack when needed; purely single-layer specialists are not the target profile. * Production ownership: experience owning features end-to-end from spec through deployment, observability, and on-call. Engineers here own what they ship; there is no separate ops handoff. * Code quality fundamentals: strong grasp of software design principles, automated testing, code review, and CI/CD. * Fully autonomous; drives technical decisions within the team; mentors junior engineers. * Python proficiency; comfortable building and operating production LLM applications. * Hands-on experience with at least one specialization: RAG and retrieval systems, LLM evaluation, agentic frameworks (LangChain, LlamaIndex, or similar), or LLM-based workflow automation. * Understanding of prompt engineering, context window management, and LLM output quality tradeoffs. * Familiarity with vector databases, embedding models, or semantic search. * High degree of accuracy and attention to detail * Excellent organization skills and ability to multi-task Preferred: * Exposure to MLOps tooling or model deployment pipelines. * Contributions to internal developer tooling, golden path standards, or SDLC process improvements. * Experience with e-commerce platforms, product catalogs, or high-traffic consumer applications. * Exposure to MLOps tooling or model deployment pipelines. * Experience working in globally distributed teams. * Track record of documenting architectural decisions, writing RFCs, or contributing to engineering wikis. Equipment Knowledge: * Experience with Microsoft Office Suite (Word, Excel, PowerPoint) * Experience with Google Business Suite (Gmail, Drive, Docs, Sheets, Forms) preferred Experience Requirements: Generally requires a minimum of 10+ years of software engineering experience. Education Requirements: Bachelor’s Degree in Computer Science or related field preferred, or a combination of education and equivalent work experience. Judgment/Reasoning Ability: Able to identify, troubleshoot and resolve problems quickly using sound judgment, poise and diplomacy. Ability to use judgment and reasoning skills, and determine when to escalate issues, as required, in a timely manner. Physical Demands: The physical demands described here are representative of those that must be met by a Team Member to successfully perform the essential functions of this job. While performing the duties of this job, the Team Member is regularly required to talk and hear. The Team Member is frequently required to sit, walk, climb stairs, use hands and fingers, bend, stoop and reach with hands and arms. Reaching above shoulder heights, below the waist or lifting as required to file documents or store materials throughout the work day. The Team Member may occasionally lift or move office products and supplies up to 25 pounds. Proper lifting techniques required. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions. Work Environment: The noise in the work environment is usually moderate. Other factors are: * Hectic, fast-paced with multi-level distractions * Professional, yet casual work environment * Office / Warehouse environment * Ability to work extended hours as required #LI-JC1 The anticipated pay scale for this position can be found below, however the pay range applicable to you may vary by geographic location based on where the job is located or where you work. The final pay offered to a successful candidate will be dependent on several factors that may include but are not limited to the type and years of experience within the job, the type of years and experience within the industry, education, etc. iHerb, LLC is a multi-state employer and this pay scale may not reflect positions that work in other states or locations. Employees (and their families) that meet eligibility criteria as outlined in applicable plan documents are eligible to participate in our medical, dental, vision, and basic life insurance programs and may enroll in our company’s 401(k) plan. Employees will also be eligible for Time Off and Paid Sick Leave pursuant to the company’s policies. Employees will enjoy paid holidays throughout the calendar year. Eligibility requirements for these benefits will be controlled by applicable plan documents.Hired applicant may be awarded Restrict Stock Units and receive annual bonuses pursuant to eligibility and performance criteria defined in the respective plan documents and policies. For more information on iHerb benefits, visit us at [iHerbBenefits.com](https://www.iherbbenefits.com/). Anticipated Pay Scale:$187,000—$235,000 USD Staffing Agency Submission Notice iHerb does not accept unsolicited 3rd party (“Agency”) candidates. If you are an Agency, please send any requests to be considered as a supplier in our Vendor Management System to [staffingvendors@iherb.com](mailto:staffingvendors@iherb.com). Do not contact iHerb employees directly. If requested to work on a role, any Agency candidates would be presented through the internal recruiting organization. About iHerb iHerb is on a mission to make health and wellness accessible to all. We offer Earth’s best-curated selection of health and wellness products, at the best possible value, delivered with the most convenient experience. We’re the world’s largest eCommerce platform dedicated to vitamins, minerals, and supplements, and other health and wellness products. For more than 25 years, we’ve been making it simple for people all over the world to purchase the highest quality products. From supplements to skincare to grocery items, we ship over 50,000 products, from over 1,800 brands direct to our customers in 180+ countries. Our vision is to become the #1 destination for health and wellness across the world. With a passion for wellness and a mind for innovative solutions, iHerb team members share a vision for a healthier world that drives them each day. Our 5 Shared Values unite our global team: Focus on the Customer · Empower Our People · Be Entrepreneurial & Pivot Quickly · Embrace Diversity & Inclusion · Strive for Simplicity iHerb Benefits At iHerb, we are dedicated to offering programs designed to help our employees and their families stay healthy, live well, and plan for their financial future. Built on a strong foundation, our programs provide options and upgrades with flexibility, protection, and security in mind. For the comprehensive benefits list, visit [www.iHerbBenefits.com](http://www.iherbbenefits.com/). For our international team members, you may be eligible for benefits depending on the country where you are employed. The Talent Acquisition Partner/local HR representative will go over the benefits you are eligible for. iHerb is an Equal Opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability or veteran status. iHerb provides equal employment opportunities to all applicants for employment and prohibits discrimination and harassment. Show more [Apply now >](https://jobicy.com/jobs/147334-sr-software-engineer-ii-ai.md) * ![Upload CV](data:image/svg+xml;base64,PHN2ZyB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciIHdpZHRoPSI2NSIgaGVpZ2h0PSI2NSIgZmlsbD0ibm9uZSIgeG1sbnM6dj0iaHR0cHM6Ly92ZWN0YS5pby9uYW5vIj48ZyBjbGlwLXBhdGg9InVybCgjQSkiPjxwYXRoIGQ9Ik0wIDBINjVWNjVIMFYwWiIgZmlsbD0iIzAyOWFlYiIvPjxnIGZpbGw9IiNmZmYiIHN0cm9rZT0iI2ZmZiIgc3Ryb2tlLXdpZHRoPSIyIj48cGF0aCBkPSJNMzMuMDQ5IDE1LjQ1NGExLjQzIDEuNDMgMCAwIDAtMi4wOTcgMGwtNy41NzkgOC4xNDdhMS4zOCAxLjM4IDAgMCAwIC4wOSAxLjk3MyAxLjQ0IDEuNDQgMCAwIDAgMi4wMDgtLjA4OGw1LjEwOS01LjQ5MnYyMC42MWExLjQxIDEuNDEgMCAwIDAgMS40MjEgMS4zOTdjLjc4NSAwIDEuNDIxLS42MjUgMS40MjEtMS4zOTd2LTIwLjYxbDUuMTA5IDUuNDkyYTEuNDQgMS40NCAwIDAgMCAyLjAwOC4wODggMS4zOCAxLjM4IDAgMCAwIC4wOS0xLjk3M2wtNy41NzktOC4xNDZ6TTE2Ljc2OSAzOC40YzAtLjc3My0uNjItMS40LTEuMzg1LTEuNFMxNCAzNy42MjcgMTQgMzguNHYuMTAybC4yMTUgNi4yMjljLjIyMyAxLjY4LjcwMSAzLjA5NSAxLjgxMyA0LjIxOHMyLjUxIDEuNjA3IDQuMTcyIDEuODMzYzEuNi4yMTggMy42MzYuMjE4IDYuMTYuMjE4aDExLjI4bDYuMTYtLjIxOGMxLjY2Mi0uMjI2IDMuMDYxLS43MDkgNC4xNzItMS44MzNzMS41ODktMi41MzggMS44MTMtNC4yMThDNTAgNDMuMTEzIDUwIDQxLjA1NSA1MCAzOC41MDNWMzguNGMwLS43NzMtLjYyLTEuNC0xLjM4NS0xLjRzLTEuMzg1LjYyNy0xLjM4NSAxLjRsLS4xOSA1Ljk1OGMtLjE4MiAxLjM3LS41MTUgMi4wOTUtMS4wMjYgMi42MTJzLTEuMjI4Ljg1My0yLjU4MyAxLjAzOGMtMS4zOTUuMTktMy4yNDMuMTkzLTUuODkzLjE5M0gyNi40NjJjLTIuNjUgMC00LjQ5OC0uMDAzLTUuODkzLS4xOTMtMS4zNTUtLjE4NC0yLjA3Mi0uNTIxLTIuNTgzLTEuMDM4cy0uODQ0LTEuMjQyLTEuMDI2LTIuNjEyYy0uMTg3LTEuNDEtLjE5MS0zLjI3OS0uMTkxLTUuOTU4eiIvPjwvZz48L2c+PGRlZnM+PGNsaXBQYXRoIGlkPSJBIj48cGF0aCBmaWxsPSIjZmZmIiBkPSJNMCAwaDY1djY1SDB6Ii8+PC9jbGlwUGF0aD48L2RlZnM+PC9zdmc+) ### Upload your resume now To unlock remote work opportunities and be discovered by global employers. This job listing has been manually reviewed by the Jobicy Trust & Safety Team for compliance with our posting guidelines, including verification of the company's legitimacy, accuracy of job details, clarity of remote work policy, and absence of misleading or fraudulent content. ## How to apply ## See a few more Similar Software Engineering remote jobs * ![Mozilla logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2020/10/mozilla.jpg) Mozilla ### [Senior Software Engineer (Contract)](https://jobicy.com/jobs/145880-senior-software-engineer-contract.md) Are you passionate about Privacy Protections and the Open Web? Do you want to ship software to a large user base? Do you want your contributions to have a positive… ![Germany flag](https://cloud.jobicy.com/nyc4-cold/img/round-flags/de.svg) DE•ContractNEW* ![Boulevard logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2021/12/a45167e12b0ed51058a884cf9cd0c76f.png) Boulevard ### [Director of Engineering, Cloud & Reliability](https://jobicy.com/jobs/149111-director-of-engineering-cloud-reliability.md) Who is Boulevard? Boulevard provides the first and only client experience platform for appointment-based, self-care businesses. We empower our customers to give their clients more of the magical moments that… ![USA flag](https://cloud.jobicy.com/nyc4-cold/img/round-flags/us.svg) US•Full TimeUSD 209,500-270k/year* ![Upstart logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/06/bc2cfa2b-221-1.jpeg) Upstart ### [Software Engineer, Unsecured Installments](https://jobicy.com/jobs/149109-software-engineer-unsecured-installments.md) About Upstart At Upstart, we’re united by a mission that matters: to radically reduce the cost and complexity of borrowing for all Americans. Every day, we bring creativity, experimentation, and… ![USA flag](https://cloud.jobicy.com/nyc4-cold/img/round-flags/us.svg) US•Full TimeUSD 136k-196,600/year* ![Upstart logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/06/bc2cfa2b-221-1.jpeg) Upstart ### [Senior Software Engineer, Unsecured Installments](https://jobicy.com/jobs/149108-senior-software-engineer-unsecured-installments.md) About Upstart At Upstart, we’re united by a mission that matters: to radically reduce the cost and complexity of borrowing for all Americans. Every day, we bring creativity, experimentation, and… ![USA flag](https://cloud.jobicy.com/nyc4-cold/img/round-flags/us.svg) US•Full TimeUSD 160,400-223,900/year* ![Cresta logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2022/08/4d686e40b22cf2510b627c59afe5fd95.jpg) Cresta ### [Senior Software Engineer, Backend (AI Agent Integrations)](https://jobicy.com/jobs/149101-senior-software-engineer-backend-ai-agent-integrations.md) Cresta unlocks the true potential of the customer experience, turning every conversation into a competitive advantage. Cresta’s unified AI platform combines conversational AI agents, real-time human agent augmentation, and comprehensive… ![Canada flag](https://cloud.jobicy.com/nyc4-cold/img/round-flags/ca.svg) CA•Full TimeNEW* ![Grundfos logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/09/3a459ef1-221.png) Grundfos ### [Application Engineer – Digital Solutions](https://jobicy.com/jobs/149097-application-engineer-digital-solutions.md) Are you passionate about bridging the gap between cutting-edge digital technology and real-world customer success in water management? Then join us in our mission to pioneer smarter solutions for moving… ![Mexico flag](https://cloud.jobicy.com/nyc4-cold/img/round-flags/mx.svg) MX•Full TimeNEW* ![Zuora logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/06/43baa0bd-221.jpg) Zuora ### [Senior Customer Solution Engineer — AI Native/Consumption Quote to Cash](https://jobicy.com/jobs/149068-senior-customer-solution-engineer-ai-native-consumption-quote-to-cash.md) About ZuoraAt Zuora, we help businesses grow smarter and adapt faster. Our platform powers modern business models — from subscriptions and usage-based pricing to AI-driven and outcome-based offerings — helping… ![USA flag](https://cloud.jobicy.com/nyc4-cold/img/round-flags/us.svg) US•Full TimeUSD 136,800-177,100/year* ![Enode logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2026/06/70d7b7e3-221.webp) Enode ### [Software Engineer](https://jobicy.com/jobs/149062-software-engineer.md) About EnodeThe grid was built for predictable, centralised power. Today it’s absorbing intermittent supply from grid scale solar and wind, alongside dynamic demand from EVs, heat pumps, and home batteries…. ![Europe flag](https://cloud.jobicy.com/nyc4-cold/img/round-flags/eu.svg) ![Norway flag](https://cloud.jobicy.com/nyc4-cold/img/round-flags/no.svg) EU, NO•Full TimeNEW* ![Ruby Labs logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/06/0799a7b7-221-1.jpeg) Ruby Labs ### [Lead IOS Engineer](https://jobicy.com/jobs/149055-lead-ios-engineer.md) About usRuby Labs is a leading tech company that creates and operates innovative consumer products. We offer a diverse range of opportunities across the health, education, and entertainment industries. Our… ![Europe flag](https://cloud.jobicy.com/nyc4-cold/img/round-flags/eu.svg) EU•Full TimeNEW* ![Ruby Labs logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/06/0799a7b7-221-1.jpeg) Ruby Labs ### [Lead Android Developer](https://jobicy.com/jobs/149054-lead-android-developer.md) About usRuby Labs is a leading tech company that creates and operates innovative consumer products. We offer a diverse range of opportunities across the health, education, and entertainment industries. Our… ![Europe flag](https://cloud.jobicy.com/nyc4-cold/img/round-flags/eu.svg) EU•Full TimeNEW [More Jobs](https://jobicy.com/jobs.md)