# Senior Solution Architect, AI Infrastructure Remote from[USA](https://jobicy.com/job-region/usa.md)Salary, yearly, USD 184,000 - 356,500Department [Software Engineering](https://jobicy.com/categories/engineering.md) Employment type Full Time, Job posted25 Jun 2026Apply before25 Jul 2026Experience level Senior Views / Applies 287 / 41 [About company](https://jobicy.com/company/nvidia.md) [Share](#share) About [NVIDIA](https://jobicy.com/company/nvidia.md) NVIDIA is a leader in AI computing and graphics technology. * [Computer Hardware](https://jobicy.com/company-category/computer-hardware.md) * 1993 Actively Hiring Verified job posting This job post has been [manually reviewed](https://jobicy.com/tools/help-center/employee/how-does-jobicy-verify-the-legitimacy-of-remote-job-listings.md) for authenticity and compliance. Tailor Resume Check Job Fit Cover Letter ### Tailor my resume to this job Discover how to best rewrite and optimize your resume for this specific job. You'll receive personalized suggestions and detailed guidance to highlight your key strengths, effectively address the job requirements, and make your application more compelling to recruiters and hiring managers. After analyzing your resume, I can provide several recommendations to better position yourself for this role. Your background in software development shows strong technical skills, particularly in Java and Python development. However, for this Senior Backend Developer position, I notice there could be more emphasis on your experience with microservices architecture and cloud technologies, which are key requirements for this role. I recommend highlighting specific projects where you utilized these technologies and quantifying your achievements to demonstrate impact... Upgrade to Plus ### Am I a good fit for this job? Understand your compatibility with this specific job opportunity. Our detailed analysis will assess your resume against the role's requirements, providing insights into your potential fit, key skill alignments, and areas you might need to develop to be a strong candidate. After assessing your resume against the job requirements, here's a summary of your fit: 1. Overall Match: Moderate Fit (Approx. 65-70%). Your resume shows good alignment with several core responsibilities for the Project Manager role, especially your experience in agile methodologies and stakeholder communication. 2. Key Strengths: Your PMP certification and proven track record in delivering projects on time are strong assets for this position. 3. Potential Gap: The role specifies experience with 'XYZ specific software', which is not explicitly mentioned in your resume. If you have this experience, ensure it's highlighted. 4. Recommendation: Consider adding a quantifiable achievement related to budget management, as this is often a key metric for PM roles... Upgrade to Plus ### Cover Letter Assistant Need help writing a compelling cover letter? Our system can analyze this job and your resume to help you draft personalized paragraphs that highlight your strengths and impress hiring managers. Let me help you draft a strong opening... Dear Hiring Manager, I am writing to express my keen interest in the Senior Marketing Manager position. My background in developing data-driven marketing strategies and leading successful product launches, as detailed in my resume, directly aligns with your need for a candidate capable of enhancing brand visibility and driving market share growth. I am confident I can make a significant contribution to your team... Upgrade to Plus ### AI Summary NVIDIA's Federal business unit seeks a Senior Solution Architect for AI Infrastructure to lead the design and deployment of large-scale GPU systems for US government clients. The role involves working with cloud partners and OEMs, guiding customers on network and compute/storage design, and debugging cluster performance. Ideal candidates have 6+ years in solution engineering, expertise in HPC or networking, and strong customer-facing skills. This position requires US citizenship and offers the opportunity to drive AI transformation in the public sector. ### Role DNA Job Complexity Easy Hard AI Insight The role demands deep technical expertise in GPU infrastructure, networking, and AI, combined with customer-facing and cross-functional leadership skills, making it highly challenging. ### Salary Analysis Median Highly Competitive USD270,250US Market USD150k – 350k 0 USD385k AI Insight The offered salary range of $184,000-$356,500 (median $270,250) is competitive for a Senior Solution Architect role in AI infrastructure, aligning with top-tier tech companies. The market range for this role is typically $150,000-$350,000, so the offer is attractive. ### Core Skills Required [Accelerated Computing](https://jobicy.com/jobs?search_keywords=Accelerated+Computing.md) [AI Infrastructure](https://jobicy.com/jobs?search_keywords=AI+Infrastructure.md) [GPU Clusters](https://jobicy.com/jobs?search_keywords=GPU+Clusters.md) [High-Performance Computing](https://jobicy.com/jobs?search_keywords=HighPerformance+Computing.md) [InfiniBand](https://jobicy.com/jobs?search_keywords=InfiniBand.md) [Solution Architecture](https://jobicy.com/jobs?search_keywords=Solution+Architecture.md) [Customer Engagement](https://jobicy.com/jobs?search_keywords=Customer+Engagement.md) [Network Design](https://jobicy.com/jobs?search_keywords=Network+Design.md) [Deep Learning](https://jobicy.com/jobs?search_keywords=Deep+Learning.md) [US Federal Government](https://jobicy.com/jobs?search_keywords=US+Federal+Government.md) ### Cover Letter Sample I am excited to apply for the Senior Solution Architect, AI Infrastructure position at NVIDIA's Federal business unit. With over 6 years of experience in solution engineering and a deep background in accelerated computing and AI, I am well-prepared to drive digital transformation for US government clients. My expertise in GPU infrastructure, high-performance networking, and customer engagement aligns perfectly with the requirements outlined in the job description. In my previous role, I successfully led the design and deployment of large-scale GPU clusters for federal customers, optimizing network performance and ensuring seamless integration. I have a proven track record of collaborating with cross-functional teams to deliver complex solutions and have extensive experience with NVIDIA technologies, including GPUs, InfiniBand, and cluster management tools. I am particularly drawn to this opportunity because of NVIDIA's leadership in AI and my passion for serving the public sector. I am confident that my technical skills and customer-focused approach will enable me to excel as a trusted advisor to your clients. I look forward to the possibility of contributing to NVIDIA's mission and would welcome the chance to discuss my qualifications further. Copy ### Sample Interview Questions Can you describe a time when you led the deployment of a large-scale GPU cluster for a customer? What challenges did you face and how did you overcome them?In my previous role, I led the deployment of a 1000-GPU cluster for a federal research lab. Key challenges included network congestion and cooling issues. I worked with the networking team to optimize InfiniBand topology and implemented liquid cooling solutions, resulting in a 20% performance improvement.How would you approach a customer who is skeptical about adopting AI and GPU infrastructure?I would start by understanding their specific pain points and use cases, then present case studies and ROI analyses from similar organizations. I would also offer a proof-of-concept project to demonstrate tangible benefits, such as reduced training times or improved model accuracy.Explain the impact of network architecture on GPU cluster performance. How do you optimize it?Network architecture directly affects data transfer speeds and latency, which are critical for distributed training. To optimize, I ensure low-latency interconnects like InfiniBand, use NCCL for efficient communication, and design a non-blocking topology to avoid bottlenecks.Describe your experience with NVIDIA's software stack, including NCCL, DCGM, and UFM. How have you used them in production?I have used NCCL to optimize multi-GPU communication in training workflows, DCGM for monitoring GPU health and performance, and UFM for fabric management in InfiniBand networks. In one project, I used DCGM to identify a memory leak in a GPU application, reducing downtime by 30%.As a solution architect, how do you balance customer requirements with product capabilities? Give an example.When a customer requested a feature that wasn't in the product roadmap, I facilitated a workshop to understand their underlying need. We discovered a workaround using existing APIs that met their requirements. I then provided feedback to the product team, which later incorporated the feature based on customer demand. NVIDIA’s Federal business unit is seeking an experienced solutions lead. This person will be passionate about crafting an entire market and serving the US Federal Government during digital transformation. The ideal candidate will have a strong technical background in accelerated computing technology and artificial intelligence and leverage those skills to help government programs within the US Public Sector market. They will collaborate closely with product, engineering, and federal customers to accelerate NVIDIA technology in the design to deployment of large-scale GPU infrastructure. A successful candidate will demonstrate skill in transcending boundaries, working effectively with product teams, account managers, field organization, and customers to drive success. You must be a U.S. Citizen to apply for this position. What you’ll be doing: * Working with NVIDIA Cloud Partners and OEMs in Public Sector on large data center GPU server and networking system deployments. Guide customer discussions on network design, compute/storage, and support bring up of server/network/cluster deployments. You will need to visit customer data center during bring up phase. * Become the primary technical driver for customers during the design, development, construction, integration, and production of GPU infrastructure and applications throughout the entire customer lifecycle. * Work as the customer’s trusted advisor conducting regular technical customer meetings for product roadmap, cluster issue debugging, feature discussions and introduction to new technology solutions. * Partner with other SAs, Account Managers, Engineering, Product, and business leaders to align on strategies, assess technical needs, and secure business opportunities for NVIDIA. * Analyze and debug compute/network configuration and performance issues to deliver performant clusters. * Prepare and deliver technical content to customers including presentations, workshops, reference architectures, tutorials, publications. * Educate C-Suite-level decision-makers about the benefits of AI and high-performance computing. * Lead communication with customers and NVIDIA Management. * Provide constructive feedback to engineering and product regarding product requirements, customer experience, documentation, and tools. * Ability to travel ~20% What we need to see: The position requires solving complex multidisciplinary problems. They will often be responsible for leading the resolution of technical issues across multiple engineering teams and coordinating the solutions to the customer. * BS/MS/PhD in Electrical Engineering, Computer Science or equivalent experience. * 6+ years supporting Solution Engineering (or similar Sales Engineering, Cloud Engineering, Solution Architecture) including experience working directly with partners and customers. * Experience with high performance Networking or CPU/GPU application acceleration is preferred. * Strong interpersonal skills and a background in direct customer interaction. * Subject Matter Expertise (SME) in High-Performance Computing, or Networking * Critical thinking capability, the ability to concisely communicate vision (both written and verbal) and engage in cross-functional collaboration. Ways to stand out from the crowd: * Familiarity with NVIDIA GPUs, NVIDIA Networking technologies (e.g. NICs, RoCE, InfiniBand), and systems technology such as NCCL, DCGM, UFM, Mission Control, and Base Command Manager. Experience building and/or integration artificial intelligence solutions. * Experience with bring up and deployment of large GPU clusters, including deploying and optimizing high-speed networks (InfiniBand/Ethernet), with a clear understanding of how network architecture impacts GPU cluster performance. * Experience working with enterprise developers and strong customer-facing skills. * Active Security Clearance is highly desirable. NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us. If you’re creative, independent, and focused on serving the mission of the U.S. Federal Government, we want to hear from you! Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD – 287,500 USD for Level 4, and 224,000 USD – 356,500 USD for Level 5. You will also be eligible for equity and [benefits](https://www.nvidia.com/en-us/benefits/). Applications for this job will be accepted at least until May 15, 2026. This posting is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes. NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law. Show more [Apply now >](https://jobicy.com/jobs/143574-senior-solution-architect-ai-infrastructure.md) * ![Upload CV](data:image/svg+xml;base64,PHN2ZyB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciIHdpZHRoPSI2NSIgaGVpZ2h0PSI2NSIgZmlsbD0ibm9uZSIgeG1sbnM6dj0iaHR0cHM6Ly92ZWN0YS5pby9uYW5vIj48ZyBjbGlwLXBhdGg9InVybCgjQSkiPjxwYXRoIGQ9Ik0wIDBINjVWNjVIMFYwWiIgZmlsbD0iIzAyOWFlYiIvPjxnIGZpbGw9IiNmZmYiIHN0cm9rZT0iI2ZmZiIgc3Ryb2tlLXdpZHRoPSIyIj48cGF0aCBkPSJNMzMuMDQ5IDE1LjQ1NGExLjQzIDEuNDMgMCAwIDAtMi4wOTcgMGwtNy41NzkgOC4xNDdhMS4zOCAxLjM4IDAgMCAwIC4wOSAxLjk3MyAxLjQ0IDEuNDQgMCAwIDAgMi4wMDgtLjA4OGw1LjEwOS01LjQ5MnYyMC42MWExLjQxIDEuNDEgMCAwIDAgMS40MjEgMS4zOTdjLjc4NSAwIDEuNDIxLS42MjUgMS40MjEtMS4zOTd2LTIwLjYxbDUuMTA5IDUuNDkyYTEuNDQgMS40NCAwIDAgMCAyLjAwOC4wODggMS4zOCAxLjM4IDAgMCAwIC4wOS0xLjk3M2wtNy41NzktOC4xNDZ6TTE2Ljc2OSAzOC40YzAtLjc3My0uNjItMS40LTEuMzg1LTEuNFMxNCAzNy42MjcgMTQgMzguNHYuMTAybC4yMTUgNi4yMjljLjIyMyAxLjY4LjcwMSAzLjA5NSAxLjgxMyA0LjIxOHMyLjUxIDEuNjA3IDQuMTcyIDEuODMzYzEuNi4yMTggMy42MzYuMjE4IDYuMTYuMjE4aDExLjI4bDYuMTYtLjIxOGMxLjY2Mi0uMjI2IDMuMDYxLS43MDkgNC4xNzItMS44MzNzMS41ODktMi41MzggMS44MTMtNC4yMThDNTAgNDMuMTEzIDUwIDQxLjA1NSA1MCAzOC41MDNWMzguNGMwLS43NzMtLjYyLTEuNC0xLjM4NS0xLjRzLTEuMzg1LjYyNy0xLjM4NSAxLjRsLS4xOSA1Ljk1OGMtLjE4MiAxLjM3LS41MTUgMi4wOTUtMS4wMjYgMi42MTJzLTEuMjI4Ljg1My0yLjU4MyAxLjAzOGMtMS4zOTUuMTktMy4yNDMuMTkzLTUuODkzLjE5M0gyNi40NjJjLTIuNjUgMC00LjQ5OC0uMDAzLTUuODkzLS4xOTMtMS4zNTUtLjE4NC0yLjA3Mi0uNTIxLTIuNTgzLTEuMDM4cy0uODQ0LTEuMjQyLTEuMDI2LTIuNjEyYy0uMTg3LTEuNDEtLjE5MS0zLjI3OS0uMTkxLTUuOTU4eiIvPjwvZz48L2c+PGRlZnM+PGNsaXBQYXRoIGlkPSJBIj48cGF0aCBmaWxsPSIjZmZmIiBkPSJNMCAwaDY1djY1SDB6Ii8+PC9jbGlwUGF0aD48L2RlZnM+PC9zdmc+) ### Upload your resume now To unlock remote work opportunities and be discovered by global employers. This job listing has been manually reviewed by the Jobicy Trust & Safety Team for compliance with our posting guidelines, including verification of the company's legitimacy, accuracy of job details, clarity of remote work policy, and absence of misleading or fraudulent content. ## How to apply ## See a few more Similar Software Engineering remote jobs * ![MLabs logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/06/635fcb8b-221.png) MLabs [Senior Android Engineer](https://jobicy.com/jobs/144909-senior-android-engineer-2.md) Location: Remote – EU remoteRemote | Full-timeCompensation: €90K – €110KWe are hiring on behalf of our client, a high-growth, venture-backed financial technology organization who is seeking an exceptional Senior Android Engineer to join… ![Germany flag](https://cloud.jobicy.com/nyc4-cold/img/round-flags/de.svg) ![Netherlands flag](https://cloud.jobicy.com/nyc4-cold/img/round-flags/nl.svg) DE, NL +2 more, PT, PL•Full TimeEUR 90k-110k/year* ![1Password logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2020/09/WRILS-200909195848-296323.png) 1Password [Senior Security Engineer, GRC Automation](https://jobicy.com/jobs/144932-senior-security-engineer-grc-automation.md) 1Password is growing. We’ve surpassed $400M in ARR and we’re continuing to accelerate, earning a spot on the Forbes Cloud 100 for four years in a row and teaming up… ![USA flag](https://cloud.jobicy.com/nyc4-cold/img/round-flags/us.svg) ![Canada flag](https://cloud.jobicy.com/nyc4-cold/img/round-flags/ca.svg) US, CA•Full TimeUSD 144k-214k/year* ![ManTech logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/06/265c7fe8-221-1.png) ManTech [Agentic AI Developer](https://jobicy.com/jobs/145128-agentic-ai-developer.md) General information Requisition # R68149 Locations USA-Remote Work Posting Date 05/29/2026 Security Clearance Required None Remote Type Fully Remote Time Type Full time Description & Requirements Elevate your career with… ![USA flag](https://cloud.jobicy.com/nyc4-cold/img/round-flags/us.svg) US•Full TimeUSD 63,500-105,900/year* ![Kubikware logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/08/e55f1c3e-221.png) Kubikware [Node.js & React Tech Lead (Latam, Remote)](https://jobicy.com/jobs/147980-node-js-react-tech-lead-latam-remote.md) We are Kubikware™, a digital agency with 20+ years of experience designing and developing web and mobile platforms, as well as video games, AR/VR apps, and AI/ML. We are headquartered… ![LATAM flag](https://cloud.jobicy.com/nyc4-cold/img/round-flags/latam.svg) LATAM•Full TimeNEW* ![Kubikware logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/08/e55f1c3e-221.png) Kubikware [Laravel & React Engineer (Remote, Latam)](https://jobicy.com/jobs/147975-laravel-react-engineer-remote-latam.md) We are Kubikware™, a digital agency with 20 years of experience designing and developing web and mobile platforms, as well as video games, AR/VR apps, and AI/ML. We are headquartered… ![LATAM flag](https://cloud.jobicy.com/nyc4-cold/img/round-flags/latam.svg) LATAM•Full TimeNEW* ![Kubikware logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/08/e55f1c3e-221.png) Kubikware [Full-Stack Node.js and React Engineer](https://jobicy.com/jobs/147974-full-stack-node-js-and-react-engineer.md) We are Kubikware™, a digital agency with 20+ years of experience designing and developing web and mobile platforms, as well as video games, AR/VR apps, and AI/ML. We are headquartered… ![LATAM flag](https://cloud.jobicy.com/nyc4-cold/img/round-flags/latam.svg) LATAM•Full TimeNEW* ![Autodesk logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2022/03/983ea436405fa9ab72f858e1f1b874a7.jpeg) Autodesk [CPQ Architect](https://jobicy.com/jobs/147705-cpq-architect.md) Job Requisition ID #26WD98345Position Overview Autodesk is looking for an experienced Salesforce CPQ Architect to join our dynamic team. As a Salesforce CPQ Architect, you will play a pivotal role… ![APAC flag](https://cloud.jobicy.com/nyc4-cold/img/round-flags/apac.svg) ![Australia flag](https://cloud.jobicy.com/nyc4-cold/img/round-flags/au.svg) APAC, AU•Full TimeNEW* ![ManTech logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/06/265c7fe8-221-1.png) ManTech [Senior Model Based System Engineer](https://jobicy.com/jobs/142065-senior-model-based-system-engineer.md) General information Requisition # R67188 Locations USA-Remote Work Posting Date 04/16/2026 Security Clearance Required Interim Secret Remote Type Fully Remote Time Type Full time Description & Requirements Shape the future… ![USA flag](https://cloud.jobicy.com/nyc4-cold/img/round-flags/us.svg) US•Full TimeUSD 89,100-148,200/year* ![NVIDIA logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/06/52745899-221.jpeg) NVIDIA [Senior HPC Performance Engineer](https://jobicy.com/jobs/142109-senior-hpc-performance-engineer.md) As a member of our team in NVIDIA’s NVHPC compilers & tools group, you will analyze and run High Performance Computing (HPC) applications on HPC servers and systems to gain… ![Europe flag](https://cloud.jobicy.com/nyc4-cold/img/round-flags/eu.svg) EU•Full TimeNEW* ![NVIDIA logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/06/52745899-221.jpeg) NVIDIA [Senior Software Engineer, JAX](https://jobicy.com/jobs/142111-senior-software-engineer-jax.md) NVIDIA is hiring senior engineers to develop its AI platform and more specifically its performance optimizations in deep learning frameworks using JAX, a tool that can differentiate between Python control… ![Europe flag](https://cloud.jobicy.com/nyc4-cold/img/round-flags/eu.svg) EU•Full TimeUSD 292,500-507k/year [More Jobs](https://jobicy.com/jobs.md)