[All remote jobs](https://jobicy.com/jobs.md)Open role[![ICON plc logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/06/4536bfb1-221-1.jpeg)](https://jobicy.com/company/icon-plc.md)Remote opportunity at[ICON plc](https://jobicy.com/company/icon-plc.md)

# AI Software Engineer II, Government Technology

Review the role, location requirements, compensation details, and application process before deciding whether this opportunity fits your next career move.

[Apply for this job](#job-application)[View company](https://jobicy.com/company/icon-plc.md)Share21 Aug 2026Published27Listing views0Application actions20 Sep 2026Apply before  Opportunity details

## About this role.

AI SummaryICON seeks an experienced AI Software Engineer to design and ship production agentic-AI capabilities for its construction technology platform and government technology programs. The role centers on LLM-powered products, multi-agent orchestration, tool use, MCP integrations, RAG pipelines, and rigorous evaluation practices. Candidates need at least six years of software engineering experience, strong Python and/or TypeScript skills, and demonstrated experience shipping LLM-based systems. This is a remote full-time role with periodic project-based travel to ICON headquarters in Austin, Texas, and the selected candidate must be able to obtain and maintain a security clearance.

## Role DNA

A quick view of the complexity, pace, ownership and collaboration implied by the job description.

### Job Complexity

5/5EasyHard

### Pace & Pressure

4/5RelaxedFast-paced

### Autonomy Level

5/5GuidedFull ownership

### Communication Load

4/5IndependentCollaborative

AI insightThis is a senior-level engineering role requiring both deep production software engineering capability and specialized expertise in rapidly evolving agentic AI systems. The engineer will own work from prototype through deployment while operating in potentially regulated government environments.

## Salary analysis

Estimated compensation compared with the broader US market for similar roles.

Estimated job medianMarket rate$153,200US market range$125k–$190k0$209k

AI insightThe stated candidate compensation range is $126,400 to $180,000, with a midpoint of $153,200. The posting does not state a pay cadence, so no job period is assigned. For a US-based AI Software Engineer II with production LLM, RAG, and agentic-systems responsibilities, an estimated market range is $125,000 to $190,000 USD.

## Core skills

Skills and capabilities most closely associated with this opportunity.

[Agentic AI](https://jobicy.com/jobs?search_keywords=Agentic%20AI.md)[LLM application development](https://jobicy.com/jobs?search_keywords=LLM%20application%20development.md)[Python](https://jobicy.com/jobs?search_keywords=Python.md)[TypeScript](https://jobicy.com/jobs?search_keywords=TypeScript.md)[Retrieval-augmented generation (RAG)](https://jobicy.com/jobs?search_keywords=Retrieval-augmented%20generation%20RAG.md)[Multi-agent orchestration](https://jobicy.com/jobs?search_keywords=Multi-agent%20orchestration.md)[Model Context Protocol (MCP)](https://jobicy.com/jobs?search_keywords=Model%20Context%20Protocol%20MCP.md)[Prompt engineering](https://jobicy.com/jobs?search_keywords=Prompt%20engineering.md)[LLM evaluation](https://jobicy.com/jobs?search_keywords=LLM%20evaluation.md)[AWS serverless infrastructure](https://jobicy.com/jobs?search_keywords=AWS%20serverless%20infrastructure.md)

Sample interview questionsDescribe an agentic AI workflow you have shipped to production and how you ensured it was reliable.I would explain the workflow's user goal, tools, orchestration logic, guardrails, and deployment architecture. I would also describe measurable evaluation criteria, fallback paths, observability, and the production outcomes such as reduced manual effort or improved task completion.

How would you design a RAG system for technical construction or government documentation?

I would begin with source governance and ingestion, then use document-aware chunking, metadata enrichment, embeddings, and a vector store with hybrid retrieval where appropriate. I would add reranking, citation requirements, access controls, and offline evaluation sets to validate answer quality, grounding, and retrieval performance.

What approach would you take to evaluating a multi-agent system?

I would define task-level success criteria and test both individual agents and end-to-end workflows with representative scenarios. I would track tool-call correctness, groundedness, latency, cost, failure modes, and human-review outcomes, then use those findings to refine prompts, tools, routing, and guardrails.

How have you used Model Context Protocol or similar tool-integration patterns?

I would describe creating or integrating secure tool interfaces with clear schemas, authentication, least-privilege permissions, validation, and auditability. I would emphasize making tool results predictable for models and implementing robust error handling, timeouts, and safe retries.

How would you balance rapid AI experimentation with the security needs of a government-facing product?

I would use a controlled experimentation environment with approved models, sanitized data, logging controls, and clear release gates. Before production deployment, I would perform threat modeling, validate data handling and access controls, establish monitoring and incident procedures, and involve security stakeholders early in the design process.

ICON is looking for a pragmatic builder who has made the leap from traditional software engineering into the emerging world of agentic AI development. As an AI Software Engineer at ICON, you will be responsible for designing and shipping AI-powered tools, workflows, and autonomous agents that accelerate ICON’s construction technology platform. This role reports to the Sr. Director, Defense Technology Programs and is available for remote work with periodic travel to ICON HQ in Austin, TX as projects require.

RESPONSIBILITIES

*

Design and build agentic AI systems that automate complex, multi-step workflows across ICON’s software platform

*

Develop LLM-powered features and products using state-of-the-art foundation models and APIs (e.g. Anthropic, OpenAI)

*

Architect and implement multi-agent pipelines, tool-use systems, and Model Context Protocol (MCP) integrations

*

Build robust RAG systems including document ingestion, chunking strategies, embedding pipelines, and vector retrieval

*

Collaborate with software and domain teams to identify high-leverage AI automation opportunities and translate them into shipped products

*

Own the full development lifecycle of AI features: prototyping, evaluation, deployment, and iteration

*

Serve as a technical resource and informal mentor on agentic AI best practices across the engineering organization

*

Stay at the leading edge of the agentic AI landscape and bring emerging techniques into production

MINIMUM QUALIFICATIONS

*

6+ years of professional software engineering experience with a strong foundation in backend or full-stack development

*

Demonstrated experience building and shipping production-grade products using LLMs and agentic frameworks

*

Proficiency in TypeScript and/or Python

*

Deep understanding of prompt engineering, context management, and LLM reasoning patterns

*

Experience with tool-use, function calling, and agent orchestration (e.g. LangChain, LlamaIndex, Claude Code, or custom implementations)

*

Ability to design and execute structured evals to measure and improve AI system performance

*

Strong communication skills and comfort working cross-functionally with both technical teams and non-technical stakeholders

* Must be able to obtain and maintain security clearance.

PREFERRED SKILLS AND EXPERIENCE

*

Experience with MCP (Model Context Protocol) server development and integration

*

Familiarity with vector databases (e.g. pgvector, Pinecone, Weaviate)

*

Experience with fine-tuning, RLHF, or model evaluation pipelines

*

Background in ML fundamentals: embeddings, transformers, attention mechanisms

*

Exposure to structured output generation and LLM-based data extraction

*

Experience working with code generation agents (e.g. Claude Code, Cursor, Devin-style systems)

*

Familiarity with AWS and serverless infrastructure for AI workloads

*

Experience working in or alongside government, defense, or regulated environments

*

Interest or background in the AEC (architecture, engineering, construction) industry

Rate Range: $126,400 – $180,000

ICON is an equal opportunity employer committed to fostering an innovative, inclusive, diverse and discrimination-free work environment. Employment with ICON is based on merit, competence, and qualifications. It is our policy to administer all personnel actions, including recruiting, hiring, training, and promoting employees, without regard to race, color, religion, gender, sexual orientation, gender identity, national origin or ancestry, age, disability, marital status, veteran status, or any other legally protected classification in accordance with applicable federal and state laws. Consistent with the obligations of these laws, ICON will make reasonable accommodations for qualified individuals with disabilities.

Furthermore, as a federal government contractor, the Company maintains an affirmative action program which furthers its commitment and complies with recordkeeping and reporting requirements under certain federal civil rights laws and regulations, including Executive Order 11246, Section 503 of the Rehabilitation Act of 1973 (as amended) and the Vietnam Era Veterans’ Readjustment Assistance Act of 1974 (as amended).

Headhunters and recruitment agencies may not submit candidates through this application. ICON does not accept unsolicited headhunter and agency submissions for candidates and will not pay fees to any third-party agency without a prior agreement with ICON.

As part of our compliance with these obligations, the Company invites you to voluntarily self-identify as set forth below. Provision of such information is entirely voluntary and a decision to provide or not provide such information will not have any effect on your employment or subject you to any adverse treatment. Any and all information provided will be considered confidential, will be kept separate from your application and/or personnel file, and will only be used in accordance with applicable laws, orders and regulations, including those that require the information to be summarized and reported to the federal government for civil rights enforcement purposes.

[Internet Applicant Employment Notices](https://drive.google.com/drive/folders/1KtxCrS8fV9XRApKaXFjKJ5twhzR_MkGE)

Show more

[Apply now >](https://jobicy.com/jobs/151298-ai-software-engineer-ii-government-technology.md)

*

![Upload CV](data:image/svg+xml;base64,PHN2ZyB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciIHdpZHRoPSI2NSIgaGVpZ2h0PSI2NSIgZmlsbD0ibm9uZSIgeG1sbnM6dj0iaHR0cHM6Ly92ZWN0YS5pby9uYW5vIj48ZyBjbGlwLXBhdGg9InVybCgjQSkiPjxwYXRoIGQ9Ik0wIDBINjVWNjVIMFYwWiIgZmlsbD0iIzAyOWFlYiIvPjxnIGZpbGw9IiNmZmYiIHN0cm9rZT0iI2ZmZiIgc3Ryb2tlLXdpZHRoPSIyIj48cGF0aCBkPSJNMzMuMDQ5IDE1LjQ1NGExLjQzIDEuNDMgMCAwIDAtMi4wOTcgMGwtNy41NzkgOC4xNDdhMS4zOCAxLjM4IDAgMCAwIC4wOSAxLjk3MyAxLjQ0IDEuNDQgMCAwIDAgMi4wMDgtLjA4OGw1LjEwOS01LjQ5MnYyMC42MWExLjQxIDEuNDEgMCAwIDAgMS40MjEgMS4zOTdjLjc4NSAwIDEuNDIxLS42MjUgMS40MjEtMS4zOTd2LTIwLjYxbDUuMTA5IDUuNDkyYTEuNDQgMS40NCAwIDAgMCAyLjAwOC4wODggMS4zOCAxLjM4IDAgMCAwIC4wOS0xLjk3M2wtNy41NzktOC4xNDZ6TTE2Ljc2OSAzOC40YzAtLjc3My0uNjItMS40LTEuMzg1LTEuNFMxNCAzNy42MjcgMTQgMzguNHYuMTAybC4yMTUgNi4yMjljLjIyMyAxLjY4LjcwMSAzLjA5NSAxLjgxMyA0LjIxOHMyLjUxIDEuNjA3IDQuMTcyIDEuODMzYzEuNi4yMTggMy42MzYuMjE4IDYuMTYuMjE4aDExLjI4bDYuMTYtLjIxOGMxLjY2Mi0uMjI2IDMuMDYxLS43MDkgNC4xNzItMS44MzNzMS41ODktMi41MzggMS44MTMtNC4yMThDNTAgNDMuMTEzIDUwIDQxLjA1NSA1MCAzOC41MDNWMzguNGMwLS43NzMtLjYyLTEuNC0xLjM4NS0xLjRzLTEuMzg1LjYyNy0xLjM4NSAxLjRsLS4xOSA1Ljk1OGMtLjE4MiAxLjM3LS41MTUgMi4wOTUtMS4wMjYgMi42MTJzLTEuMjI4Ljg1My0yLjU4MyAxLjAzOGMtMS4zOTUuMTktMy4yNDMuMTkzLTUuODkzLjE5M0gyNi40NjJjLTIuNjUgMC00LjQ5OC0uMDAzLTUuODkzLS4xOTMtMS4zNTUtLjE4NC0yLjA3Mi0uNTIxLTIuNTgzLTEuMDM4cy0uODQ0LTEuMjQyLTEuMDI2LTIuNjEyYy0uMTg3LTEuNDEtLjE5MS0zLjI3OS0uMTkxLTUuOTU4eiIvPjwvZz48L2c+PGRlZnM+PGNsaXBQYXRoIGlkPSJBIj48cGF0aCBmaWxsPSIjZmZmIiBkPSJNMCAwaDY1djY1SDB6Ii8+PC9jbGlwUGF0aD48L2RlZnM+PC9zdmc+)

### Upload your resume now

To unlock remote work opportunities and be discovered by global employers.

This job listing has been manually reviewed by the Jobicy Trust & Safety Team for compliance with our posting guidelines, including verification of the company's legitimacy, accuracy of job details, clarity of remote work policy, and absence of misleading or fraudulent content.

Next step

## Apply now.

Follow the employer’s application method and review Jobicy’s safety guidance before sharing personal information.

Keep exploring

## Related remote jobs.

Matched by job category10 related opportunities[Software Engineering](https://jobicy.com/categories/engineering.md) [Browse all jobs](https://jobicy.com/jobs.md)
*
![Astronomer logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2022/08/7a77cfb5b26b29196d5ed8cd14a3103a.jpg)
Astronomer  Aug 21

### [Data Platform Engineer](https://jobicy.com/jobs/151314-data-platform-engineer.md)

Astronomer empowers data teams to bring mission-critical software, analytics, and AI to life and is the company behind Astro, the industry-leading unified DataOps platform powered by Apache Airflow®. Astro accelerates…

*
![Close logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2020/09/Closeio.png)
Close  Aug 21

### [Senior Frontend Engineer – Growth (USA Only – 100% Remote)](https://jobicy.com/jobs/151313-senior-frontend-engineer-growth-usa-only-100-remote.md)

About Us Since 2013, we’ve been building a CRM that gets out of your way and helps your team sell more, faster. Now we’re building AI into every part of…

*
![Close logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2020/09/Closeio.png)
Close  Aug 21

### [Senior Software Engineer – Backend (USA Only – 100% Remote)](https://jobicy.com/jobs/151308-senior-software-engineer-backend-usa-only-100-remote.md)

About Us Since 2013, we’ve been building a CRM that gets out of your way and helps your team sell more, faster. Now we’re building AI into every part of…

*
![Tremendous logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/01/c2bd8be5-221.jpeg)
Tremendous  Aug 21

### [Senior Software Engineer](https://jobicy.com/jobs/151290-senior-software-engineer-3.md)

Tremendous is the global platform built for businesses to send thousands of payouts to anyone, anywhere, for free. We’re trusted by 20,000 organizations like Atlassian, MIT, and United Way to…

*
![eMerchantPay logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/08/1cf6dc20-221.png)
eMerchantPay  Aug 21

### [Senior AI Engineer](https://jobicy.com/jobs/144139-senior-ai-engineer-3.md)

emerchantpay is a leading global payment service provider and acquirer for online, mobile, in-store and over the phone payments. Our global payments solution is available through a simple integration, offering…

*
![Zuora logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/06/43baa0bd-221.jpg)
Zuora  Aug 21

### [Customer Solution Engineer – AI Native/Consumption Quote to Cash](https://jobicy.com/jobs/149450-customer-solution-engineer-ai-native-consumption-quote-to-cash.md)

About ZuoraAt Zuora, we help businesses grow smarter and adapt faster. Our platform powers modern business models — from subscriptions and usage-based pricing to AI-driven and outcome-based offerings — helping…

*
![Welo Global logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2026/06/83c40f94-221.webp)
Welo Global  Aug 21

### [Project Chiron – French (Canada) Quality Control Specialist](https://jobicy.com/jobs/149466-project-chiron-french-canada-quality-control-specialist.md)

About the Role  We are looking for detail-oriented Quality Control (QC) Specialist to support an AI data annotation project. In this role, you will review the work submitted by Trainers — pre-seeded questions paired…

*
![Welo Global logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2026/06/83c40f94-221.webp)
Welo Global  Aug 21

### [Project Chiron – Spanish (Latin America) Quality Control Specialist](https://jobicy.com/jobs/149468-project-chiron-spanish-latin-america-quality-control-specialist.md)

About the Role  We are looking for detail-oriented Quality Control (QC) Specialist to support an AI data annotation project. In this role, you will review the work submitted by Trainers — pre-seeded questions paired…

*
![Acquia, Inc. logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/08/450fb78c-221.png)
Acquia, Inc.  Aug 20

### [Staff AI Engineer](https://jobicy.com/jobs/151267-staff-ai-engineer.md)

About Acquia Acquia empowers the world’s most ambitious brands to create digital customer experiences that matter. With open source Drupal at its core, the Acquia Digital Experience Platform (DXP) enables…

*
![Luxury Presence logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2022/05/f2b241fb769140fff2f70e8efaf5c0ff.jpg)
Luxury Presence  Aug 20

### [Generative Media Engineer, AI Social – US](https://jobicy.com/jobs/151260-generative-media-engineer-ai-social-us.md)

Luxury Presence is building the AI growth platform for real estate. Backed by Bessemer Venture Partners and other top investors, we’re a Series C company that has hit $100M in…