[All remote jobs](https://jobicy.com/jobs.md)Open role[![GitLab logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2020/12/WRILS-201207055737-109952.jpg)](https://jobicy.com/company/gitlab.md)Remote opportunity at[GitLab](https://jobicy.com/company/gitlab.md) # Senior Backend Engineer, AI Engineering: Chat Review the role, location requirements, compensation details, and application process before deciding whether this opportunity fits your next career move. [Apply for this job](#job-application)[View company](https://jobicy.com/company/gitlab.md)Share1 Aug 2026Published46Listing views1Application actionsManually reviewedTrust & Safety status Opportunity details ## About this role. AI SummaryGitLab is hiring a Senior Backend Engineer for its Duo Chat AI team to build core AI capabilities that power the intelligent orchestration of DevSecOps. This role focuses on developing flow components and agentic flows using Python and LangGraph, integrating LLMs, and ensuring reliability across the Python Duo Workflow Service and the Rails monolith. The position requires significant experience in production backend development, AI integration, and strong collaboration with cross-functional teams. You will own complex features end-to-end, with a high degree of autonomy and involvement in on-call rotations. ## Role DNA A quick view of the complexity, pace, ownership and collaboration implied by the job description. ### Job Complexity 4/5EasyHard ### Pace & Pressure 4/5RelaxedFast-paced ### Autonomy Level 5/5GuidedFull ownership ### Communication Load 4/5IndependentCollaborative AI insightThis role demands deep expertise in Python, AI/LLM integration, and distributed systems, plus familiarity with GitLab's Rails monolith and multi-agent orchestration. The complexity of building agentic flows and the need to ensure reliability at scale make this a challenging senior-level position. ## Salary analysis Estimated compensation compared with the broader US market for similar roles. Estimated job medianMarket rate$170,000US market range$130k–$220k0$242k AI insightThe offered salary is not specified in the listing, but based on US market data for senior backend AI engineering roles, the typical range is $130k-$220k. GitLab generally offers competitive base salaries, equity, and comprehensive benefits, and this specialized AI-focused role likely commands a premium within that range. ## Core skills Skills and capabilities most closely associated with this opportunity. [Python](https://jobicy.com/jobs?search_keywords=Python.md)[LangGraph](https://jobicy.com/jobs?search_keywords=LangGraph.md)[AI/LLM Integration](https://jobicy.com/jobs?search_keywords=AILLM%20Integration.md)[Backend Engineering](https://jobicy.com/jobs?search_keywords=Backend%20Engineering.md)[GraphQL](https://jobicy.com/jobs?search_keywords=GraphQL.md)[REST APIs](https://jobicy.com/jobs?search_keywords=REST%20APIs.md)[Ruby on Rails](https://jobicy.com/jobs?search_keywords=Ruby%20on%20Rails.md)[DevSecOps](https://jobicy.com/jobs?search_keywords=DevSecOps.md)[Distributed Systems](https://jobicy.com/jobs?search_keywords=Distributed%20Systems.md)[Observability](https://jobicy.com/jobs?search_keywords=Observability.md) Cover letter sampleDear Hiring Manager, I am excited to apply for the Senior Backend Engineer, AI Engineering: Chat role at GitLab. With extensive experience in building production Python backends and a deep interest in AI-powered systems, I am drawn to GitLab's mission of transforming DevSecOps through intelligent orchestration. In my previous roles, I have designed and shipped complex backend services, integrated LLMs into production workflows, and built scalable APIs using GraphQL and REST. I thrive in fast-paced, collaborative environments and am comfortable taking ownership of features end-to-end. I am particularly excited about the opportunity to work on Duo Chat and the Flow Registry, building agentic flows that directly impact how developers work. I look forward to contributing to GitLab's high-performance culture and learning from world-class engineers. Sincerely, [Your Name] Copy Sample interview questionsCan you describe your experience building production Python backends and handling asynchronous workloads?I have worked on several services using FastAPI and asyncio, handling long-running tasks with background workers and message queues. For example, I designed a data pipeline that processed millions of events per day. How would you approach integrating a new LLM provider into Duo Chat while maintaining low latency? I would first isolate the integration behind an interface, ensure streaming support, implement caching and fallback mechanisms, and set up load testing and monitoring. Describe a time when you had to debug a complex production issue in a distributed system. In a microservices environment, I used tracing and structured logs to pinpoint a race condition between services, then implemented idempotent retries and proper error handling to resolve it. Why do you want to work on agentic flows, and how do you ensure answer quality? I am passionate about making AI agents reliable. I would design with clear evaluation metrics, collect user feedback, and implement robust error handling to continuously improve the quality of responses. How do you handle collaboration between product, UX, and engineering teams for a feature? I schedule regular syncs, ensure requirements are clear, and do iterative development with constant communication. I also involve UX early to validate user interactions and adapt based on feedback. GitLab is the intelligent orchestration platform for DevSecOps. GitLab enables organizations to increase developer productivity, improve operational efficiency, reduce security and compliance risk, and accelerate digital transformation. More than 50 million registered users and more than 50% of the Fortune 100* trust GitLab to ship better, more secure software faster. The same principles built into our products are reflected in how our team works: we embrace AI as a core productivity multiplier, with all team members expected to incorporate AI into their daily workflows to drive efficiency, innovation, and impact. GitLab is where careers accelerate, innovation flourishes, and every voice is valued. Our high-performance culture is driven by our values and continuous knowledge exchange, enabling our team members to reach their full potential while collaborating with industry leaders to solve complex problems. [Co-create the future with us](https://www.youtube.com/watch?v=OuZIb5zszQI) as we build technology that transforms how the world develops software. *Fortune 500® is a registered trademark of Fortune Media IP Limited, used under license. Claim based on GitLab data. Fortune 100 refers to the top 20% ranked companies in the 2025 Fortune 500 list, published in June 2025. Fortune and Fortune Media IP Limited are not affiliated with, and do not endorse products or services of GitLab. ## An overview of this role As a Senior Backend Engineer on the Duo Chat team, focused on Chat Engine, you’ll build the core AI capabilities behind GitLab Duo Chat, the natural-language and agentic interface to the GitLab DevSecOps platform. Much of your work will involve building flow components and agentic flows in the Flow Registry, the Python framework built on LangGraph within our Duo Workflow Service that powers agentic chat, and integrating them with the GitLab Rails monolith. You’ll own complex backend features from start to finish across both services. You’ll integrate large language models and orchestrate multi-agent flows so customers can work faster and more securely across the software development lifecycle. This work sits where GitLab’s core platform meets its AI strategy, and reliability, performance, and answer quality directly shape the customer experience. ## What you’ll do * Design and build flow components and agentic flows in the Flow Registry using Python and LangGraph within the Duo Workflow Service. These reusable building blocks power agentic Duo Chat and, increasingly, other AI features across GitLab. * Develop, ship, and maintain backend features for GitLab Duo Chat across the Python Duo Workflow Service and the GitLab Rails monolith in a secure, well-tested, and performant way. * Integrate new generative AI models, providers, tools, and multi-agent orchestration patterns into Duo Chat to expand its capabilities and improve answer quality. * Design, implement, and review GraphQL and Representational State Transfer (REST) application programming interfaces (APIs) and related monolith logic, including chat entry points, permissions, and foundational-flow registration. Keep contracts with frontend clients and host systems reliable and clear. * Improve debugging, observability, and test coverage using pytest, RSpec, and related frameworks; track and improve latency, error rates, and test coverage so AI-powered chat workflows stay reliable at scale. * Collaborate with Product, User Experience (UX), frontend, and AI specialists to refine requirements and deliver high-quality improvements through iteration. * Document standards, patterns, and learnings with other engineers, raising the bar for safe AI integration and evidence-driven engineering. * Participate in Tier 2 on-call rotations to troubleshoot production issues, contribute to root cause analysis, and strengthen resiliency. ## What you’ll bring * Significant experience building and maintaining production Python backends, including APIs, data models, and asynchronous or long-running workloads. * Practical experience designing and shipping AI-powered, agentic backend features, including large language model integration, tool or function calling, and multi-agent orchestration. You use sound judgment about large language model limitations and safe use in production. * Working proficiency in Ruby on Rails, or a strong willingness to learn it. Duo Chat integrates deeply with the GitLab monolith for chat entry points, GraphQL, permissions, and flow registration, and most of GitLab’s codebase is written in Ruby. * Proficiency designing or extending REST or GraphQL APIs with attention to scalability, maintainability, and backward compatibility. * Strong Structured Query Language (SQL) skills and familiarity with relational databases such as PostgreSQL, including efficient queries and data modeling. * Ability to find, diagnose, and prevent performance and reliability problems at scale. * Experience solving technical problems of high scope and complexity and advocating for quality, security, and performance improvements across your team. * Openness to learning and collaborating in an async-first, distributed team, applying transferable skills from related technologies or domains. Hands-on experience with agent frameworks such as LangGraph or LangChain is a strong plus. ## About the team We’re part of GitLab’s AI Engineering organization and own the AI-powered chat experience embedded across the GitLab platform. Chat Engine is the backend-focused team within the Duo Chat group. We’re backend, frontend, and AI specialists working asynchronously across time zones, using issues, merge requests, and documentation as our main collaboration tools. Our focus is to expand generative and agentic AI capabilities, improve the performance and reliability of chat workflows, and strengthen the debugging and testing foundations that let us run AI features safely at scale. For more on how we work, see the [team handbook](https://handbook.gitlab.com/handbook/engineering/ai/duo-chat/) page. Remote-Global ### How GitLab Supports Full-Time Employees * [Benefits to support your health, finances, and well-being](https://about.gitlab.com/handbook/total-rewards/benefits/general-and-entity-benefits/) * [Flexible Paid Time Off ](https://handbook.gitlab.com/handbook/people-group/time-off-and-absence/time-off-types/#flexible-paid-time-off-pto) * [Team Member Resource Groups](https://handbook.gitlab.com/handbook/company/culture/inclusion/tmrg-tmag/) * [Equity Compensation & Employee Stock Purchase Plan](https://handbook.gitlab.com/handbook/total-rewards/stock-options/) * [Growth and Development Fund](https://handbook.gitlab.com/handbook/people-group/learning-and-development/growth-and-development/) * [Parental Leave](https://about.gitlab.com/handbook/total-rewards/benefits/general-and-entity-benefits/#parental-leave) Please note that we welcome interest from candidates with varying levels of experience; many successful candidates do not meet every single requirement. Additionally, studies have shown that people from [underrepresented groups](https://about.gitlab.com/company/culture/inclusion/#examples-of-select-underrepresented-groups) are less likely to apply to a job unless they meet every single qualification. If you’re excited about this role, please apply and allow our recruiters to assess your application. Country Hiring Guidelines: GitLab hires new team members in countries around the world. All of our roles are remote, however some roles may carry specific location-based eligibility requirements. Our Talent Acquisition team can help answer any questions about location after starting the recruiting process. Privacy Policy: Please review our [Recruitment Privacy Policy.](https://handbook.gitlab.com/handbook/hiring/candidate-faq/recruitment-privacy-policy/) Your privacy is important to us. GitLab is proud to be an equal opportunity workplace and is an affirmative action employer. GitLab’s policies and practices relating to recruitment, employment, career development and advancement, promotion, and retirement are based solely on merit, regardless of race, color, religion, ancestry, sex (including pregnancy, lactation, sexual orientation, gender identity, or gender expression), national origin, age, citizenship, marital status, mental or physical disability, genetic information (including family medical history), discharge status from the military, protected veteran status (which includes disabled veterans, recently separated veterans, active duty wartime or campaign badge veterans, and Armed Forces service medal veterans), or any other basis protected by law. GitLab will not tolerate discrimination or harassment based on any of these characteristics. See also [GitLab’s EEO Policy](https://about.gitlab.com/handbook/people-policies/inc-usa/#equal-employment-opportunity-policy) and [EEO is the Law](https://about.gitlab.com/handbook/labor-and-employment-notices/#eeoc-us-equal-employment-opportunity-commission-notices). If you have a disability or special need that requires [accommodation](https://about.gitlab.com/handbook/people-policies/inc-usa/#reasonable-accommodation), please let us know during the [recruiting process](https://about.gitlab.com/handbook/hiring/interviewing/#adjustments-to-our-interview-process). Show more [Apply now >](https://jobicy.com/jobs/150061-senior-backend-engineer-ai-engineering-chat.md) > Annual salary information is not provided for this position. Explore salary ranges for similar roles in our [Salary Directory ›](https://jobicy.com/salaries.md) * ![Upload CV](data:image/svg+xml;base64,PHN2ZyB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciIHdpZHRoPSI2NSIgaGVpZ2h0PSI2NSIgZmlsbD0ibm9uZSIgeG1sbnM6dj0iaHR0cHM6Ly92ZWN0YS5pby9uYW5vIj48ZyBjbGlwLXBhdGg9InVybCgjQSkiPjxwYXRoIGQ9Ik0wIDBINjVWNjVIMFYwWiIgZmlsbD0iIzAyOWFlYiIvPjxnIGZpbGw9IiNmZmYiIHN0cm9rZT0iI2ZmZiIgc3Ryb2tlLXdpZHRoPSIyIj48cGF0aCBkPSJNMzMuMDQ5IDE1LjQ1NGExLjQzIDEuNDMgMCAwIDAtMi4wOTcgMGwtNy41NzkgOC4xNDdhMS4zOCAxLjM4IDAgMCAwIC4wOSAxLjk3MyAxLjQ0IDEuNDQgMCAwIDAgMi4wMDgtLjA4OGw1LjEwOS01LjQ5MnYyMC42MWExLjQxIDEuNDEgMCAwIDAgMS40MjEgMS4zOTdjLjc4NSAwIDEuNDIxLS42MjUgMS40MjEtMS4zOTd2LTIwLjYxbDUuMTA5IDUuNDkyYTEuNDQgMS40NCAwIDAgMCAyLjAwOC4wODggMS4zOCAxLjM4IDAgMCAwIC4wOS0xLjk3M2wtNy41NzktOC4xNDZ6TTE2Ljc2OSAzOC40YzAtLjc3My0uNjItMS40LTEuMzg1LTEuNFMxNCAzNy42MjcgMTQgMzguNHYuMTAybC4yMTUgNi4yMjljLjIyMyAxLjY4LjcwMSAzLjA5NSAxLjgxMyA0LjIxOHMyLjUxIDEuNjA3IDQuMTcyIDEuODMzYzEuNi4yMTggMy42MzYuMjE4IDYuMTYuMjE4aDExLjI4bDYuMTYtLjIxOGMxLjY2Mi0uMjI2IDMuMDYxLS43MDkgNC4xNzItMS44MzNzMS41ODktMi41MzggMS44MTMtNC4yMThDNTAgNDMuMTEzIDUwIDQxLjA1NSA1MCAzOC41MDNWMzguNGMwLS43NzMtLjYyLTEuNC0xLjM4NS0xLjRzLTEuMzg1LjYyNy0xLjM4NSAxLjRsLS4xOSA1Ljk1OGMtLjE4MiAxLjM3LS41MTUgMi4wOTUtMS4wMjYgMi42MTJzLTEuMjI4Ljg1My0yLjU4MyAxLjAzOGMtMS4zOTUuMTktMy4yNDMuMTkzLTUuODkzLjE5M0gyNi40NjJjLTIuNjUgMC00LjQ5OC0uMDAzLTUuODkzLS4xOTMtMS4zNTUtLjE4NC0yLjA3Mi0uNTIxLTIuNTgzLTEuMDM4cy0uODQ0LTEuMjQyLTEuMDI2LTIuNjEyYy0uMTg3LTEuNDEtLjE5MS0zLjI3OS0uMTkxLTUuOTU4eiIvPjwvZz48L2c+PGRlZnM+PGNsaXBQYXRoIGlkPSJBIj48cGF0aCBmaWxsPSIjZmZmIiBkPSJNMCAwaDY1djY1SDB6Ii8+PC9jbGlwUGF0aD48L2RlZnM+PC9zdmc+) ### Upload your resume now To unlock remote work opportunities and be discovered by global employers. This job listing has been manually reviewed by the Jobicy Trust & Safety Team for compliance with our posting guidelines, including verification of the company's legitimacy, accuracy of job details, clarity of remote work policy, and absence of misleading or fraudulent content. Next step ## Apply now. Follow the employer’s application method and review Jobicy’s safety guidance before sharing personal information. Keep exploring ## Related remote jobs. Matched by job category10 related opportunities[Software Engineering](https://jobicy.com/categories/engineering.md) [Browse all jobs](https://jobicy.com/jobs.md) * ![NVIDIA logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/06/52745899-221.jpeg) NVIDIA Aug 1 ### [Senior HPC Performance Engineer](https://jobicy.com/jobs/142109-senior-hpc-performance-engineer.md) As a member of our team in NVIDIA’s NVHPC compilers & tools group, you will analyze and run High Performance Computing (HPC) applications on HPC servers and systems to gain… * ![Okta logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/06/d54f5eb5-221.png) Okta Aug 1 ### [Demo Engineer](https://jobicy.com/jobs/148141-demo-engineer.md) Secure Every Identity, from AI to HumanIdentity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely… * ![Reddit logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2020/10/Reddit.jpg) Reddit Aug 1 ### [Senior Software Engineer, Storage](https://jobicy.com/jobs/148143-senior-software-engineer-storage.md) Reddit is a community of communities. It’s built on shared interests, passion, and trust, and is home to the most open and authentic conversations on the internet. Every day, Reddit… * ![Aviatrix logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/06/c783b38c-221.jpeg) Aviatrix Aug 1 ### [Senior Solutions Architect – ACE](https://jobicy.com/jobs/148145-senior-solutions-architect-ace.md) WHO WE ARE: Aviatrix® is pioneering the Cloud Native Security Fabric — the architecture the Containment Era requires. The Cloud Native Security Fabric governs every workload communication path across… * ![Veeam Software logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/06/f7716b71-221.jpg) Veeam Software Aug 1 ### [Software Developer in Test (JavaScript)](https://jobicy.com/jobs/144087-software-developer-in-test-javascript-2.md) Veeam is the Data and AI Trust Company, specializing in helping organizations ensure their data and AI are fully understood, secured, and resilient to enable the acceleration of safe AI… * ![Binance logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/06/bc822f38-221.jpg) Binance Aug 1 ### [Data/ Java Engineer (AI/LLM Chatbot, Customer Service)](https://jobicy.com/jobs/150065-data-java-engineer-ai-llm-chatbot-customer-service.md) Binance is the leading global blockchain ecosystem and cryptocurrency infrastructure provider whose suite of financial products includes the world’s largest digital-asset exchange.Our mission is to accelerate cryptocurrency adoption and increase… * ![Binance logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/06/bc822f38-221.jpg) Binance Aug 1 ### [Client Full-Stack Engineer — IM Chat Platform, Android Focus](https://jobicy.com/jobs/150064-client-full-stack-engineer-im-chat-platform-android-focus.md) Binance is a leading global blockchain ecosystem behind the world’s largest cryptocurrency exchange by trading volume and registered users. We are trusted by 300+ million people in 100+ countries for… * ![Mindrift logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/06/8c9f770c-221-1.jpeg) Mindrift Aug 1 ### [Chatbot Developer (WhatsApp, Telegram, Discord) – Freelance](https://jobicy.com/jobs/150059-chatbot-developer-whatsapp-telegram-discord-freelance.md) Mindrift is looking for skilled Bot Developers (WhatsApp Business API, Telegram Bot API, Discord API) to join the Tendem project (https://tendem.ai/) and build conversational bots and messaging-platform integrations for real-world applications. In… * ![Softgic logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/06/80b93c85-221.jpeg) Softgic Aug 1 ### [1775 RPG/AS400 & JD Edwards EnterpriseOne Developer](https://jobicy.com/jobs/150052-1775-rpg-as400-jd-edwards-enterpriseone-developer.md) This is a remote position. We are looking for a professional with hands-on experience developing in RPG/RPGLE on IBM AS400/iSeries, as well as proven experience with JD Edwards EnterpriseOne development… * ![RTX logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/06/50b38b57-221.jpeg) RTX Aug 1 ### [Principal Hardware Design Engineer – Computing Products](https://jobicy.com/jobs/150048-principal-hardware-design-engineer-computing-products.md) Date Posted:2026-07-31 Country:United States of America Location:US-IA-REMOTE Position Role Type:Remote U.S. Citizen, U.S. Person, or Immigration Status Requirements: U.S. citizenship is required, as only U.S. citizens are authorized to access…